Oct 30 20:01:05.509366 ip-10-0-139-217 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Oct 30 20:01:05.509377 ip-10-0-139-217 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Oct 30 20:01:05.509386 ip-10-0-139-217 systemd[1]: kubelet.service: Failed with result 'resources'. Oct 30 20:01:05.509700 ip-10-0-139-217 systemd[1]: Failed to start Kubernetes Kubelet. Oct 30 20:01:15.758809 ip-10-0-139-217 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Oct 30 20:01:15.758825 ip-10-0-139-217 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a426ad57108042bbb688a28aac771f7d -- Oct 30 20:03:01.190677 ip-10-0-139-217 systemd[1]: Starting Kubernetes Kubelet... Oct 30 20:03:01.643839 ip-10-0-139-217 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 20:03:01.643839 ip-10-0-139-217 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 20:03:01.643839 ip-10-0-139-217 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 20:03:01.643839 ip-10-0-139-217 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 20:03:01.648432 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648324 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 20:03:01.648432 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648427 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 20:03:01.648432 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648432 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 20:03:01.648432 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648437 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 20:03:01.648432 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648441 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 20:03:01.648733 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648445 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 20:03:01.648733 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648449 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 20:03:01.648733 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648453 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 20:03:01.648733 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648456 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 20:03:01.648733 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648460 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 20:03:01.648733 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648464 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 20:03:01.648733 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648468 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 20:03:01.648733 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648471 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 20:03:01.648733 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648475 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 20:03:01.648733 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648479 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 20:03:01.648733 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648483 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 20:03:01.648733 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648487 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 20:03:01.648733 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648491 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 20:03:01.648733 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648495 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 20:03:01.648733 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648498 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 20:03:01.648733 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648502 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 20:03:01.648733 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648506 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 20:03:01.648733 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648509 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 20:03:01.648733 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648513 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 20:03:01.648733 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648517 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 20:03:01.649562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648520 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 20:03:01.649562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648524 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 20:03:01.649562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648540 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 20:03:01.649562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648544 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 20:03:01.649562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648548 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 20:03:01.649562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648552 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 20:03:01.649562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648556 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 20:03:01.649562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648559 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 20:03:01.649562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648564 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 20:03:01.649562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648568 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 20:03:01.649562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648572 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 20:03:01.649562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648577 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 20:03:01.649562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648581 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 20:03:01.649562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648588 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 20:03:01.649562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648595 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 20:03:01.649562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648600 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 20:03:01.649562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648605 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 20:03:01.649562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648609 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 20:03:01.649562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648613 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 20:03:01.650354 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648617 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 20:03:01.650354 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648622 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 20:03:01.650354 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648626 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 20:03:01.650354 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648630 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 20:03:01.650354 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648635 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 20:03:01.650354 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648639 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 20:03:01.650354 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648643 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 20:03:01.650354 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648648 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 20:03:01.650354 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648652 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 20:03:01.650354 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648656 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 20:03:01.650354 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648661 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 20:03:01.650354 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648665 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 20:03:01.650354 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648670 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 20:03:01.650354 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648674 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 20:03:01.650354 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648678 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 20:03:01.650354 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648683 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 20:03:01.650354 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648688 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 20:03:01.650354 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648692 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 20:03:01.650354 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648698 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 20:03:01.651152 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648703 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 20:03:01.651152 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648707 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 20:03:01.651152 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648714 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 20:03:01.651152 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648721 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 20:03:01.651152 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648727 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 20:03:01.651152 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648731 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 20:03:01.651152 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648736 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 20:03:01.651152 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648740 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 20:03:01.651152 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648744 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 20:03:01.651152 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648749 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 20:03:01.651152 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648753 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 20:03:01.651152 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648757 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 20:03:01.651152 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648762 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 20:03:01.651152 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648766 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 20:03:01.651152 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648772 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 20:03:01.651152 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648777 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 20:03:01.651152 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648782 2578 feature_gate.go:386] unrecognized feature gate: Example Oct 30 20:03:01.651152 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648787 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 20:03:01.651152 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648791 2578 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 20:03:01.651988 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648795 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 20:03:01.651988 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648800 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 20:03:01.651988 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648804 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 20:03:01.651988 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648808 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 20:03:01.651988 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648812 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 20:03:01.651988 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648817 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 20:03:01.651988 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648821 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 20:03:01.651988 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648825 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 20:03:01.651988 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648830 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 20:03:01.651988 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648834 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 20:03:01.651988 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648838 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 20:03:01.651988 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648847 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 20:03:01.651988 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648852 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 20:03:01.651988 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648857 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 20:03:01.651988 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648861 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 20:03:01.651988 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648865 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 20:03:01.651988 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648870 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 20:03:01.651988 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648874 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 20:03:01.651988 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648878 2578 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 20:03:01.651988 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648883 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 20:03:01.652678 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648887 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 20:03:01.652678 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648892 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 20:03:01.652678 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648896 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 20:03:01.652678 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.648901 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 20:03:01.652678 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650202 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 20:03:01.652678 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650213 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 20:03:01.652678 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650219 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 20:03:01.652678 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650224 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 20:03:01.652678 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650230 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 20:03:01.652678 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650235 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 20:03:01.652678 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650239 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 20:03:01.652678 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650243 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 20:03:01.652678 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650248 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 20:03:01.652678 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650252 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 20:03:01.652678 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650256 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 20:03:01.652678 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650260 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 20:03:01.652678 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650265 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 20:03:01.652678 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650270 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 20:03:01.652678 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650275 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 20:03:01.653171 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650280 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 20:03:01.653171 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650284 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 20:03:01.653171 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650288 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 20:03:01.653171 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650293 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 20:03:01.653171 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650299 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 20:03:01.653171 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650306 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 20:03:01.653171 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650311 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 20:03:01.653171 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650315 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 20:03:01.653171 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650320 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 20:03:01.653171 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650324 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 20:03:01.653171 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650347 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 20:03:01.653171 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650351 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 20:03:01.653171 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650356 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 20:03:01.653171 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650360 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 20:03:01.653171 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650364 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 20:03:01.653171 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650368 2578 feature_gate.go:386] unrecognized feature gate: Example Oct 30 20:03:01.653171 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650373 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 20:03:01.653171 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650377 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 20:03:01.653171 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650381 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 20:03:01.653171 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650387 2578 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 20:03:01.654007 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650391 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 20:03:01.654007 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650395 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 20:03:01.654007 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650399 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 20:03:01.654007 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650403 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 20:03:01.654007 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650407 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 20:03:01.654007 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650412 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 20:03:01.654007 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650417 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 20:03:01.654007 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650421 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 20:03:01.654007 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650425 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 20:03:01.654007 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650429 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 20:03:01.654007 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650433 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 20:03:01.654007 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650438 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 20:03:01.654007 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650442 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 20:03:01.654007 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650447 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 20:03:01.654007 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650451 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 20:03:01.654007 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650456 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 20:03:01.654007 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650460 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 20:03:01.654007 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650465 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 20:03:01.654007 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650470 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 20:03:01.654007 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650475 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 20:03:01.654888 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650479 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 20:03:01.654888 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650484 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 20:03:01.654888 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650488 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 20:03:01.654888 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650492 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 20:03:01.654888 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650497 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 20:03:01.654888 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650501 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 20:03:01.654888 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650505 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 20:03:01.654888 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650509 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 20:03:01.654888 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650513 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 20:03:01.654888 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650517 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 20:03:01.654888 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650522 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 20:03:01.654888 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650526 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 20:03:01.654888 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650530 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 20:03:01.654888 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650534 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 20:03:01.654888 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650539 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 20:03:01.654888 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650543 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 20:03:01.654888 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650547 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 20:03:01.654888 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650551 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 20:03:01.654888 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650555 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 20:03:01.655700 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650559 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 20:03:01.655700 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650563 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 20:03:01.655700 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650568 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 20:03:01.655700 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650572 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 20:03:01.655700 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650576 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 20:03:01.655700 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650582 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 20:03:01.655700 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650586 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 20:03:01.655700 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650591 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 20:03:01.655700 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650595 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 20:03:01.655700 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650602 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 20:03:01.655700 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650608 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 20:03:01.655700 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650613 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 20:03:01.655700 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650619 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 20:03:01.655700 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650624 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 20:03:01.655700 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650628 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 20:03:01.655700 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650633 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 20:03:01.655700 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650637 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 20:03:01.655700 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650641 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 20:03:01.655700 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650645 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 20:03:01.656163 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650649 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 20:03:01.656163 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650653 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 20:03:01.656163 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650658 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 20:03:01.656163 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650662 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 20:03:01.656163 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650666 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 20:03:01.656163 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650670 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 20:03:01.656163 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650674 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 20:03:01.656163 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650678 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 20:03:01.656163 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650683 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 20:03:01.656163 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650687 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 20:03:01.656163 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650691 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 20:03:01.656163 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650695 2578 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 20:03:01.656163 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.650699 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 20:03:01.656163 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651569 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 20:03:01.656163 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651579 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 20:03:01.656163 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651583 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 20:03:01.656163 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651587 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 20:03:01.656163 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651592 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 20:03:01.656163 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651596 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 20:03:01.656738 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651601 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 20:03:01.656738 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651605 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 20:03:01.656738 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651609 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 20:03:01.656738 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651614 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 20:03:01.656738 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651619 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 20:03:01.656738 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651623 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 20:03:01.656738 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651628 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 20:03:01.656738 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651633 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 20:03:01.656738 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651637 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 20:03:01.656738 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651642 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 20:03:01.656738 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651646 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 20:03:01.656738 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651649 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 20:03:01.656738 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651654 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 20:03:01.656738 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651658 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 20:03:01.656738 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651663 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 20:03:01.656738 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651667 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 20:03:01.656738 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651671 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 20:03:01.656738 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651676 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 20:03:01.656738 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651680 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 20:03:01.656738 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651684 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 20:03:01.657221 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651688 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 20:03:01.657221 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651693 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 20:03:01.657221 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651697 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 20:03:01.657221 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651701 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 20:03:01.657221 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651706 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 20:03:01.657221 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651710 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 20:03:01.657221 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651714 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 20:03:01.657221 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651718 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 20:03:01.657221 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651722 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 20:03:01.657221 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651726 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 20:03:01.657221 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651731 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 20:03:01.657221 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651735 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 20:03:01.657221 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651740 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 20:03:01.657221 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651744 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 20:03:01.657221 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651751 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 20:03:01.657221 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651758 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 20:03:01.657221 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651764 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 20:03:01.657221 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651768 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 20:03:01.657221 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651773 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 20:03:01.657221 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651778 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 20:03:01.657754 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651783 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 20:03:01.657754 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651787 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 20:03:01.657754 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651791 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 20:03:01.657754 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651796 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 20:03:01.657754 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651800 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 20:03:01.657754 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651804 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 20:03:01.657754 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651808 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 20:03:01.657754 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651812 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 20:03:01.657754 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651817 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 20:03:01.657754 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651821 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 20:03:01.657754 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651825 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 20:03:01.657754 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651829 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 20:03:01.657754 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651833 2578 feature_gate.go:386] unrecognized feature gate: Example Oct 30 20:03:01.657754 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651838 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 20:03:01.657754 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651842 2578 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 20:03:01.657754 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651846 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 20:03:01.657754 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651850 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 20:03:01.657754 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651855 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 20:03:01.657754 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651859 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 20:03:01.657754 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651863 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 20:03:01.658225 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651867 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 20:03:01.658225 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651871 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 20:03:01.658225 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651880 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 20:03:01.658225 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651884 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 20:03:01.658225 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651889 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 20:03:01.658225 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651893 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 20:03:01.658225 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651897 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 20:03:01.658225 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651902 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 20:03:01.658225 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651906 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 20:03:01.658225 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651911 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 20:03:01.658225 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651915 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 20:03:01.658225 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651921 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 20:03:01.658225 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651926 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 20:03:01.658225 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651930 2578 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 20:03:01.658225 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651934 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 20:03:01.658225 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651938 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 20:03:01.658225 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651942 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 20:03:01.658225 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651946 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 20:03:01.658225 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651951 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 20:03:01.658728 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651957 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 20:03:01.658728 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651963 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 20:03:01.658728 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651969 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 20:03:01.658728 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651974 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 20:03:01.658728 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651978 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 20:03:01.658728 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651983 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 20:03:01.658728 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651986 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 20:03:01.658728 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651991 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 20:03:01.658728 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.651995 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 20:03:01.658728 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.652000 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 20:03:01.658728 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.652004 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 20:03:01.658728 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.652008 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 20:03:01.658728 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.652012 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 20:03:01.658728 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.652017 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 20:03:01.658728 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.652021 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 20:03:01.658728 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.652027 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 20:03:01.658728 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.652033 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 20:03:01.658728 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.652037 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 20:03:01.658728 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.652041 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.652045 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.652055 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653261 2578 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653286 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653296 2578 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653303 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653310 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653319 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653341 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653348 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653353 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653370 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653376 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653382 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653388 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653393 2578 flags.go:64] FLAG: --cgroup-root="" Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653397 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653402 2578 flags.go:64] FLAG: --client-ca-file="" Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653407 2578 flags.go:64] FLAG: --cloud-provider="external" Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653412 2578 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653419 2578 flags.go:64] FLAG: --cluster-domain="" Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653424 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653429 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 20:03:01.659200 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653434 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653440 2578 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653446 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653451 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653456 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653462 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653467 2578 flags.go:64] FLAG: --contention-profiling="false" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653472 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653477 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653482 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653487 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653495 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653500 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653505 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653510 2578 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653515 2578 flags.go:64] FLAG: --enable-server="true" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653520 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653527 2578 flags.go:64] FLAG: --event-burst="100" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653532 2578 flags.go:64] FLAG: --event-qps="50" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653537 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653542 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653547 2578 flags.go:64] FLAG: --eviction-hard="" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653554 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653558 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653563 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 20:03:01.659792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653569 2578 flags.go:64] FLAG: --eviction-soft="" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653574 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653579 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653583 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653588 2578 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653593 2578 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653598 2578 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653603 2578 flags.go:64] FLAG: --feature-gates="" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653609 2578 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653614 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653620 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653625 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653629 2578 flags.go:64] FLAG: --healthz-port="10248" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653634 2578 flags.go:64] FLAG: --help="false" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653639 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653644 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653649 2578 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653654 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653662 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653667 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653672 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653677 2578 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653682 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 20:03:01.660432 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653687 2578 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653692 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653698 2578 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653703 2578 flags.go:64] FLAG: --kube-reserved="" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653707 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653712 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653717 2578 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653721 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653727 2578 flags.go:64] FLAG: --lock-file="" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653731 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653736 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653741 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653750 2578 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653755 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653759 2578 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653764 2578 flags.go:64] FLAG: --logging-format="text" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653769 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653775 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653779 2578 flags.go:64] FLAG: --manifest-url="" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653784 2578 flags.go:64] FLAG: --manifest-url-header="" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653791 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653796 2578 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653802 2578 flags.go:64] FLAG: --max-pods="110" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653807 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653812 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 20:03:01.660974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653817 2578 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653822 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653829 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653833 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653838 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653852 2578 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653857 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653862 2578 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653867 2578 flags.go:64] FLAG: --pod-cidr="" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653872 2578 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653877 2578 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653882 2578 flags.go:64] FLAG: --pods-per-core="0" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653886 2578 flags.go:64] FLAG: --port="10250" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653891 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653896 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0b812eebadafa4378" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653902 2578 flags.go:64] FLAG: --qos-reserved="" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653907 2578 flags.go:64] FLAG: --read-only-port="10255" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653912 2578 flags.go:64] FLAG: --register-node="true" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653916 2578 flags.go:64] FLAG: --register-with-taints="" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653922 2578 flags.go:64] FLAG: --registry-burst="10" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653927 2578 flags.go:64] FLAG: --registry-qps="5" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653932 2578 flags.go:64] FLAG: --reserved-cpus="" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653937 2578 flags.go:64] FLAG: --reserved-memory="" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653943 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653948 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653953 2578 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 20:03:01.661930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653957 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653962 2578 flags.go:64] FLAG: --runonce="false" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653967 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653972 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653978 2578 flags.go:64] FLAG: --seccomp-default="false" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653982 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653987 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653993 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.653999 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654004 2578 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654009 2578 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654014 2578 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654018 2578 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654022 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654027 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654032 2578 flags.go:64] FLAG: --system-cgroups="" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654037 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654046 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654051 2578 flags.go:64] FLAG: --tls-cert-file="" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654056 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654065 2578 flags.go:64] FLAG: --tls-min-version="" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654069 2578 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654074 2578 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654078 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654083 2578 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 20:03:01.662995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654088 2578 flags.go:64] FLAG: --v="2" Oct 30 20:03:01.663601 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654095 2578 flags.go:64] FLAG: --version="false" Oct 30 20:03:01.663601 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654101 2578 flags.go:64] FLAG: --vmodule="" Oct 30 20:03:01.663601 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654108 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 20:03:01.663601 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654113 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 20:03:01.663601 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654387 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 20:03:01.663601 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654397 2578 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 20:03:01.663601 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654401 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 20:03:01.663601 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654406 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 20:03:01.663601 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654411 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 20:03:01.663601 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654416 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 20:03:01.663601 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654421 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 20:03:01.663601 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654425 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 20:03:01.663601 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654429 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 20:03:01.663601 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654434 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 20:03:01.663601 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654439 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 20:03:01.663601 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654443 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 20:03:01.663601 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654448 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 20:03:01.663601 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654452 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 20:03:01.663601 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654456 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 20:03:01.663601 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654460 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 20:03:01.663601 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654464 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 20:03:01.664108 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654469 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 20:03:01.664108 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654473 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 20:03:01.664108 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654477 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 20:03:01.664108 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654483 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 20:03:01.664108 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654488 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 20:03:01.664108 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654494 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 20:03:01.664108 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654498 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 20:03:01.664108 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654502 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 20:03:01.664108 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654506 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 20:03:01.664108 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654510 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 20:03:01.664108 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654515 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 20:03:01.664108 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654520 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 20:03:01.664108 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654524 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 20:03:01.664108 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654529 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 20:03:01.664108 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654533 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 20:03:01.664108 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654537 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 20:03:01.664108 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654542 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 20:03:01.664108 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654546 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 20:03:01.664108 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654550 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 20:03:01.664586 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654554 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 20:03:01.664586 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654559 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 20:03:01.664586 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654563 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 20:03:01.664586 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654567 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 20:03:01.664586 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654571 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 20:03:01.664586 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654576 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 20:03:01.664586 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654580 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 20:03:01.664586 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654585 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 20:03:01.664586 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654589 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 20:03:01.664586 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654593 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 20:03:01.664586 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654597 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 20:03:01.664586 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654602 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 20:03:01.664586 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654606 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 20:03:01.664586 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654612 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 20:03:01.664586 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654618 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 20:03:01.664586 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654622 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 20:03:01.664586 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654627 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 20:03:01.664586 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654632 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 20:03:01.664586 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654638 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 20:03:01.665038 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654642 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 20:03:01.665038 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654647 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 20:03:01.665038 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654652 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 20:03:01.665038 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654656 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 20:03:01.665038 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654660 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 20:03:01.665038 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654665 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 20:03:01.665038 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654669 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 20:03:01.665038 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654673 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 20:03:01.665038 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654678 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 20:03:01.665038 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654682 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 20:03:01.665038 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654687 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 20:03:01.665038 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654691 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 20:03:01.665038 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654696 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 20:03:01.665038 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654700 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 20:03:01.665038 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654704 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 20:03:01.665038 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654708 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 20:03:01.665038 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654713 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 20:03:01.665038 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654717 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 20:03:01.665038 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654721 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 20:03:01.665038 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654725 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 20:03:01.665593 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654729 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 20:03:01.665593 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654734 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 20:03:01.665593 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654738 2578 feature_gate.go:386] unrecognized feature gate: Example Oct 30 20:03:01.665593 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654742 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 20:03:01.665593 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654746 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 20:03:01.665593 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654750 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 20:03:01.665593 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654754 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 20:03:01.665593 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654758 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 20:03:01.665593 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654763 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 20:03:01.665593 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654767 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 20:03:01.665593 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654772 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 20:03:01.665593 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654778 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 20:03:01.665593 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654783 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 20:03:01.665593 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654787 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 20:03:01.665593 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654791 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 20:03:01.665593 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654796 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 20:03:01.665593 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654800 2578 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 20:03:01.665593 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654804 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 20:03:01.665593 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654808 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 20:03:01.665593 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654815 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 20:03:01.666068 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654821 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 20:03:01.666068 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654825 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 20:03:01.666068 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654829 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 20:03:01.666068 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654834 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 20:03:01.666068 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654838 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 20:03:01.666068 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654843 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 20:03:01.666068 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654848 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 20:03:01.666068 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654852 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 20:03:01.666068 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654856 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 20:03:01.666068 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654861 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 20:03:01.666068 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654865 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 20:03:01.666068 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.654906 2578 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 20:03:01.666068 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654970 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 20:03:01.666068 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654978 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 20:03:01.666068 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654984 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 20:03:01.666068 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.654998 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 20:03:01.666469 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655003 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 20:03:01.666469 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655009 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 20:03:01.666469 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655013 2578 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 20:03:01.666469 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655018 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 20:03:01.666469 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655023 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 20:03:01.666469 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655029 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 20:03:01.666469 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655036 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 20:03:01.666469 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655041 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 20:03:01.666469 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655048 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 20:03:01.666469 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655053 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 20:03:01.666469 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655057 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 20:03:01.666469 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655061 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 20:03:01.666469 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655066 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 20:03:01.666469 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655070 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 20:03:01.666469 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655075 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 20:03:01.666469 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655079 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 20:03:01.666469 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655083 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 20:03:01.666469 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655088 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 20:03:01.666469 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655093 2578 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 20:03:01.666919 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655098 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 20:03:01.666919 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655102 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 20:03:01.666919 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655106 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 20:03:01.666919 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655110 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 20:03:01.666919 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655115 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 20:03:01.666919 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655119 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 20:03:01.666919 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655123 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 20:03:01.666919 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655128 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 20:03:01.666919 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655132 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 20:03:01.666919 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655136 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 20:03:01.666919 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655140 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 20:03:01.666919 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655145 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 20:03:01.666919 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655149 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 20:03:01.666919 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655153 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 20:03:01.666919 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655157 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 20:03:01.666919 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655162 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 20:03:01.666919 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655166 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 20:03:01.666919 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655170 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 20:03:01.666919 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655176 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 20:03:01.666919 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655181 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 20:03:01.667423 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655185 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 20:03:01.667423 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655192 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 20:03:01.667423 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655197 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 20:03:01.667423 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655201 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 20:03:01.667423 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655206 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 20:03:01.667423 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655210 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 20:03:01.667423 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655214 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 20:03:01.667423 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655219 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 20:03:01.667423 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655223 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 20:03:01.667423 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655228 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 20:03:01.667423 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655232 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 20:03:01.667423 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655238 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 20:03:01.667423 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655242 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 20:03:01.667423 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655246 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 20:03:01.667423 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655251 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 20:03:01.667423 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655255 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 20:03:01.667423 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655259 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 20:03:01.667423 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655263 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 20:03:01.667423 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655268 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 20:03:01.667882 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655272 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 20:03:01.667882 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655277 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 20:03:01.667882 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655281 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 20:03:01.667882 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655285 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 20:03:01.667882 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655289 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 20:03:01.667882 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655294 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 20:03:01.667882 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655299 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 20:03:01.667882 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655303 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 20:03:01.667882 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655309 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 20:03:01.667882 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655315 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 20:03:01.667882 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655320 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 20:03:01.667882 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655339 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 20:03:01.667882 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655344 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 20:03:01.667882 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655348 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 20:03:01.667882 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655354 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 20:03:01.667882 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655359 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 20:03:01.667882 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655366 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 20:03:01.667882 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655370 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 20:03:01.667882 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655375 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 20:03:01.669382 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655379 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 20:03:01.669382 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655383 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 20:03:01.669382 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655387 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 20:03:01.669382 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655391 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 20:03:01.669382 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655395 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 20:03:01.669382 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655402 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 20:03:01.669382 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655406 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 20:03:01.669382 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655411 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 20:03:01.669382 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655415 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 20:03:01.669382 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655420 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 20:03:01.669382 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655424 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 20:03:01.669382 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655428 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 20:03:01.669382 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655433 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 20:03:01.669382 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655437 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 20:03:01.669382 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655440 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 20:03:01.669382 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655445 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 20:03:01.669382 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655449 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 20:03:01.669382 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655454 2578 feature_gate.go:386] unrecognized feature gate: Example Oct 30 20:03:01.669382 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655458 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 20:03:01.669382 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655462 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 20:03:01.669876 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655466 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 20:03:01.669876 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655470 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 20:03:01.669876 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655475 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 20:03:01.669876 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655479 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 20:03:01.669876 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.655483 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 20:03:01.669876 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.664513 2578 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 20:03:01.669876 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.664640 2578 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 20:03:01.669876 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.665376 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 20:03:01.669876 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.665384 2578 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 20:03:01.669876 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665449 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 20:03:01.669876 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665454 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 20:03:01.669876 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665457 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 20:03:01.669876 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665461 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 20:03:01.669876 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665464 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 20:03:01.669876 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665467 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 20:03:01.669876 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665471 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 20:03:01.669876 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665476 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 20:03:01.669876 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665479 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 20:03:01.669876 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665482 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 20:03:01.670398 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665484 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 20:03:01.670398 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665487 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 20:03:01.670398 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665490 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 20:03:01.670398 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665492 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 20:03:01.670398 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665495 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 20:03:01.670398 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665498 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 20:03:01.670398 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665501 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 20:03:01.670398 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665503 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 20:03:01.670398 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665506 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 20:03:01.670398 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665509 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 20:03:01.670398 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665512 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 20:03:01.670398 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665514 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 20:03:01.670398 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665517 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 20:03:01.670398 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665525 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 20:03:01.670398 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665528 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 20:03:01.670398 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665531 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 20:03:01.670398 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665535 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 20:03:01.670398 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665539 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 20:03:01.670398 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665542 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 20:03:01.670845 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665545 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 20:03:01.670845 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665548 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 20:03:01.670845 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665551 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 20:03:01.670845 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665553 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 20:03:01.670845 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665556 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 20:03:01.670845 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665559 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 20:03:01.670845 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665562 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 20:03:01.670845 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665564 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 20:03:01.670845 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665567 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 20:03:01.670845 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665570 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 20:03:01.670845 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665572 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 20:03:01.670845 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665575 2578 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 20:03:01.670845 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665578 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 20:03:01.670845 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665581 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 20:03:01.670845 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665583 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 20:03:01.670845 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665586 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 20:03:01.670845 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665589 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 20:03:01.670845 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665591 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 20:03:01.670845 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665595 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 20:03:01.671314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665598 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 20:03:01.671314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665600 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 20:03:01.671314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665603 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 20:03:01.671314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665606 2578 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 20:03:01.671314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665609 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 20:03:01.671314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665611 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 20:03:01.671314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665614 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 20:03:01.671314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665616 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 20:03:01.671314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665619 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 20:03:01.671314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665622 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 20:03:01.671314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665625 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 20:03:01.671314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665628 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 20:03:01.671314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665631 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 20:03:01.671314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665634 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 20:03:01.671314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665636 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 20:03:01.671314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665639 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 20:03:01.671314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665642 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 20:03:01.671314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665644 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 20:03:01.671314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665647 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 20:03:01.671784 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665650 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 20:03:01.671784 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665653 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 20:03:01.671784 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665656 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 20:03:01.671784 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665658 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 20:03:01.671784 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665661 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 20:03:01.671784 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665663 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 20:03:01.671784 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665666 2578 feature_gate.go:386] unrecognized feature gate: Example Oct 30 20:03:01.671784 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665669 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 20:03:01.671784 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665671 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 20:03:01.671784 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665674 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 20:03:01.671784 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665676 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 20:03:01.671784 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665679 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 20:03:01.671784 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665682 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 20:03:01.671784 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665685 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 20:03:01.671784 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665688 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 20:03:01.671784 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665690 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 20:03:01.671784 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665693 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 20:03:01.671784 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665696 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 20:03:01.671784 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665698 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 20:03:01.671784 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665701 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 20:03:01.672258 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665704 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 20:03:01.672258 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665706 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 20:03:01.672258 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665709 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 20:03:01.672258 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665711 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 20:03:01.672258 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665714 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 20:03:01.672258 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665717 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 20:03:01.672258 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665720 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 20:03:01.672258 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665723 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 20:03:01.672258 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665725 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 20:03:01.672258 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665728 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 20:03:01.672258 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665731 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 20:03:01.672258 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665733 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 20:03:01.672258 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665736 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 20:03:01.672258 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665739 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 20:03:01.672258 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665741 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 20:03:01.672258 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665744 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 20:03:01.672258 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665746 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 20:03:01.672258 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665749 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 20:03:01.672258 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665752 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 20:03:01.672712 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.665780 2578 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 20:03:01.672712 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665946 2578 feature_gate.go:386] unrecognized feature gate: Example Oct 30 20:03:01.672712 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665952 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 20:03:01.672712 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665956 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 20:03:01.672712 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665960 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 20:03:01.672712 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665963 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 20:03:01.672712 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665967 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 20:03:01.672712 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665970 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 20:03:01.672712 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665973 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 20:03:01.672712 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665975 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 20:03:01.672712 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665980 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 20:03:01.672712 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665984 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 20:03:01.672712 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665987 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 20:03:01.672712 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665990 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 20:03:01.672712 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665992 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 20:03:01.673091 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665995 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 20:03:01.673091 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.665998 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 20:03:01.673091 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666001 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 20:03:01.673091 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666003 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 20:03:01.673091 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666006 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 20:03:01.673091 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666009 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 20:03:01.673091 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666011 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 20:03:01.673091 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666014 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 20:03:01.673091 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666017 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 20:03:01.673091 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666019 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 20:03:01.673091 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666022 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 20:03:01.673091 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666024 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 20:03:01.673091 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666027 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 20:03:01.673091 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666029 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 20:03:01.673091 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666032 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 20:03:01.673091 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666034 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 20:03:01.673091 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666037 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 20:03:01.673091 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666040 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 20:03:01.673091 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666042 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 20:03:01.673091 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666045 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 20:03:01.673562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666047 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 20:03:01.673562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666050 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 20:03:01.673562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666052 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 20:03:01.673562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666055 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 20:03:01.673562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666058 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 20:03:01.673562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666061 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 20:03:01.673562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666063 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 20:03:01.673562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666066 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 20:03:01.673562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666069 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 20:03:01.673562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666072 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 20:03:01.673562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666074 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 20:03:01.673562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666077 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 20:03:01.673562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666080 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 20:03:01.673562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666083 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 20:03:01.673562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666085 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 20:03:01.673562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666088 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 20:03:01.673562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666090 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 20:03:01.673562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666093 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 20:03:01.673562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666096 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 20:03:01.673562 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666098 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 20:03:01.674039 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666100 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 20:03:01.674039 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666103 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 20:03:01.674039 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666106 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 20:03:01.674039 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666108 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 20:03:01.674039 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666111 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 20:03:01.674039 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666113 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 20:03:01.674039 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666116 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 20:03:01.674039 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666118 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 20:03:01.674039 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666121 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 20:03:01.674039 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666124 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 20:03:01.674039 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666126 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 20:03:01.674039 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666129 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 20:03:01.674039 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666131 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 20:03:01.674039 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666134 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 20:03:01.674039 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666136 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 20:03:01.674039 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666139 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 20:03:01.674039 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666141 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 20:03:01.674039 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666144 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 20:03:01.674039 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666147 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 20:03:01.674039 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666150 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 20:03:01.674530 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666152 2578 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 20:03:01.674530 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666155 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 20:03:01.674530 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666158 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 20:03:01.674530 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666160 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 20:03:01.674530 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666163 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 20:03:01.674530 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666165 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 20:03:01.674530 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666168 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 20:03:01.674530 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666170 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 20:03:01.674530 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666173 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 20:03:01.674530 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666176 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 20:03:01.674530 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666178 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 20:03:01.674530 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666181 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 20:03:01.674530 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666183 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 20:03:01.674530 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666186 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 20:03:01.674530 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666188 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 20:03:01.674530 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666191 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 20:03:01.674530 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666193 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 20:03:01.674530 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666196 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 20:03:01.674530 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666199 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 20:03:01.674975 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666201 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 20:03:01.674975 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666203 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 20:03:01.674975 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666206 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 20:03:01.674975 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666208 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 20:03:01.674975 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666211 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 20:03:01.674975 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666213 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 20:03:01.674975 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666216 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 20:03:01.674975 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666219 2578 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 20:03:01.674975 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666221 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 20:03:01.674975 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666224 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 20:03:01.674975 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666226 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 20:03:01.674975 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666229 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 20:03:01.674975 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666232 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 20:03:01.674975 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.666255 2578 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 20:03:01.674975 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666288 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 20:03:01.674975 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666293 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 20:03:01.675372 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666296 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 20:03:01.675372 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666300 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 20:03:01.675372 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666305 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 20:03:01.675372 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666308 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 20:03:01.675372 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666311 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 20:03:01.675372 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666315 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 20:03:01.675372 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666318 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 20:03:01.675372 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666321 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 20:03:01.675372 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666324 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 20:03:01.675372 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666338 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 20:03:01.675372 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666341 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 20:03:01.675372 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666344 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 20:03:01.675372 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666346 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 20:03:01.675372 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666349 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 20:03:01.675372 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666352 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 20:03:01.675372 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666354 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 20:03:01.675372 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666357 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 20:03:01.675372 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666360 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 20:03:01.675372 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666362 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 20:03:01.675818 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666365 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 20:03:01.675818 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666367 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 20:03:01.675818 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666370 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 20:03:01.675818 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666372 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 20:03:01.675818 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666375 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 20:03:01.675818 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666377 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 20:03:01.675818 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666380 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 20:03:01.675818 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666383 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 20:03:01.675818 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666385 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 20:03:01.675818 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666388 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 20:03:01.675818 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666391 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 20:03:01.675818 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666394 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 20:03:01.675818 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666397 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 20:03:01.675818 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666399 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 20:03:01.675818 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666402 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 20:03:01.675818 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666404 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 20:03:01.675818 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666407 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 20:03:01.675818 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666409 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 20:03:01.675818 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666412 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 20:03:01.675818 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666415 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 20:03:01.676314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666417 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 20:03:01.676314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666420 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 20:03:01.676314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666422 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 20:03:01.676314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666425 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 20:03:01.676314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666427 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 20:03:01.676314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666430 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 20:03:01.676314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666432 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 20:03:01.676314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666435 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 20:03:01.676314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666438 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 20:03:01.676314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666441 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 20:03:01.676314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666444 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 20:03:01.676314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666446 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 20:03:01.676314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666449 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 20:03:01.676314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666451 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 20:03:01.676314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666454 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 20:03:01.676314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666457 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 20:03:01.676314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666460 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 20:03:01.676314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666462 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 20:03:01.676314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666465 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 20:03:01.676314 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666467 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 20:03:01.676797 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666470 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 20:03:01.676797 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666473 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 20:03:01.676797 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666476 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 20:03:01.676797 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666479 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 20:03:01.676797 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666482 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 20:03:01.676797 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666484 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 20:03:01.676797 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666487 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 20:03:01.676797 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666489 2578 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 20:03:01.676797 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666492 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 20:03:01.676797 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666495 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 20:03:01.676797 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666497 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 20:03:01.676797 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666500 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 20:03:01.676797 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666502 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 20:03:01.676797 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666505 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 20:03:01.676797 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666507 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 20:03:01.676797 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666510 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 20:03:01.676797 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666512 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 20:03:01.676797 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666515 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 20:03:01.676797 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666517 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 20:03:01.676797 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666520 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 20:03:01.677269 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666526 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 20:03:01.677269 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666528 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 20:03:01.677269 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666531 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 20:03:01.677269 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666533 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 20:03:01.677269 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666536 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 20:03:01.677269 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666538 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 20:03:01.677269 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666541 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 20:03:01.677269 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666543 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 20:03:01.677269 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666546 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 20:03:01.677269 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666549 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 20:03:01.677269 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666551 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 20:03:01.677269 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666554 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 20:03:01.677269 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666556 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 20:03:01.677269 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666561 2578 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 20:03:01.677269 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666564 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 20:03:01.677269 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666567 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 20:03:01.677269 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666569 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 20:03:01.677269 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666572 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 20:03:01.677269 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666574 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 20:03:01.677269 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666577 2578 feature_gate.go:386] unrecognized feature gate: Example Oct 30 20:03:01.677782 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666580 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 20:03:01.677782 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666585 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 20:03:01.677782 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666588 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 20:03:01.677782 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666591 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 20:03:01.677782 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:01.666593 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 20:03:01.677782 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.666653 2578 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 20:03:01.677782 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.669172 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 30 20:03:01.677782 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.670252 2578 server.go:1014] "Starting client certificate rotation" Oct 30 20:03:01.677782 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.670358 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 20:03:01.677782 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.671173 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 20:03:01.677782 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.672422 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 20:03:01.677782 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.673546 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 20:03:01.687021 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.686998 2578 log.go:25] "Validated CRI v1 runtime API" Oct 30 20:03:01.691132 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.691115 2578 log.go:25] "Validated CRI v1 image API" Oct 30 20:03:01.692933 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.692909 2578 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 20:03:01.695748 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.695728 2578 fs.go:135] Filesystem UUIDs: map[0b9c55da-2e89-4cab-89d9-24bb4d47ffb9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7c77a14d-f6b9-4e08-bfb1-44d3997a17aa:/dev/nvme0n1p4] Oct 30 20:03:01.695818 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.695746 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Oct 30 20:03:01.702464 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.702346 2578 manager.go:217] Machine: {Timestamp:2026-10-30 20:03:01.701836451 +0000 UTC m=+0.381118692 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100588 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24b28f8a39a86ac2a6e5282ab764e9 SystemUUID:ec24b28f-8a39-a86a-c2a6-e5282ab764e9 BootID:a426ad57-1080-42bb-b688-a28aac771f7d Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e6:f7:70:73 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e6:f7:70:73 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:e2:0b:72:b2:e2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 20:03:01.702464 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.702453 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 20:03:01.702623 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.702599 2578 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 20:03:01.706386 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.706361 2578 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 20:03:01.706507 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.706386 2578 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-217.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 20:03:01.706554 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.706509 2578 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 20:03:01.706554 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.706517 2578 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 20:03:01.706554 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.706547 2578 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 20:03:01.706630 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.706564 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 20:03:01.707978 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.707968 2578 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 20:03:01.709993 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.709977 2578 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 20:03:01.712598 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.712586 2578 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 20:03:01.712873 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.712863 2578 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 20:03:01.712907 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.712896 2578 kubelet.go:493] "Attempting to sync node with API server" Oct 30 20:03:01.712907 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.712906 2578 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 20:03:01.712957 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.712916 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 20:03:01.712957 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.712924 2578 kubelet.go:405] "Adding apiserver pod source" Oct 30 20:03:01.712957 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.712933 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 20:03:01.713248 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.713236 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 20:03:01.715767 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.715748 2578 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 20:03:01.723064 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.723049 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 20:03:01.723917 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.723906 2578 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 20:03:01.723953 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.723935 2578 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 20:03:01.724092 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.724080 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 20:03:01.724120 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.724100 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 20:03:01.724120 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.724109 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 20:03:01.724169 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.724120 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 20:03:01.724169 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.724128 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 20:03:01.724169 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.724134 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 20:03:01.724822 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.724811 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 20:03:01.724852 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.724829 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 20:03:01.724852 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.724840 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 20:03:01.724906 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.724855 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 20:03:01.724906 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.724869 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 20:03:01.724906 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.724878 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 20:03:01.725805 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.725797 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 20:03:01.725842 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.725810 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 20:03:01.729966 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.729949 2578 server.go:1263] "Started kubelet" Oct 30 20:03:01.730083 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.730019 2578 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 20:03:01.730224 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.730100 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 20:03:01.730319 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.730306 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 20:03:01.731274 ip-10-0-139-217 systemd[1]: Started Kubernetes Kubelet. Oct 30 20:03:01.732909 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.731840 2578 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 20:03:01.733166 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.733005 2578 server.go:317] "Adding debug handlers to kubelet server" Oct 30 20:03:01.733166 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.733033 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-217.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 30 20:03:01.733166 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:01.733090 2578 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-217.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Oct 30 20:03:01.733308 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:01.733205 2578 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Oct 30 20:03:01.736373 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:01.736351 2578 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 30 20:03:01.740382 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.740360 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 20:03:01.740975 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.740958 2578 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 20:03:01.741070 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:01.741054 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-217.us-east-2.compute.internal\" not found" Oct 30 20:03:01.741930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.741696 2578 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 20:03:01.741930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.741714 2578 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 20:03:01.741930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.741890 2578 reconstruct.go:97] "Volume reconstruction finished" Oct 30 20:03:01.741930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.741901 2578 reconciler.go:29] "Reconciler: start to sync state" Oct 30 20:03:01.742402 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.742384 2578 factory.go:55] Registering systemd factory Oct 30 20:03:01.742471 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.742428 2578 factory.go:223] Registration of the systemd container factory successfully Oct 30 20:03:01.742523 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.742505 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 20:03:01.742687 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.742669 2578 factory.go:153] Registering CRI-O factory Oct 30 20:03:01.742748 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.742691 2578 factory.go:223] Registration of the crio container factory successfully Oct 30 20:03:01.742804 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.742758 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 20:03:01.742804 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.742776 2578 factory.go:103] Registering Raw factory Oct 30 20:03:01.742804 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.742790 2578 manager.go:1199] Started watching for new ooms in manager Oct 30 20:03:01.743888 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.743872 2578 manager.go:319] Starting recovery of all containers Oct 30 20:03:01.744278 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:01.742923 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-217.us-east-2.compute.internal.18e3673b778b00dc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-217.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-217.us-east-2.compute.internal,},FirstTimestamp:2026-10-30 20:03:01.729919196 +0000 UTC m=+0.409201436,LastTimestamp:2026-10-30 20:03:01.729919196 +0000 UTC m=+0.409201436,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-217.us-east-2.compute.internal,}" Oct 30 20:03:01.757154 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:01.757125 2578 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-217.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Oct 30 20:03:01.758517 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.758494 2578 manager.go:324] Recovery completed Oct 30 20:03:01.762631 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.762618 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 20:03:01.764840 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.764822 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 20:03:01.764911 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.764856 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 20:03:01.764911 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.764871 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 20:03:01.765478 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.765459 2578 cpu_manager.go:226] "Starting" policy="none" Oct 30 20:03:01.765478 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.765470 2578 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 20:03:01.765569 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.765487 2578 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 20:03:01.765569 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.765525 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 20:03:01.766320 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.766305 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 20:03:01.766408 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.766353 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 20:03:01.766408 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.766364 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 20:03:01.766810 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:01.766785 2578 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Oct 30 20:03:01.767602 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.767591 2578 policy_none.go:50] "Start" Oct 30 20:03:01.767655 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.767606 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 20:03:01.767655 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.767619 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 20:03:01.769609 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.769599 2578 policy_none.go:44] "Start" Oct 30 20:03:01.774788 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:01.774727 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-217.us-east-2.compute.internal.18e3673b799fd92b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-217.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-217.us-east-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-217.us-east-2.compute.internal,},FirstTimestamp:2026-10-30 20:03:01.764839723 +0000 UTC m=+0.444121963,LastTimestamp:2026-10-30 20:03:01.764839723 +0000 UTC m=+0.444121963,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-217.us-east-2.compute.internal,}" Oct 30 20:03:01.776452 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.776433 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h2n95" Oct 30 20:03:01.782614 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:01.782513 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-217.us-east-2.compute.internal.18e3673b79a03882 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-217.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-217.us-east-2.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-217.us-east-2.compute.internal,},FirstTimestamp:2026-10-30 20:03:01.76486413 +0000 UTC m=+0.444146380,LastTimestamp:2026-10-30 20:03:01.76486413 +0000 UTC m=+0.444146380,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-217.us-east-2.compute.internal,}" Oct 30 20:03:01.787038 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.787017 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h2n95" Oct 30 20:03:01.819031 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.806928 2578 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 20:03:01.819031 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.809873 2578 manager.go:341] "Starting Device Plugin manager" Oct 30 20:03:01.819031 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:01.809899 2578 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 20:03:01.819031 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.809910 2578 server.go:87] "Starting device plugin registration server" Oct 30 20:03:01.819031 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.810159 2578 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 20:03:01.819031 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.810168 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 20:03:01.819031 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.810267 2578 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 20:03:01.819031 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.810391 2578 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 20:03:01.819031 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.810404 2578 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 20:03:01.819031 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:01.811003 2578 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 20:03:01.819031 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:01.811053 2578 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-217.us-east-2.compute.internal\" not found" Oct 30 20:03:01.819031 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.814727 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 20:03:01.819031 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.815880 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 20:03:01.819031 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.815901 2578 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 20:03:01.819031 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.815940 2578 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 20:03:01.819031 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:01.815978 2578 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Oct 30 20:03:01.823478 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.820082 2578 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 20:03:01.910963 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.910890 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 20:03:01.911887 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.911870 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 20:03:01.911979 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.911899 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 20:03:01.911979 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.911946 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 20:03:01.912042 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.911980 2578 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:01.916550 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.916530 2578 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal"] Oct 30 20:03:01.916619 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.916600 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 20:03:01.917384 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.917367 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 20:03:01.917467 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.917402 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 20:03:01.917467 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.917418 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 20:03:01.919602 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.919590 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 20:03:01.919773 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.919760 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:01.919821 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.919811 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 20:03:01.920713 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.920700 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 20:03:01.920766 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.920724 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 20:03:01.920766 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.920700 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 20:03:01.920826 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.920771 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 20:03:01.920826 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.920734 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 20:03:01.920826 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.920786 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 20:03:01.922217 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.922201 2578 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:01.922299 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:01.922240 2578 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-217.us-east-2.compute.internal\": node \"ip-10-0-139-217.us-east-2.compute.internal\" not found" Oct 30 20:03:01.922943 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.922927 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:01.922997 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.922960 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 20:03:01.923698 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.923683 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 20:03:01.923770 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.923711 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 20:03:01.923770 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:01.923721 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 20:03:01.945698 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:01.945101 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-217.us-east-2.compute.internal\" not found" Oct 30 20:03:01.951155 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:01.951131 2578 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-217.us-east-2.compute.internal\" not found" node="ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:01.953716 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:01.953701 2578 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-217.us-east-2.compute.internal\" not found" node="ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:02.043801 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:02.043765 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b98aff2d2ebc77273590dcdeafea2f9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal\" (UID: \"0b98aff2d2ebc77273590dcdeafea2f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:02.043967 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:02.043804 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b98aff2d2ebc77273590dcdeafea2f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal\" (UID: \"0b98aff2d2ebc77273590dcdeafea2f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:02.043967 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:02.043830 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49a9f3fd327006d80eb3bde05ad64dae-config\") pod \"kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal\" (UID: \"49a9f3fd327006d80eb3bde05ad64dae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:02.045870 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:02.045854 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-217.us-east-2.compute.internal\" not found" Oct 30 20:03:02.144797 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:02.144749 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49a9f3fd327006d80eb3bde05ad64dae-config\") pod \"kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal\" (UID: \"49a9f3fd327006d80eb3bde05ad64dae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:02.144797 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:02.144801 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b98aff2d2ebc77273590dcdeafea2f9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal\" (UID: \"0b98aff2d2ebc77273590dcdeafea2f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:02.145016 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:02.144825 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b98aff2d2ebc77273590dcdeafea2f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal\" (UID: \"0b98aff2d2ebc77273590dcdeafea2f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:02.145016 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:02.144870 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49a9f3fd327006d80eb3bde05ad64dae-config\") pod \"kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal\" (UID: \"49a9f3fd327006d80eb3bde05ad64dae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:02.145016 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:02.144882 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b98aff2d2ebc77273590dcdeafea2f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal\" (UID: \"0b98aff2d2ebc77273590dcdeafea2f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:02.145016 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:02.144923 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b98aff2d2ebc77273590dcdeafea2f9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal\" (UID: \"0b98aff2d2ebc77273590dcdeafea2f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:02.146847 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:02.146825 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-217.us-east-2.compute.internal\" not found" Oct 30 20:03:02.247706 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:02.247630 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-217.us-east-2.compute.internal\" not found" Oct 30 20:03:02.255795 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:02.255775 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:02.258945 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:02.258931 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:02.348394 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:02.348364 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-217.us-east-2.compute.internal\" not found" Oct 30 20:03:02.449136 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:02.449101 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-217.us-east-2.compute.internal\" not found" Oct 30 20:03:02.549390 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:02.549302 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-217.us-east-2.compute.internal\" not found" Oct 30 20:03:02.650325 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:02.650301 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-217.us-east-2.compute.internal\" not found" Oct 30 20:03:02.670787 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:02.670762 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 30 20:03:02.670913 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:02.670897 2578 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 30 20:03:02.751207 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:02.751179 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-217.us-east-2.compute.internal\" not found" Oct 30 20:03:02.793458 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:02.793398 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 19:58:02 +0000 UTC" deadline="2028-05-03 07:39:40.039650935 +0000 UTC" Oct 30 20:03:02.793458 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:02.793453 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13211h36m37.246201918s" Oct 30 20:03:02.852051 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:02.851990 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-217.us-east-2.compute.internal\" not found" Oct 30 20:03:02.952922 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:02.952755 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-217.us-east-2.compute.internal\" not found" Oct 30 20:03:02.974306 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:02.974278 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 20:03:02.975657 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:02.975633 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 20:03:02.975737 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:02.975676 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 20:03:02.975737 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:02.975695 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 20:03:03.031097 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:03.031052 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49a9f3fd327006d80eb3bde05ad64dae.slice/crio-83569e0f3f3c833e2b4533d25bc58421c22c2ea556096f2ef757f6d4903df1c9 WatchSource:0}: Error finding container 83569e0f3f3c833e2b4533d25bc58421c22c2ea556096f2ef757f6d4903df1c9: Status 404 returned error can't find the container with id 83569e0f3f3c833e2b4533d25bc58421c22c2ea556096f2ef757f6d4903df1c9 Oct 30 20:03:03.031741 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:03.031710 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b98aff2d2ebc77273590dcdeafea2f9.slice/crio-e2aa29bcb30843d9c098e8ef496822e709e2f1874bd80a4c5d1baf020427aaee WatchSource:0}: Error finding container e2aa29bcb30843d9c098e8ef496822e709e2f1874bd80a4c5d1baf020427aaee: Status 404 returned error can't find the container with id e2aa29bcb30843d9c098e8ef496822e709e2f1874bd80a4c5d1baf020427aaee Oct 30 20:03:03.035368 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.035349 2578 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 20:03:03.039217 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.039203 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 20:03:03.042049 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.042032 2578 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:03.054384 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.054366 2578 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 20:03:03.056596 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.056580 2578 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:03.071742 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.071729 2578 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 20:03:03.247927 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.247849 2578 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 20:03:03.678912 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.678819 2578 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 20:03:03.714036 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.714000 2578 apiserver.go:52] "Watching apiserver" Oct 30 20:03:03.724944 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.724914 2578 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 20:03:03.725298 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.725265 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-l5w4q","openshift-network-operator/iptables-alerter-5hfvr","kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6","openshift-cluster-node-tuning-operator/tuned-2sftq","openshift-dns/node-resolver-sxszz","openshift-image-registry/node-ca-fc6gd","openshift-multus/network-metrics-daemon-698hj","kube-system/konnectivity-agent-cvpxr","openshift-ovn-kubernetes/ovnkube-node-df4d8","kube-system/global-pull-secret-syncer-dw59s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal","openshift-multus/multus-additional-cni-plugins-tvkf2","openshift-multus/multus-qspzv"] Oct 30 20:03:03.727949 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.727926 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fc6gd" Oct 30 20:03:03.730464 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.730442 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.733348 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.733315 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.733535 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.733384 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-26gph\"" Oct 30 20:03:03.734016 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.733997 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 20:03:03.734168 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.734003 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 20:03:03.734168 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.734158 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 20:03:03.735685 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.735660 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 20:03:03.735780 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.735689 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 20:03:03.735849 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.735780 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 20:03:03.735899 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.735869 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-84sqw\"" Oct 30 20:03:03.735899 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.735892 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 20:03:03.735985 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.735928 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 20:03:03.736335 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.736311 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.738596 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.737911 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-phqsm\"" Oct 30 20:03:03.738596 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.738012 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 20:03:03.738864 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.738845 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.740247 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.740229 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 20:03:03.740440 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.740421 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hms2c\"" Oct 30 20:03:03.740525 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.740459 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 20:03:03.740525 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.740518 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 20:03:03.742334 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.741155 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Oct 30 20:03:03.742334 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.741610 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sxszz" Oct 30 20:03:03.743218 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.743110 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rnw2v\"" Oct 30 20:03:03.743218 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.743179 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 20:03:03.743218 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.743220 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 20:03:03.745181 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.744815 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cvpxr" Oct 30 20:03:03.746089 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.746068 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 20:03:03.746350 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.746314 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rx62b\"" Oct 30 20:03:03.746441 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.746375 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 20:03:03.750399 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.748430 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:03.750399 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:03.748532 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l5w4q" podUID="9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e" Oct 30 20:03:03.750899 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.750877 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5hfvr" Oct 30 20:03:03.753869 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.753849 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.755120 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.755090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/14006e48-475b-4dbe-8994-1f908f897884-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.755228 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.755134 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-etc-selinux\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.755228 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.755170 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-socket-dir-parent\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.755367 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.755242 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-var-lib-cni-bin\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.755367 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.755322 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14006e48-475b-4dbe-8994-1f908f897884-system-cni-dir\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.755367 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.755360 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6m8f\" (UniqueName: \"kubernetes.io/projected/14006e48-475b-4dbe-8994-1f908f897884-kube-api-access-q6m8f\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.755537 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.755386 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.755537 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.755462 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ff5da8ed-018c-4182-82f0-a8a3266aff52-serviceca\") pod \"node-ca-fc6gd\" (UID: \"ff5da8ed-018c-4182-82f0-a8a3266aff52\") " pod="openshift-image-registry/node-ca-fc6gd" Oct 30 20:03:03.755537 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.755497 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-cni-binary-copy\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.755679 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.755565 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr5cv\" (UniqueName: \"kubernetes.io/projected/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-kube-api-access-zr5cv\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.755679 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.755599 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14006e48-475b-4dbe-8994-1f908f897884-cni-binary-copy\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.755679 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.755628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-run\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.755679 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.755661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-sys\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.755921 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.755693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-host\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.755921 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.755739 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/caeeb8a7-4283-4c38-b3be-c036eeeceb65-konnectivity-ca\") pod \"konnectivity-agent-cvpxr\" (UID: \"caeeb8a7-4283-4c38-b3be-c036eeeceb65\") " pod="kube-system/konnectivity-agent-cvpxr" Oct 30 20:03:03.756040 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.755943 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-cnibin\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.756040 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.755970 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-run-netns\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.756040 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.755993 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-hostroot\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.756040 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756018 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-daemon-config\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.756256 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756042 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-sysctl-d\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.756256 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756067 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-systemd\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.756256 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756098 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-var-lib-kubelet\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.756256 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756121 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-system-cni-dir\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.756256 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756145 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-run-k8s-cni-cncf-io\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.756539 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756376 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-var-lib-cni-multus\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.756539 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756411 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-run-multus-certs\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.756539 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756436 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl424\" (UniqueName: \"kubernetes.io/projected/bea5c7b2-5ad1-43f5-8f43-07e3af665d6a-kube-api-access-hl424\") pod \"node-resolver-sxszz\" (UID: \"bea5c7b2-5ad1-43f5-8f43-07e3af665d6a\") " pod="openshift-dns/node-resolver-sxszz" Oct 30 20:03:03.756539 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756462 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-modprobe-d\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.756539 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756483 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-sysconfig\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.756539 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756506 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-kubernetes\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.756539 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756530 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7846l\" (UniqueName: \"kubernetes.io/projected/f8c5839e-f557-4e1d-a26f-17102c15ff8e-kube-api-access-7846l\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.756895 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756547 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/caeeb8a7-4283-4c38-b3be-c036eeeceb65-agent-certs\") pod \"konnectivity-agent-cvpxr\" (UID: \"caeeb8a7-4283-4c38-b3be-c036eeeceb65\") " pod="kube-system/konnectivity-agent-cvpxr" Oct 30 20:03:03.756895 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756567 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-conf-dir\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.756895 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bea5c7b2-5ad1-43f5-8f43-07e3af665d6a-hosts-file\") pod \"node-resolver-sxszz\" (UID: \"bea5c7b2-5ad1-43f5-8f43-07e3af665d6a\") " pod="openshift-dns/node-resolver-sxszz" Oct 30 20:03:03.756895 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756596 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14006e48-475b-4dbe-8994-1f908f897884-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.756895 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-lib-modules\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.756895 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-tuned\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.756895 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756644 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-cni-dir\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.756895 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756667 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14006e48-475b-4dbe-8994-1f908f897884-cnibin\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.756895 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756684 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-registration-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.756895 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756698 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff5da8ed-018c-4182-82f0-a8a3266aff52-host\") pod \"node-ca-fc6gd\" (UID: \"ff5da8ed-018c-4182-82f0-a8a3266aff52\") " pod="openshift-image-registry/node-ca-fc6gd" Oct 30 20:03:03.756895 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756715 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-var-lib-kubelet\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.756895 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756740 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/14006e48-475b-4dbe-8994-1f908f897884-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.756895 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756764 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-socket-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.756895 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756784 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-device-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.756895 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756800 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-sys-fs\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.756895 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756817 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s8zr\" (UniqueName: \"kubernetes.io/projected/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-kube-api-access-8s8zr\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.757644 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756832 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-sysctl-conf\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.757644 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756846 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8c5839e-f557-4e1d-a26f-17102c15ff8e-tmp\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.757644 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756861 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk9xw\" (UniqueName: \"kubernetes.io/projected/ff5da8ed-018c-4182-82f0-a8a3266aff52-kube-api-access-sk9xw\") pod \"node-ca-fc6gd\" (UID: \"ff5da8ed-018c-4182-82f0-a8a3266aff52\") " pod="openshift-image-registry/node-ca-fc6gd" Oct 30 20:03:03.757644 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756880 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-etc-kubernetes\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.757644 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.756895 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bea5c7b2-5ad1-43f5-8f43-07e3af665d6a-tmp-dir\") pod \"node-resolver-sxszz\" (UID: \"bea5c7b2-5ad1-43f5-8f43-07e3af665d6a\") " pod="openshift-dns/node-resolver-sxszz" Oct 30 20:03:03.757644 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.757385 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:03.757644 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:03.757458 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw59s" podUID="9dabf5d4-7787-40b3-b01e-fe430c316887" Oct 30 20:03:03.759182 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.759158 2578 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 20:03:03.761882 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.761857 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:03.761993 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:03.761927 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698hj" podUID="f69d831c-d9e4-4060-a2bd-9d85265000f6" Oct 30 20:03:03.795125 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.795096 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qmrjv" Oct 30 20:03:03.810054 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.810012 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qmrjv" Oct 30 20:03:03.821537 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.821489 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" event={"ID":"0b98aff2d2ebc77273590dcdeafea2f9","Type":"ContainerStarted","Data":"e2aa29bcb30843d9c098e8ef496822e709e2f1874bd80a4c5d1baf020427aaee"} Oct 30 20:03:03.824878 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.824843 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal" event={"ID":"49a9f3fd327006d80eb3bde05ad64dae","Type":"ContainerStarted","Data":"83569e0f3f3c833e2b4533d25bc58421c22c2ea556096f2ef757f6d4903df1c9"} Oct 30 20:03:03.843644 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.843609 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-cfnmr\"" Oct 30 20:03:03.843820 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.843682 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 20:03:03.843986 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.843968 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 20:03:03.845235 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.845117 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 20:03:03.845235 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.845146 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hntbg\"" Oct 30 20:03:03.845235 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.845162 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 20:03:03.845235 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.845180 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 20:03:03.845235 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.845197 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rlckg\"" Oct 30 20:03:03.845235 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.845202 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 20:03:03.845628 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.845442 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 20:03:03.845628 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.845473 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 20:03:03.845628 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.845489 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 20:03:03.845628 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.845490 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 20:03:03.846203 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.846182 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 20:03:03.849481 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.847209 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 20:03:03.857952 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.857924 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-lib-modules\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.858108 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.857963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-cni-dir\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.858108 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.857991 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14006e48-475b-4dbe-8994-1f908f897884-cnibin\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.858108 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-registration-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.858108 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858036 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-run-systemd\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.858108 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858059 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-etc-openvswitch\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.858108 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4452f26-53ff-4b31-9417-f550aa50c38d-iptables-alerter-script\") pod \"iptables-alerter-5hfvr\" (UID: \"d4452f26-53ff-4b31-9417-f550aa50c38d\") " pod="openshift-network-operator/iptables-alerter-5hfvr" Oct 30 20:03:03.858108 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858093 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4452f26-53ff-4b31-9417-f550aa50c38d-host-slash\") pod \"iptables-alerter-5hfvr\" (UID: \"d4452f26-53ff-4b31-9417-f550aa50c38d\") " pod="openshift-network-operator/iptables-alerter-5hfvr" Oct 30 20:03:03.858108 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858111 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/14006e48-475b-4dbe-8994-1f908f897884-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.858546 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858131 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-socket-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.858546 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858150 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-sys-fs\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.858546 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858153 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-lib-modules\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.858546 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858167 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-log-socket\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.858546 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858317 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-cni-dir\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.858546 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858386 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14006e48-475b-4dbe-8994-1f908f897884-cnibin\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.858546 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858449 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-registration-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.858546 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858545 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-sys-fs\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.858954 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858669 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-socket-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.858954 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-sysctl-conf\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.858954 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858747 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8c5839e-f557-4e1d-a26f-17102c15ff8e-tmp\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.858954 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858771 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-etc-kubernetes\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.858954 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858787 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/14006e48-475b-4dbe-8994-1f908f897884-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.858954 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858840 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bea5c7b2-5ad1-43f5-8f43-07e3af665d6a-tmp-dir\") pod \"node-resolver-sxszz\" (UID: \"bea5c7b2-5ad1-43f5-8f43-07e3af665d6a\") " pod="openshift-dns/node-resolver-sxszz" Oct 30 20:03:03.858954 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858871 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/14006e48-475b-4dbe-8994-1f908f897884-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.858954 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858899 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-etc-selinux\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.858954 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858914 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-sysctl-conf\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.859433 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.858980 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-var-lib-cni-bin\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.859433 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859015 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-etc-kubernetes\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.859433 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859039 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14006e48-475b-4dbe-8994-1f908f897884-system-cni-dir\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.859433 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859071 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-systemd-units\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.859433 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859131 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4hpl\" (UniqueName: \"kubernetes.io/projected/f69d831c-d9e4-4060-a2bd-9d85265000f6-kube-api-access-l4hpl\") pod \"network-metrics-daemon-698hj\" (UID: \"f69d831c-d9e4-4060-a2bd-9d85265000f6\") " pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:03.859433 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859164 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ff5da8ed-018c-4182-82f0-a8a3266aff52-serviceca\") pod \"node-ca-fc6gd\" (UID: \"ff5da8ed-018c-4182-82f0-a8a3266aff52\") " pod="openshift-image-registry/node-ca-fc6gd" Oct 30 20:03:03.859433 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859191 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-ovnkube-config\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.859433 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859217 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-ovn-node-metrics-cert\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.859433 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859241 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs\") pod \"network-metrics-daemon-698hj\" (UID: \"f69d831c-d9e4-4060-a2bd-9d85265000f6\") " pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:03.859433 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859304 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bea5c7b2-5ad1-43f5-8f43-07e3af665d6a-tmp-dir\") pod \"node-resolver-sxszz\" (UID: \"bea5c7b2-5ad1-43f5-8f43-07e3af665d6a\") " pod="openshift-dns/node-resolver-sxszz" Oct 30 20:03:03.859433 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859368 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14006e48-475b-4dbe-8994-1f908f897884-system-cni-dir\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.859433 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859423 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-run\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.860057 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859451 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-host\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.860057 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859477 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/caeeb8a7-4283-4c38-b3be-c036eeeceb65-konnectivity-ca\") pod \"konnectivity-agent-cvpxr\" (UID: \"caeeb8a7-4283-4c38-b3be-c036eeeceb65\") " pod="kube-system/konnectivity-agent-cvpxr" Oct 30 20:03:03.860057 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859504 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-run-netns\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.860057 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859542 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-daemon-config\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.860057 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859570 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl424\" (UniqueName: \"kubernetes.io/projected/bea5c7b2-5ad1-43f5-8f43-07e3af665d6a-kube-api-access-hl424\") pod \"node-resolver-sxszz\" (UID: \"bea5c7b2-5ad1-43f5-8f43-07e3af665d6a\") " pod="openshift-dns/node-resolver-sxszz" Oct 30 20:03:03.860057 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859572 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/14006e48-475b-4dbe-8994-1f908f897884-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.860057 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859024 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-etc-selinux\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.860057 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859598 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-run-netns\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.860057 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859848 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ff5da8ed-018c-4182-82f0-a8a3266aff52-serviceca\") pod \"node-ca-fc6gd\" (UID: \"ff5da8ed-018c-4182-82f0-a8a3266aff52\") " pod="openshift-image-registry/node-ca-fc6gd" Oct 30 20:03:03.860057 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859898 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-var-lib-cni-bin\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.860057 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859964 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-run-ovn-kubernetes\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.860057 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.859997 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-device-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.860057 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860006 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-run\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.860057 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s8zr\" (UniqueName: \"kubernetes.io/projected/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-kube-api-access-8s8zr\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.860057 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860046 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-sysctl-d\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.860822 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860074 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-var-lib-cni-multus\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.860822 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860106 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/caeeb8a7-4283-4c38-b3be-c036eeeceb65-konnectivity-ca\") pod \"konnectivity-agent-cvpxr\" (UID: \"caeeb8a7-4283-4c38-b3be-c036eeeceb65\") " pod="kube-system/konnectivity-agent-cvpxr" Oct 30 20:03:03.860822 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860139 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-var-lib-cni-multus\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.860822 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860156 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-run-multus-certs\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.860822 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860219 2578 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 20:03:03.860822 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860230 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-run-openvswitch\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.860822 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860255 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-device-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.860822 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9dabf5d4-7787-40b3-b01e-fe430c316887-kubelet-config\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:03.860822 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860161 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-run-netns\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.860822 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860394 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-sysctl-d\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.860822 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860417 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-modprobe-d\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.860822 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860453 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-sysconfig\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.860822 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860478 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-kubernetes\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.860822 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860496 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-run-multus-certs\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.860822 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860536 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf4tm\" (UniqueName: \"kubernetes.io/projected/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-kube-api-access-mf4tm\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.860822 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860550 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-daemon-config\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.860822 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860571 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsppj\" (UniqueName: \"kubernetes.io/projected/d4452f26-53ff-4b31-9417-f550aa50c38d-kube-api-access-qsppj\") pod \"iptables-alerter-5hfvr\" (UID: \"d4452f26-53ff-4b31-9417-f550aa50c38d\") " pod="openshift-network-operator/iptables-alerter-5hfvr" Oct 30 20:03:03.860822 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860201 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-host\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.861580 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860595 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-modprobe-d\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.861580 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860604 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-sysconfig\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.861580 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860689 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-tuned\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.861580 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860693 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-kubernetes\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.861580 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-slash\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.861580 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860784 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-env-overrides\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.861580 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff5da8ed-018c-4182-82f0-a8a3266aff52-host\") pod \"node-ca-fc6gd\" (UID: \"ff5da8ed-018c-4182-82f0-a8a3266aff52\") " pod="openshift-image-registry/node-ca-fc6gd" Oct 30 20:03:03.861580 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860921 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-var-lib-kubelet\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.861580 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860945 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff5da8ed-018c-4182-82f0-a8a3266aff52-host\") pod \"node-ca-fc6gd\" (UID: \"ff5da8ed-018c-4182-82f0-a8a3266aff52\") " pod="openshift-image-registry/node-ca-fc6gd" Oct 30 20:03:03.861580 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.860992 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-kubelet\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.861580 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861025 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-var-lib-kubelet\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.861580 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861081 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk9xw\" (UniqueName: \"kubernetes.io/projected/ff5da8ed-018c-4182-82f0-a8a3266aff52-kube-api-access-sk9xw\") pod \"node-ca-fc6gd\" (UID: \"ff5da8ed-018c-4182-82f0-a8a3266aff52\") " pod="openshift-image-registry/node-ca-fc6gd" Oct 30 20:03:03.861580 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861119 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-socket-dir-parent\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.861580 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861157 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6m8f\" (UniqueName: \"kubernetes.io/projected/14006e48-475b-4dbe-8994-1f908f897884-kube-api-access-q6m8f\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.861580 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861184 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.861580 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861240 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.861580 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861284 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-node-log\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.862325 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861346 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-cni-binary-copy\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.862325 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr5cv\" (UniqueName: \"kubernetes.io/projected/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-kube-api-access-zr5cv\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.862325 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861419 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14006e48-475b-4dbe-8994-1f908f897884-cni-binary-copy\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.862325 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861425 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-socket-dir-parent\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.862325 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861533 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-run-ovn\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.862325 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861589 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-sys\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.862325 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-cnibin\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.862325 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861655 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-sys\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.862325 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861692 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-hostroot\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.862325 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861722 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-var-lib-openvswitch\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.862325 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861753 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14006e48-475b-4dbe-8994-1f908f897884-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.862325 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861761 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-hostroot\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.862325 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861834 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-cnibin\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.862325 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861886 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-systemd\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.862325 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861927 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-var-lib-kubelet\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.862325 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861931 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14006e48-475b-4dbe-8994-1f908f897884-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.862325 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.861957 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-system-cni-dir\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.862325 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.862002 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-systemd\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.863000 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.862008 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-system-cni-dir\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.863000 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.862016 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-cni-binary-copy\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.863000 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.862040 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-var-lib-kubelet\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.863000 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.862096 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-run-k8s-cni-cncf-io\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.863000 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.862126 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-cni-netd\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.863000 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.862143 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-run-k8s-cni-cncf-io\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.863000 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.862187 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.863000 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.862219 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:03.863000 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.862264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7846l\" (UniqueName: \"kubernetes.io/projected/f8c5839e-f557-4e1d-a26f-17102c15ff8e-kube-api-access-7846l\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.863000 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.862315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/caeeb8a7-4283-4c38-b3be-c036eeeceb65-agent-certs\") pod \"konnectivity-agent-cvpxr\" (UID: \"caeeb8a7-4283-4c38-b3be-c036eeeceb65\") " pod="kube-system/konnectivity-agent-cvpxr" Oct 30 20:03:03.863000 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.862409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-conf-dir\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.863000 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.862438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bea5c7b2-5ad1-43f5-8f43-07e3af665d6a-hosts-file\") pod \"node-resolver-sxszz\" (UID: \"bea5c7b2-5ad1-43f5-8f43-07e3af665d6a\") " pod="openshift-dns/node-resolver-sxszz" Oct 30 20:03:03.863000 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.862462 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-cni-bin\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.863000 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.862481 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-conf-dir\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.863000 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.862486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-ovnkube-script-lib\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.863000 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.862520 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9dabf5d4-7787-40b3-b01e-fe430c316887-dbus\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:03.863000 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.862552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnl5q\" (UniqueName: \"kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q\") pod \"network-check-target-l5w4q\" (UID: \"9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e\") " pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:03.863672 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.862568 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bea5c7b2-5ad1-43f5-8f43-07e3af665d6a-hosts-file\") pod \"node-resolver-sxszz\" (UID: \"bea5c7b2-5ad1-43f5-8f43-07e3af665d6a\") " pod="openshift-dns/node-resolver-sxszz" Oct 30 20:03:03.863672 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.863053 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14006e48-475b-4dbe-8994-1f908f897884-cni-binary-copy\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.866251 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.866225 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8c5839e-f557-4e1d-a26f-17102c15ff8e-tmp\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.866372 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.866261 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-tuned\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.868519 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.868357 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/caeeb8a7-4283-4c38-b3be-c036eeeceb65-agent-certs\") pod \"konnectivity-agent-cvpxr\" (UID: \"caeeb8a7-4283-4c38-b3be-c036eeeceb65\") " pod="kube-system/konnectivity-agent-cvpxr" Oct 30 20:03:03.875799 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.875769 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk9xw\" (UniqueName: \"kubernetes.io/projected/ff5da8ed-018c-4182-82f0-a8a3266aff52-kube-api-access-sk9xw\") pod \"node-ca-fc6gd\" (UID: \"ff5da8ed-018c-4182-82f0-a8a3266aff52\") " pod="openshift-image-registry/node-ca-fc6gd" Oct 30 20:03:03.876852 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.876823 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr5cv\" (UniqueName: \"kubernetes.io/projected/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-kube-api-access-zr5cv\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:03.877907 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.877884 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7846l\" (UniqueName: \"kubernetes.io/projected/f8c5839e-f557-4e1d-a26f-17102c15ff8e-kube-api-access-7846l\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:03.880901 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.880881 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl424\" (UniqueName: \"kubernetes.io/projected/bea5c7b2-5ad1-43f5-8f43-07e3af665d6a-kube-api-access-hl424\") pod \"node-resolver-sxszz\" (UID: \"bea5c7b2-5ad1-43f5-8f43-07e3af665d6a\") " pod="openshift-dns/node-resolver-sxszz" Oct 30 20:03:03.880901 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.880891 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6m8f\" (UniqueName: \"kubernetes.io/projected/14006e48-475b-4dbe-8994-1f908f897884-kube-api-access-q6m8f\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:03.882125 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.882100 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s8zr\" (UniqueName: \"kubernetes.io/projected/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-kube-api-access-8s8zr\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:03.963354 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963240 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-run-netns\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.963354 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963286 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-run-ovn-kubernetes\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.963354 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963316 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-run-openvswitch\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.963354 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9dabf5d4-7787-40b3-b01e-fe430c316887-kubelet-config\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:03.963637 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963384 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-run-netns\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.963637 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963384 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-run-ovn-kubernetes\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.963637 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963427 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-run-openvswitch\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.963637 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf4tm\" (UniqueName: \"kubernetes.io/projected/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-kube-api-access-mf4tm\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.963637 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963470 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsppj\" (UniqueName: \"kubernetes.io/projected/d4452f26-53ff-4b31-9417-f550aa50c38d-kube-api-access-qsppj\") pod \"iptables-alerter-5hfvr\" (UID: \"d4452f26-53ff-4b31-9417-f550aa50c38d\") " pod="openshift-network-operator/iptables-alerter-5hfvr" Oct 30 20:03:03.963637 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963487 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9dabf5d4-7787-40b3-b01e-fe430c316887-kubelet-config\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:03.963637 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963498 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-slash\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.963637 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963529 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-env-overrides\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.963637 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963558 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-kubelet\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.963637 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963583 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-node-log\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.963637 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963610 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-run-ovn\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.963637 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963636 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-var-lib-openvswitch\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.964044 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963665 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-cni-netd\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.964044 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963691 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.964044 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963716 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-slash\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.964044 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963718 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:03.964044 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963756 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-cni-bin\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.964044 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963762 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-node-log\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.964044 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-ovnkube-script-lib\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.964044 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963790 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9dabf5d4-7787-40b3-b01e-fe430c316887-dbus\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:03.964044 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963804 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-run-ovn\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.964044 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963807 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnl5q\" (UniqueName: \"kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q\") pod \"network-check-target-l5w4q\" (UID: \"9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e\") " pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:03.964044 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963863 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-run-systemd\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.964044 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963887 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-etc-openvswitch\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.964044 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4452f26-53ff-4b31-9417-f550aa50c38d-iptables-alerter-script\") pod \"iptables-alerter-5hfvr\" (UID: \"d4452f26-53ff-4b31-9417-f550aa50c38d\") " pod="openshift-network-operator/iptables-alerter-5hfvr" Oct 30 20:03:03.964044 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4452f26-53ff-4b31-9417-f550aa50c38d-host-slash\") pod \"iptables-alerter-5hfvr\" (UID: \"d4452f26-53ff-4b31-9417-f550aa50c38d\") " pod="openshift-network-operator/iptables-alerter-5hfvr" Oct 30 20:03:03.964044 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963952 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-cni-bin\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.964044 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-log-socket\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.964044 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.964007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-systemd-units\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.964594 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.964035 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4hpl\" (UniqueName: \"kubernetes.io/projected/f69d831c-d9e4-4060-a2bd-9d85265000f6-kube-api-access-l4hpl\") pod \"network-metrics-daemon-698hj\" (UID: \"f69d831c-d9e4-4060-a2bd-9d85265000f6\") " pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:03.964594 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.964063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-ovnkube-config\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.964594 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.964089 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-ovn-node-metrics-cert\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.964594 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.964136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs\") pod \"network-metrics-daemon-698hj\" (UID: \"f69d831c-d9e4-4060-a2bd-9d85265000f6\") " pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:03.964594 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.964241 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-env-overrides\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.964594 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:03.964253 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 20:03:03.964594 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:03.964315 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 20:03:03.964594 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:03.964342 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs podName:f69d831c-d9e4-4060-a2bd-9d85265000f6 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:04.464306404 +0000 UTC m=+3.143588647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs") pod "network-metrics-daemon-698hj" (UID: "f69d831c-d9e4-4060-a2bd-9d85265000f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 20:03:03.964594 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.964343 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-ovnkube-script-lib\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.964594 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:03.964368 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret podName:9dabf5d4-7787-40b3-b01e-fe430c316887 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:04.464356312 +0000 UTC m=+3.143638560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret") pod "global-pull-secret-syncer-dw59s" (UID: "9dabf5d4-7787-40b3-b01e-fe430c316887") : object "kube-system"/"original-pull-secret" not registered Oct 30 20:03:03.964594 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.964398 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-var-lib-openvswitch\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.964594 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.964407 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4452f26-53ff-4b31-9417-f550aa50c38d-host-slash\") pod \"iptables-alerter-5hfvr\" (UID: \"d4452f26-53ff-4b31-9417-f550aa50c38d\") " pod="openshift-network-operator/iptables-alerter-5hfvr" Oct 30 20:03:03.964594 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.964464 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9dabf5d4-7787-40b3-b01e-fe430c316887-dbus\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:03.964594 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.964468 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-log-socket\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.964594 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.963693 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-kubelet\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.964594 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.964509 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-cni-netd\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.964594 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.964513 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-run-systemd\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.965214 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.964537 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.965214 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.964552 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-systemd-units\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.965214 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.964564 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-etc-openvswitch\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.965925 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.965899 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4452f26-53ff-4b31-9417-f550aa50c38d-iptables-alerter-script\") pod \"iptables-alerter-5hfvr\" (UID: \"d4452f26-53ff-4b31-9417-f550aa50c38d\") " pod="openshift-network-operator/iptables-alerter-5hfvr" Oct 30 20:03:03.966172 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.966129 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-ovnkube-config\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.967441 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.967416 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-ovn-node-metrics-cert\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.977150 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.977123 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsppj\" (UniqueName: \"kubernetes.io/projected/d4452f26-53ff-4b31-9417-f550aa50c38d-kube-api-access-qsppj\") pod \"iptables-alerter-5hfvr\" (UID: \"d4452f26-53ff-4b31-9417-f550aa50c38d\") " pod="openshift-network-operator/iptables-alerter-5hfvr" Oct 30 20:03:03.977549 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:03.977518 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 20:03:03.977681 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:03.977555 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 20:03:03.977681 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:03.977575 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xnl5q for pod openshift-network-diagnostics/network-check-target-l5w4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 20:03:03.977681 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:03.977635 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q podName:9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e nodeName:}" failed. No retries permitted until 2026-10-30 20:03:04.477616897 +0000 UTC m=+3.156899144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xnl5q" (UniqueName: "kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q") pod "network-check-target-l5w4q" (UID: "9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 20:03:03.981648 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.981622 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf4tm\" (UniqueName: \"kubernetes.io/projected/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-kube-api-access-mf4tm\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:03.981767 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:03.981661 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4hpl\" (UniqueName: \"kubernetes.io/projected/f69d831c-d9e4-4060-a2bd-9d85265000f6-kube-api-access-l4hpl\") pod \"network-metrics-daemon-698hj\" (UID: \"f69d831c-d9e4-4060-a2bd-9d85265000f6\") " pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:04.045990 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.045951 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fc6gd" Oct 30 20:03:04.059351 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:04.059300 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff5da8ed_018c_4182_82f0_a8a3266aff52.slice/crio-0be6720bf54e45526d7b411465dbb59399d96ea97ffc361a16c2d7308d71044f WatchSource:0}: Error finding container 0be6720bf54e45526d7b411465dbb59399d96ea97ffc361a16c2d7308d71044f: Status 404 returned error can't find the container with id 0be6720bf54e45526d7b411465dbb59399d96ea97ffc361a16c2d7308d71044f Oct 30 20:03:04.073345 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.073310 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qspzv" Oct 30 20:03:04.076576 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.076549 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:04.082721 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.082697 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:04.084890 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.084871 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:04.086470 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:04.086442 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod285be4c1_3c4f_4972_b8fa_7f37f92d72bb.slice/crio-bde0c876d0985d2fbefc7fdb46a7a94dadaf157d085859cc86ecc627d3261a63 WatchSource:0}: Error finding container bde0c876d0985d2fbefc7fdb46a7a94dadaf157d085859cc86ecc627d3261a63: Status 404 returned error can't find the container with id bde0c876d0985d2fbefc7fdb46a7a94dadaf157d085859cc86ecc627d3261a63 Oct 30 20:03:04.090737 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:04.090702 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14006e48_475b_4dbe_8994_1f908f897884.slice/crio-9f975a3b11e1e139184bad1d22d45b0046129a9ca0bb480ab6564bf5272bf68d WatchSource:0}: Error finding container 9f975a3b11e1e139184bad1d22d45b0046129a9ca0bb480ab6564bf5272bf68d: Status 404 returned error can't find the container with id 9f975a3b11e1e139184bad1d22d45b0046129a9ca0bb480ab6564bf5272bf68d Oct 30 20:03:04.091764 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.091689 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sxszz" Oct 30 20:03:04.097820 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:04.097750 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a8ee251_819c_4ea5_8d6a_6211fdf7e00a.slice/crio-d4855521a8fd7fbe3df2536038291b21c212a53ac0d8dbbe9b6a0da401132f8e WatchSource:0}: Error finding container d4855521a8fd7fbe3df2536038291b21c212a53ac0d8dbbe9b6a0da401132f8e: Status 404 returned error can't find the container with id d4855521a8fd7fbe3df2536038291b21c212a53ac0d8dbbe9b6a0da401132f8e Oct 30 20:03:04.099130 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.099089 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cvpxr" Oct 30 20:03:04.101319 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:04.101294 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c5839e_f557_4e1d_a26f_17102c15ff8e.slice/crio-19a0ca8483dcece61d044c97bc4b75962588d84f1cbe9a51bb74be644f57bf3b WatchSource:0}: Error finding container 19a0ca8483dcece61d044c97bc4b75962588d84f1cbe9a51bb74be644f57bf3b: Status 404 returned error can't find the container with id 19a0ca8483dcece61d044c97bc4b75962588d84f1cbe9a51bb74be644f57bf3b Oct 30 20:03:04.105287 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:04.105262 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea5c7b2_5ad1_43f5_8f43_07e3af665d6a.slice/crio-b8f3f28d5b76156ba3d153f22b582bfd1646174540202df9682a6aa1bd780612 WatchSource:0}: Error finding container b8f3f28d5b76156ba3d153f22b582bfd1646174540202df9682a6aa1bd780612: Status 404 returned error can't find the container with id b8f3f28d5b76156ba3d153f22b582bfd1646174540202df9682a6aa1bd780612 Oct 30 20:03:04.109730 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.109702 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5hfvr" Oct 30 20:03:04.111228 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:04.111191 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaeeb8a7_4283_4c38_b3be_c036eeeceb65.slice/crio-12a8bde498ee3f14827b8ff9662c5ea7765ea171e601dc973f2836de752851ab WatchSource:0}: Error finding container 12a8bde498ee3f14827b8ff9662c5ea7765ea171e601dc973f2836de752851ab: Status 404 returned error can't find the container with id 12a8bde498ee3f14827b8ff9662c5ea7765ea171e601dc973f2836de752851ab Oct 30 20:03:04.121720 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:04.121686 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4452f26_53ff_4b31_9417_f550aa50c38d.slice/crio-e9fd457133bc0eb0f8fe85226bae5306358f5acde9a1829ea334a2667d6d45a4 WatchSource:0}: Error finding container e9fd457133bc0eb0f8fe85226bae5306358f5acde9a1829ea334a2667d6d45a4: Status 404 returned error can't find the container with id e9fd457133bc0eb0f8fe85226bae5306358f5acde9a1829ea334a2667d6d45a4 Oct 30 20:03:04.133039 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.133012 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:04.144011 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:04.143966 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd28c2db0_9b9a_4c34_a78f_cbf24f67ac45.slice/crio-8087d186464b3111c28de8068816ab6edc3abecac3bb35e7927728d803a7e457 WatchSource:0}: Error finding container 8087d186464b3111c28de8068816ab6edc3abecac3bb35e7927728d803a7e457: Status 404 returned error can't find the container with id 8087d186464b3111c28de8068816ab6edc3abecac3bb35e7927728d803a7e457 Oct 30 20:03:04.213684 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.213604 2578 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 20:03:04.467406 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.467305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:04.467566 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.467405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs\") pod \"network-metrics-daemon-698hj\" (UID: \"f69d831c-d9e4-4060-a2bd-9d85265000f6\") " pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:04.467566 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:04.467465 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 20:03:04.467566 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:04.467531 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 20:03:04.467566 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:04.467550 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret podName:9dabf5d4-7787-40b3-b01e-fe430c316887 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:05.467530603 +0000 UTC m=+4.146812840 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret") pod "global-pull-secret-syncer-dw59s" (UID: "9dabf5d4-7787-40b3-b01e-fe430c316887") : object "kube-system"/"original-pull-secret" not registered Oct 30 20:03:04.467948 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:04.467590 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs podName:f69d831c-d9e4-4060-a2bd-9d85265000f6 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:05.467568997 +0000 UTC m=+4.146851242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs") pod "network-metrics-daemon-698hj" (UID: "f69d831c-d9e4-4060-a2bd-9d85265000f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 20:03:04.568229 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.568190 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnl5q\" (UniqueName: \"kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q\") pod \"network-check-target-l5w4q\" (UID: \"9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e\") " pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:04.568433 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:04.568405 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 20:03:04.568433 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:04.568431 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 20:03:04.568551 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:04.568449 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xnl5q for pod openshift-network-diagnostics/network-check-target-l5w4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 20:03:04.568551 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:04.568531 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q podName:9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e nodeName:}" failed. No retries permitted until 2026-10-30 20:03:05.568510192 +0000 UTC m=+4.247792442 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xnl5q" (UniqueName: "kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q") pod "network-check-target-l5w4q" (UID: "9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 20:03:04.813372 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.813196 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 19:58:04 +0000 UTC" deadline="2028-06-02 04:32:08.884514341 +0000 UTC" Oct 30 20:03:04.813372 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.813262 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13928h29m4.071256103s" Oct 30 20:03:04.833978 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.833826 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5hfvr" event={"ID":"d4452f26-53ff-4b31-9417-f550aa50c38d","Type":"ContainerStarted","Data":"e9fd457133bc0eb0f8fe85226bae5306358f5acde9a1829ea334a2667d6d45a4"} Oct 30 20:03:04.841185 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.840114 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cvpxr" event={"ID":"caeeb8a7-4283-4c38-b3be-c036eeeceb65","Type":"ContainerStarted","Data":"12a8bde498ee3f14827b8ff9662c5ea7765ea171e601dc973f2836de752851ab"} Oct 30 20:03:04.841871 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.841843 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2sftq" event={"ID":"f8c5839e-f557-4e1d-a26f-17102c15ff8e","Type":"ContainerStarted","Data":"19a0ca8483dcece61d044c97bc4b75962588d84f1cbe9a51bb74be644f57bf3b"} Oct 30 20:03:04.853399 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.853345 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sxszz" event={"ID":"bea5c7b2-5ad1-43f5-8f43-07e3af665d6a","Type":"ContainerStarted","Data":"b8f3f28d5b76156ba3d153f22b582bfd1646174540202df9682a6aa1bd780612"} Oct 30 20:03:04.865772 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.865687 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" event={"ID":"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a","Type":"ContainerStarted","Data":"d4855521a8fd7fbe3df2536038291b21c212a53ac0d8dbbe9b6a0da401132f8e"} Oct 30 20:03:04.874007 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.873982 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvkf2" event={"ID":"14006e48-475b-4dbe-8994-1f908f897884","Type":"ContainerStarted","Data":"9f975a3b11e1e139184bad1d22d45b0046129a9ca0bb480ab6564bf5272bf68d"} Oct 30 20:03:04.877297 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.877273 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qspzv" event={"ID":"285be4c1-3c4f-4972-b8fa-7f37f92d72bb","Type":"ContainerStarted","Data":"bde0c876d0985d2fbefc7fdb46a7a94dadaf157d085859cc86ecc627d3261a63"} Oct 30 20:03:04.879418 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.879391 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fc6gd" event={"ID":"ff5da8ed-018c-4182-82f0-a8a3266aff52","Type":"ContainerStarted","Data":"0be6720bf54e45526d7b411465dbb59399d96ea97ffc361a16c2d7308d71044f"} Oct 30 20:03:04.889672 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:04.889638 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" event={"ID":"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45","Type":"ContainerStarted","Data":"8087d186464b3111c28de8068816ab6edc3abecac3bb35e7927728d803a7e457"} Oct 30 20:03:05.476278 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:05.476185 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:05.476278 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:05.476257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs\") pod \"network-metrics-daemon-698hj\" (UID: \"f69d831c-d9e4-4060-a2bd-9d85265000f6\") " pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:05.476526 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:05.476454 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 20:03:05.476526 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:05.476519 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs podName:f69d831c-d9e4-4060-a2bd-9d85265000f6 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:07.476498199 +0000 UTC m=+6.155780446 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs") pod "network-metrics-daemon-698hj" (UID: "f69d831c-d9e4-4060-a2bd-9d85265000f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 20:03:05.476653 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:05.476592 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 20:03:05.476653 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:05.476631 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret podName:9dabf5d4-7787-40b3-b01e-fe430c316887 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:07.476618719 +0000 UTC m=+6.155900964 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret") pod "global-pull-secret-syncer-dw59s" (UID: "9dabf5d4-7787-40b3-b01e-fe430c316887") : object "kube-system"/"original-pull-secret" not registered Oct 30 20:03:05.578435 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:05.577663 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnl5q\" (UniqueName: \"kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q\") pod \"network-check-target-l5w4q\" (UID: \"9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e\") " pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:05.578435 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:05.577849 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 20:03:05.578435 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:05.577889 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 20:03:05.578435 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:05.577906 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xnl5q for pod openshift-network-diagnostics/network-check-target-l5w4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 20:03:05.578435 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:05.578045 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q podName:9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e nodeName:}" failed. No retries permitted until 2026-10-30 20:03:07.578024263 +0000 UTC m=+6.257306506 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xnl5q" (UniqueName: "kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q") pod "network-check-target-l5w4q" (UID: "9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 20:03:05.818480 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:05.815942 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 19:58:04 +0000 UTC" deadline="2028-06-15 20:04:38.127713366 +0000 UTC" Oct 30 20:03:05.818480 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:05.815986 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14256h1m32.311732748s" Oct 30 20:03:05.821718 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:05.819318 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:05.821718 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:05.820801 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw59s" podUID="9dabf5d4-7787-40b3-b01e-fe430c316887" Oct 30 20:03:05.821718 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:05.821260 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:05.821718 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:05.821396 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698hj" podUID="f69d831c-d9e4-4060-a2bd-9d85265000f6" Oct 30 20:03:05.821718 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:05.821465 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:05.821718 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:05.821535 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l5w4q" podUID="9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e" Oct 30 20:03:05.902192 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:05.901296 2578 generic.go:356] "Generic (PLEG): container finished" podID="0b98aff2d2ebc77273590dcdeafea2f9" containerID="2fad94b32fb7522361bffae0038aa76f4be645b4599df1f38214edc9ea6d7482" exitCode=0 Oct 30 20:03:05.902192 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:05.901386 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" event={"ID":"0b98aff2d2ebc77273590dcdeafea2f9","Type":"ContainerDied","Data":"2fad94b32fb7522361bffae0038aa76f4be645b4599df1f38214edc9ea6d7482"} Oct 30 20:03:05.924645 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:05.924605 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal" event={"ID":"49a9f3fd327006d80eb3bde05ad64dae","Type":"ContainerStarted","Data":"1d1a222fc133fcb53134203dce7f64d8990b66a53f44ab326121ca5903c9f292"} Oct 30 20:03:05.942876 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:05.942581 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal" podStartSLOduration=2.94256113 podStartE2EDuration="2.94256113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:03:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:05.94171047 +0000 UTC m=+4.620992754" watchObservedRunningTime="2026-10-30 20:03:05.94256113 +0000 UTC m=+4.621843403" Oct 30 20:03:06.938860 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:06.938822 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" event={"ID":"0b98aff2d2ebc77273590dcdeafea2f9","Type":"ContainerStarted","Data":"0b5a798cc6a05b96856c81313dc3527665e0187c0df063f52a04363696fd0560"} Oct 30 20:03:07.493410 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:07.493371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:07.493590 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:07.493464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs\") pod \"network-metrics-daemon-698hj\" (UID: \"f69d831c-d9e4-4060-a2bd-9d85265000f6\") " pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:07.493661 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:07.493597 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 20:03:07.493710 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:07.493663 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs podName:f69d831c-d9e4-4060-a2bd-9d85265000f6 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:11.493645211 +0000 UTC m=+10.172927452 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs") pod "network-metrics-daemon-698hj" (UID: "f69d831c-d9e4-4060-a2bd-9d85265000f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 20:03:07.494145 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:07.494107 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 20:03:07.494234 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:07.494175 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret podName:9dabf5d4-7787-40b3-b01e-fe430c316887 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:11.494158914 +0000 UTC m=+10.173441162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret") pod "global-pull-secret-syncer-dw59s" (UID: "9dabf5d4-7787-40b3-b01e-fe430c316887") : object "kube-system"/"original-pull-secret" not registered Oct 30 20:03:07.594285 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:07.594249 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnl5q\" (UniqueName: \"kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q\") pod \"network-check-target-l5w4q\" (UID: \"9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e\") " pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:07.594493 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:07.594474 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 20:03:07.594558 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:07.594504 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 20:03:07.594558 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:07.594517 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xnl5q for pod openshift-network-diagnostics/network-check-target-l5w4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 20:03:07.594662 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:07.594575 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q podName:9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e nodeName:}" failed. No retries permitted until 2026-10-30 20:03:11.594556334 +0000 UTC m=+10.273838583 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xnl5q" (UniqueName: "kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q") pod "network-check-target-l5w4q" (UID: "9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 20:03:07.818593 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:07.818520 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:07.823570 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:07.823527 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw59s" podUID="9dabf5d4-7787-40b3-b01e-fe430c316887" Oct 30 20:03:07.824015 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:07.823992 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:07.824168 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:07.824148 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698hj" podUID="f69d831c-d9e4-4060-a2bd-9d85265000f6" Oct 30 20:03:07.824622 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:07.818521 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:07.824753 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:07.824733 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l5w4q" podUID="9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e" Oct 30 20:03:07.948160 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:07.948078 2578 generic.go:356] "Generic (PLEG): container finished" podID="14006e48-475b-4dbe-8994-1f908f897884" containerID="cabf06fdc7032099828ff0f1519f6d08aaf7da6d0fab8105014de3598707b276" exitCode=0 Oct 30 20:03:07.949209 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:07.949174 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvkf2" event={"ID":"14006e48-475b-4dbe-8994-1f908f897884","Type":"ContainerDied","Data":"cabf06fdc7032099828ff0f1519f6d08aaf7da6d0fab8105014de3598707b276"} Oct 30 20:03:07.994094 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:07.994015 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" podStartSLOduration=4.993995288 podStartE2EDuration="4.993995288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:03:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:06.957296414 +0000 UTC m=+5.636578668" watchObservedRunningTime="2026-10-30 20:03:07.993995288 +0000 UTC m=+6.673277540" Oct 30 20:03:08.954645 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:08.954604 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cvpxr" event={"ID":"caeeb8a7-4283-4c38-b3be-c036eeeceb65","Type":"ContainerStarted","Data":"525bfc43db04975a8c54a3407a923f9a19e0aa76cf45a54efa493de00d08302b"} Oct 30 20:03:08.974640 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:08.974578 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cvpxr" podStartSLOduration=2.841638843 podStartE2EDuration="6.974558216s" totalImagesPullingTime="4.132919373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:08.973989083 +0000 UTC m=+7.653271353" watchObservedRunningTime="2026-10-30 20:03:08.974558216 +0000 UTC m=+7.653840467" Oct 30 20:03:09.819020 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:09.818984 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:09.819198 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:09.819128 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw59s" podUID="9dabf5d4-7787-40b3-b01e-fe430c316887" Oct 30 20:03:09.819576 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:09.819528 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:09.819692 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:09.819631 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698hj" podUID="f69d831c-d9e4-4060-a2bd-9d85265000f6" Oct 30 20:03:09.819692 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:09.819683 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:09.819790 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:09.819751 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l5w4q" podUID="9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e" Oct 30 20:03:09.961180 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:09.961144 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fc6gd" event={"ID":"ff5da8ed-018c-4182-82f0-a8a3266aff52","Type":"ContainerStarted","Data":"46026611dffddfb8262cfa31a36dbf5cab69519c13a1d1e2ded39f92be4701ce"} Oct 30 20:03:10.966811 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:10.966740 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" event={"ID":"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a","Type":"ContainerStarted","Data":"a9e3319f41dcc45d51b76538e7c6ec246229db8defee73527b99b10c4e73fdaa"} Oct 30 20:03:11.529357 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:11.528732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:11.529357 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:11.528825 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs\") pod \"network-metrics-daemon-698hj\" (UID: \"f69d831c-d9e4-4060-a2bd-9d85265000f6\") " pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:11.529357 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:11.528962 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 20:03:11.529357 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:11.529026 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs podName:f69d831c-d9e4-4060-a2bd-9d85265000f6 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:19.529007857 +0000 UTC m=+18.208290095 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs") pod "network-metrics-daemon-698hj" (UID: "f69d831c-d9e4-4060-a2bd-9d85265000f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 20:03:11.529677 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:11.529442 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 20:03:11.529677 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:11.529496 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret podName:9dabf5d4-7787-40b3-b01e-fe430c316887 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:19.529482213 +0000 UTC m=+18.208764453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret") pod "global-pull-secret-syncer-dw59s" (UID: "9dabf5d4-7787-40b3-b01e-fe430c316887") : object "kube-system"/"original-pull-secret" not registered Oct 30 20:03:11.629951 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:11.629906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnl5q\" (UniqueName: \"kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q\") pod \"network-check-target-l5w4q\" (UID: \"9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e\") " pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:11.630118 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:11.630089 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 20:03:11.630118 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:11.630109 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 20:03:11.630239 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:11.630123 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xnl5q for pod openshift-network-diagnostics/network-check-target-l5w4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 20:03:11.630239 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:11.630182 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q podName:9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e nodeName:}" failed. No retries permitted until 2026-10-30 20:03:19.630163975 +0000 UTC m=+18.309446216 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xnl5q" (UniqueName: "kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q") pod "network-check-target-l5w4q" (UID: "9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 20:03:11.827172 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:11.825899 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:11.827172 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:11.826022 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698hj" podUID="f69d831c-d9e4-4060-a2bd-9d85265000f6" Oct 30 20:03:11.827172 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:11.826438 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:11.827172 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:11.826533 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l5w4q" podUID="9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e" Oct 30 20:03:11.827172 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:11.826593 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:11.827172 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:11.826716 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw59s" podUID="9dabf5d4-7787-40b3-b01e-fe430c316887" Oct 30 20:03:11.998560 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:11.998523 2578 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 20:03:12.431655 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:12.431558 2578 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cvpxr" Oct 30 20:03:12.432608 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:12.432587 2578 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cvpxr" Oct 30 20:03:12.462014 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:12.461955 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fc6gd" podStartSLOduration=5.3490519 podStartE2EDuration="10.461938149s" totalImagesPullingTime="5.112886249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:09.979931606 +0000 UTC m=+8.659213855" watchObservedRunningTime="2026-10-30 20:03:12.461938149 +0000 UTC m=+11.141220397" Oct 30 20:03:12.825672 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:12.825540 2578 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T20:03:11.998539576Z","UUID":"d3a11b3c-c271-462f-b330-46d022de8855","Handler":null,"Name":"","Endpoint":""} Oct 30 20:03:12.827167 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:12.827140 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 20:03:12.827167 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:12.827172 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 20:03:12.974372 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:12.974271 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sxszz" event={"ID":"bea5c7b2-5ad1-43f5-8f43-07e3af665d6a","Type":"ContainerStarted","Data":"0b486ad28ddaef77c969e95a1ba54655fc4da76e30e58f68b647b92b4e0a5ff1"} Oct 30 20:03:12.977399 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:12.977364 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" event={"ID":"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a","Type":"ContainerStarted","Data":"c45b6df2e37ce8e8a231a17824fe0500039541a629a5279f6b4e39db8acc8e9c"} Oct 30 20:03:12.980479 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:12.980452 2578 generic.go:356] "Generic (PLEG): container finished" podID="14006e48-475b-4dbe-8994-1f908f897884" containerID="2f8db9778d8ee7664159b7c426fcf79d92b6bfd315f8ea4b067d7cd1a7957e13" exitCode=0 Oct 30 20:03:12.980610 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:12.980531 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvkf2" event={"ID":"14006e48-475b-4dbe-8994-1f908f897884","Type":"ContainerDied","Data":"2f8db9778d8ee7664159b7c426fcf79d92b6bfd315f8ea4b067d7cd1a7957e13"} Oct 30 20:03:12.982582 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:12.982559 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qspzv" event={"ID":"285be4c1-3c4f-4972-b8fa-7f37f92d72bb","Type":"ContainerStarted","Data":"41c5c55556af532676705d4f5794789fe2679825194bcae2b7f96bb0d98c26c9"} Oct 30 20:03:13.024583 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:13.024521 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-sxszz" podStartSLOduration=3.002925801 podStartE2EDuration="11.024504764s" totalImagesPullingTime="8.021578963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:12.994023391 +0000 UTC m=+11.673305641" watchObservedRunningTime="2026-10-30 20:03:13.024504764 +0000 UTC m=+11.703787014" Oct 30 20:03:13.045193 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:13.045136 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-qspzv" podStartSLOduration=2.964396727 podStartE2EDuration="11.045119708s" totalImagesPullingTime="8.080722981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:13.044944765 +0000 UTC m=+11.724227014" watchObservedRunningTime="2026-10-30 20:03:13.045119708 +0000 UTC m=+11.724401975" Oct 30 20:03:13.819076 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:13.819047 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:13.819200 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:13.819177 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw59s" podUID="9dabf5d4-7787-40b3-b01e-fe430c316887" Oct 30 20:03:13.819555 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:13.819538 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:13.819719 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:13.819642 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698hj" podUID="f69d831c-d9e4-4060-a2bd-9d85265000f6" Oct 30 20:03:13.819719 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:13.819697 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:13.819822 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:13.819760 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l5w4q" podUID="9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e" Oct 30 20:03:13.988615 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:13.988368 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5hfvr" event={"ID":"d4452f26-53ff-4b31-9417-f550aa50c38d","Type":"ContainerStarted","Data":"d05b7ef6dd3ce0ea32fd0d0c335811395419e7dc8dbbbc23f0ef519421ac1527"} Oct 30 20:03:13.991253 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:13.991218 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" event={"ID":"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a","Type":"ContainerStarted","Data":"4d8719ca89aaa8bbb335b3de0ae18092e6d58382dd9109b1698dc8958d855ffe"} Oct 30 20:03:13.993601 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:13.993576 2578 generic.go:356] "Generic (PLEG): container finished" podID="14006e48-475b-4dbe-8994-1f908f897884" containerID="49d62a8b013c5b9424e97111beeb23f74cdeeeebdd47d647647b16b2526a5db0" exitCode=0 Oct 30 20:03:13.994403 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:13.994377 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvkf2" event={"ID":"14006e48-475b-4dbe-8994-1f908f897884","Type":"ContainerDied","Data":"49d62a8b013c5b9424e97111beeb23f74cdeeeebdd47d647647b16b2526a5db0"} Oct 30 20:03:14.011697 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:14.011633 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5hfvr" podStartSLOduration=3.667205234 podStartE2EDuration="12.011612569s" totalImagesPullingTime="8.344407335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:14.011003546 +0000 UTC m=+12.690285823" watchObservedRunningTime="2026-10-30 20:03:14.011612569 +0000 UTC m=+12.690894821" Oct 30 20:03:14.073485 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:14.072773 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" podStartSLOduration=3.483190157 podStartE2EDuration="12.072751949s" totalImagesPullingTime="8.589561792s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:03:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:14.072474197 +0000 UTC m=+12.751756448" watchObservedRunningTime="2026-10-30 20:03:14.072751949 +0000 UTC m=+12.752034215" Oct 30 20:03:15.002194 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:15.002082 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2sftq" event={"ID":"f8c5839e-f557-4e1d-a26f-17102c15ff8e","Type":"ContainerStarted","Data":"d1613b8f2e71b6b988ea7c81eb367d9f5641383bfe1a5124cb046da4ffca0be9"} Oct 30 20:03:15.025801 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:15.025751 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2sftq" podStartSLOduration=2.496238131 podStartE2EDuration="13.025738268s" totalImagesPullingTime="10.529500137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:15.025639374 +0000 UTC m=+13.704921623" watchObservedRunningTime="2026-10-30 20:03:15.025738268 +0000 UTC m=+13.705020517" Oct 30 20:03:15.816684 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:15.816654 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:15.817256 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:15.816698 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:15.817256 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:15.816797 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l5w4q" podUID="9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e" Oct 30 20:03:15.817256 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:15.816840 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:15.817256 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:15.816945 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw59s" podUID="9dabf5d4-7787-40b3-b01e-fe430c316887" Oct 30 20:03:15.817256 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:15.817014 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698hj" podUID="f69d831c-d9e4-4060-a2bd-9d85265000f6" Oct 30 20:03:16.007216 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:16.007180 2578 generic.go:356] "Generic (PLEG): container finished" podID="14006e48-475b-4dbe-8994-1f908f897884" containerID="2351d85c0cd40d8ce8a9309987ec834e8a94792a536ce0cea346bc6f19ee7654" exitCode=0 Oct 30 20:03:16.007398 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:16.007261 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvkf2" event={"ID":"14006e48-475b-4dbe-8994-1f908f897884","Type":"ContainerDied","Data":"2351d85c0cd40d8ce8a9309987ec834e8a94792a536ce0cea346bc6f19ee7654"} Oct 30 20:03:17.817110 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:17.817068 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:17.817110 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:17.817110 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:17.817991 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:17.817074 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:17.817991 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:17.817205 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw59s" podUID="9dabf5d4-7787-40b3-b01e-fe430c316887" Oct 30 20:03:17.817991 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:17.817293 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l5w4q" podUID="9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e" Oct 30 20:03:17.817991 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:17.817406 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698hj" podUID="f69d831c-d9e4-4060-a2bd-9d85265000f6" Oct 30 20:03:19.591414 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:19.591119 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:19.591414 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:19.591237 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 20:03:19.591414 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:19.591372 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs\") pod \"network-metrics-daemon-698hj\" (UID: \"f69d831c-d9e4-4060-a2bd-9d85265000f6\") " pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:19.591841 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:19.591429 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret podName:9dabf5d4-7787-40b3-b01e-fe430c316887 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:35.591409701 +0000 UTC m=+34.270691942 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret") pod "global-pull-secret-syncer-dw59s" (UID: "9dabf5d4-7787-40b3-b01e-fe430c316887") : object "kube-system"/"original-pull-secret" not registered Oct 30 20:03:19.591841 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:19.591482 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 20:03:19.591841 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:19.591540 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs podName:f69d831c-d9e4-4060-a2bd-9d85265000f6 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:35.591523964 +0000 UTC m=+34.270806195 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs") pod "network-metrics-daemon-698hj" (UID: "f69d831c-d9e4-4060-a2bd-9d85265000f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 20:03:19.692355 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:19.692290 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnl5q\" (UniqueName: \"kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q\") pod \"network-check-target-l5w4q\" (UID: \"9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e\") " pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:19.692496 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:19.692436 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 20:03:19.692496 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:19.692453 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 20:03:19.692496 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:19.692463 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xnl5q for pod openshift-network-diagnostics/network-check-target-l5w4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 20:03:19.692613 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:19.692512 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q podName:9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e nodeName:}" failed. No retries permitted until 2026-10-30 20:03:35.692499356 +0000 UTC m=+34.371781597 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xnl5q" (UniqueName: "kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q") pod "network-check-target-l5w4q" (UID: "9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 20:03:19.817146 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:19.817111 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:19.817146 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:19.817132 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:19.817397 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:19.817238 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:19.817397 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:19.817236 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698hj" podUID="f69d831c-d9e4-4060-a2bd-9d85265000f6" Oct 30 20:03:19.817397 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:19.817358 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw59s" podUID="9dabf5d4-7787-40b3-b01e-fe430c316887" Oct 30 20:03:19.817570 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:19.817417 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l5w4q" podUID="9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e" Oct 30 20:03:20.018119 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:20.017887 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" event={"ID":"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45","Type":"ContainerStarted","Data":"d290a957163eac238b7d36f3481c0365f1e3b05464692aa7595aca318fe81590"} Oct 30 20:03:20.018119 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:20.018112 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" event={"ID":"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45","Type":"ContainerStarted","Data":"be3026559430f019773d94234584f4e97d32ec90a0f8fbb74b309b66d17285f3"} Oct 30 20:03:20.018305 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:20.018144 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" event={"ID":"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45","Type":"ContainerStarted","Data":"2dc445f4999926ceb4c2321999dcd029395c3c71224a9ddef1fd155b2466f866"} Oct 30 20:03:20.018305 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:20.018176 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" event={"ID":"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45","Type":"ContainerStarted","Data":"6c239c94d711efc1bcc26f572dbce0e0f94b2fc15e1df570ffeb45b86e68718e"} Oct 30 20:03:20.018305 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:20.018212 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" event={"ID":"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45","Type":"ContainerStarted","Data":"2ec48ab53fbf4cf3b13e4b1b68c3917b91a20c959f27c44138a3528d6595446a"} Oct 30 20:03:20.018305 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:20.018256 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" event={"ID":"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45","Type":"ContainerStarted","Data":"8b0d42d817cf94ee31f387ce1cfa23cc3e12b68415c81b65947bad02e82ef12f"} Oct 30 20:03:20.020723 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:20.020697 2578 generic.go:356] "Generic (PLEG): container finished" podID="14006e48-475b-4dbe-8994-1f908f897884" containerID="722e7159ae375207cc2f29048cb20051193e9d60789e2e929329065ce3e20720" exitCode=0 Oct 30 20:03:20.020829 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:20.020743 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvkf2" event={"ID":"14006e48-475b-4dbe-8994-1f908f897884","Type":"ContainerDied","Data":"722e7159ae375207cc2f29048cb20051193e9d60789e2e929329065ce3e20720"} Oct 30 20:03:21.025316 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:21.025276 2578 generic.go:356] "Generic (PLEG): container finished" podID="14006e48-475b-4dbe-8994-1f908f897884" containerID="2ff4678a572fea63cf2e82bd3b5eec075bb4c35b62962d77fa38e8384ab1bc1f" exitCode=0 Oct 30 20:03:21.025737 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:21.025362 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvkf2" event={"ID":"14006e48-475b-4dbe-8994-1f908f897884","Type":"ContainerDied","Data":"2ff4678a572fea63cf2e82bd3b5eec075bb4c35b62962d77fa38e8384ab1bc1f"} Oct 30 20:03:21.817080 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:21.817044 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:21.817273 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:21.817182 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:21.817273 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:21.817225 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l5w4q" podUID="9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e" Oct 30 20:03:21.817273 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:21.817255 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:21.817456 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:21.817372 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw59s" podUID="9dabf5d4-7787-40b3-b01e-fe430c316887" Oct 30 20:03:21.817493 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:21.817470 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698hj" podUID="f69d831c-d9e4-4060-a2bd-9d85265000f6" Oct 30 20:03:22.029958 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:22.029866 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvkf2" event={"ID":"14006e48-475b-4dbe-8994-1f908f897884","Type":"ContainerStarted","Data":"5500f34bb2ac3f355590a34b9fc0c37ab275c8a1c3944800ded1c08bf421c71e"} Oct 30 20:03:22.032874 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:22.032850 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" event={"ID":"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45","Type":"ContainerStarted","Data":"f6969e1e47fb059864d9db5cb8fe20210947642305043b0b598e464ab5b7fe8a"} Oct 30 20:03:22.057457 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:22.057412 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tvkf2" podStartSLOduration=7.324343072 podStartE2EDuration="20.057398154s" totalImagesPullingTime="12.733055082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:03:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:22.057271212 +0000 UTC m=+20.736553462" watchObservedRunningTime="2026-10-30 20:03:22.057398154 +0000 UTC m=+20.736680412" Oct 30 20:03:23.819911 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:23.819879 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:23.820456 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:23.819973 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:23.820456 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:23.820080 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:23.820456 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:23.820099 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698hj" podUID="f69d831c-d9e4-4060-a2bd-9d85265000f6" Oct 30 20:03:23.820456 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:23.820158 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l5w4q" podUID="9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e" Oct 30 20:03:23.820456 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:23.820225 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw59s" podUID="9dabf5d4-7787-40b3-b01e-fe430c316887" Oct 30 20:03:24.040773 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:24.040683 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" event={"ID":"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45","Type":"ContainerStarted","Data":"e9f1b0b93df4b80037d5361ca1c0b83a6e374bdabe171d7dcee586bf79cb907b"} Oct 30 20:03:24.040981 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:24.040956 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:24.041092 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:24.041016 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:24.052631 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:24.052588 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cvpxr" Oct 30 20:03:24.052800 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:24.052727 2578 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 20:03:24.053159 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:24.053134 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cvpxr" Oct 30 20:03:24.057394 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:24.057372 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:24.076453 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:24.076410 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" podStartSLOduration=6.969708224 podStartE2EDuration="22.076398192s" totalImagesPullingTime="15.106689968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:24.075975959 +0000 UTC m=+22.755258209" watchObservedRunningTime="2026-10-30 20:03:24.076398192 +0000 UTC m=+22.755680440" Oct 30 20:03:25.046348 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:25.046309 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:25.061152 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:25.061118 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:25.599385 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:25.599353 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l5w4q"] Oct 30 20:03:25.599661 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:25.599504 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:25.599661 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:25.599589 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l5w4q" podUID="9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e" Oct 30 20:03:25.604029 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:25.604004 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dw59s"] Oct 30 20:03:25.604157 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:25.604099 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:25.604228 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:25.604171 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw59s" podUID="9dabf5d4-7787-40b3-b01e-fe430c316887" Oct 30 20:03:25.608576 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:25.608554 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-698hj"] Oct 30 20:03:25.608699 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:25.608660 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:25.608786 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:25.608766 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698hj" podUID="f69d831c-d9e4-4060-a2bd-9d85265000f6" Oct 30 20:03:26.817072 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:26.817041 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:26.817532 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:26.817051 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:26.817532 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:26.817164 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l5w4q" podUID="9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e" Oct 30 20:03:26.817532 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:26.817249 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw59s" podUID="9dabf5d4-7787-40b3-b01e-fe430c316887" Oct 30 20:03:27.820627 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:27.820459 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:27.820978 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:27.820712 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698hj" podUID="f69d831c-d9e4-4060-a2bd-9d85265000f6" Oct 30 20:03:28.816343 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:28.816293 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:28.816343 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:28.816347 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:28.816612 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:28.816422 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l5w4q" podUID="9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e" Oct 30 20:03:28.816612 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:28.816503 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw59s" podUID="9dabf5d4-7787-40b3-b01e-fe430c316887" Oct 30 20:03:29.819751 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:29.819723 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:29.820128 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:29.819831 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-698hj" podUID="f69d831c-d9e4-4060-a2bd-9d85265000f6" Oct 30 20:03:30.816924 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:30.816891 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:30.816924 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:30.816919 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:30.817128 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:30.816994 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dw59s" podUID="9dabf5d4-7787-40b3-b01e-fe430c316887" Oct 30 20:03:30.817128 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:30.817115 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l5w4q" podUID="9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e" Oct 30 20:03:31.655728 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.655701 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeReady" Oct 30 20:03:31.656077 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.655847 2578 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Oct 30 20:03:31.695941 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.695906 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-xh8v8"] Oct 30 20:03:31.698986 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.698969 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-xh8v8" Oct 30 20:03:31.704362 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.704320 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-4zrr5"] Oct 30 20:03:31.706491 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.706462 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Oct 30 20:03:31.706588 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.706550 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Oct 30 20:03:31.707653 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.707631 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-ffthk"] Oct 30 20:03:31.707944 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.707921 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-4zrr5" Oct 30 20:03:31.710502 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.710484 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-gksz8"] Oct 30 20:03:31.710606 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.710593 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-ffthk" Oct 30 20:03:31.713182 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.713164 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz"] Oct 30 20:03:31.713296 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.713277 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-gksz8" Oct 30 20:03:31.716032 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.716015 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j"] Oct 30 20:03:31.716133 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.716116 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" Oct 30 20:03:31.720968 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.720941 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7f94f8f65c-dqcj8"] Oct 30 20:03:31.722301 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.722283 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:31.726050 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.725669 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-rjm4m\"" Oct 30 20:03:31.726050 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.725679 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Oct 30 20:03:31.726196 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.726077 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Oct 30 20:03:31.732983 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.732953 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-s4s25"] Oct 30 20:03:31.733116 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.733091 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:31.736032 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.736004 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-c262w"] Oct 30 20:03:31.736139 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.736109 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-s4s25" Oct 30 20:03:31.739691 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.739667 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj"] Oct 30 20:03:31.739811 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.739792 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:31.744504 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.743834 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m"] Oct 30 20:03:31.744504 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.743948 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" Oct 30 20:03:31.747276 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.747253 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-dr852"] Oct 30 20:03:31.747390 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.747302 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:31.754524 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.754500 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-sb9tl"] Oct 30 20:03:31.756495 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.756473 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:31.759801 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.759779 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75c856df5f-jdst9"] Oct 30 20:03:31.759931 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.759903 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-sb9tl" Oct 30 20:03:31.774014 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.769483 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8586cfd6bb-wzm9m"] Oct 30 20:03:31.774014 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.770100 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.774014 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.772707 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-xh8v8"] Oct 30 20:03:31.774014 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.772744 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-4zrr5"] Oct 30 20:03:31.774014 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.772766 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz"] Oct 30 20:03:31.774014 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.772785 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-s4s25"] Oct 30 20:03:31.774014 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.772805 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-t85sd"] Oct 30 20:03:31.774014 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.772918 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.774516 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.774493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae25b031-7ac9-4041-bc3a-7a6679eab74d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-gksz8\" (UID: \"ae25b031-7ac9-4041-bc3a-7a6679eab74d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-gksz8" Oct 30 20:03:31.775090 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.775072 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nkhw\" (UniqueName: \"kubernetes.io/projected/93a3069b-7891-4146-a085-7b218eeff695-kube-api-access-2nkhw\") pod \"kas-connection-checker-685895c7c9-4zrr5\" (UID: \"93a3069b-7891-4146-a085-7b218eeff695\") " pod="kube-system/kas-connection-checker-685895c7c9-4zrr5" Oct 30 20:03:31.775154 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.775103 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ae25b031-7ac9-4041-bc3a-7a6679eab74d-nginx-conf\") pod \"networking-console-plugin-86c478bb88-gksz8\" (UID: \"ae25b031-7ac9-4041-bc3a-7a6679eab74d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-gksz8" Oct 30 20:03:31.775154 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.775120 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2cpl\" (UniqueName: \"kubernetes.io/projected/a7d2c4e7-accb-4388-97c7-62c0b40ebb4c-kube-api-access-r2cpl\") pod \"kas-connection-checker-685895c7c9-xh8v8\" (UID: \"a7d2c4e7-accb-4388-97c7-62c0b40ebb4c\") " pod="kube-system/kas-connection-checker-685895c7c9-xh8v8" Oct 30 20:03:31.775256 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.775152 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfdr6\" (UniqueName: \"kubernetes.io/projected/364408a3-5d56-4e76-9c96-a2a08841b50f-kube-api-access-nfdr6\") pod \"kas-connection-checker-685895c7c9-ffthk\" (UID: \"364408a3-5d56-4e76-9c96-a2a08841b50f\") " pod="kube-system/kas-connection-checker-685895c7c9-ffthk" Oct 30 20:03:31.775961 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.775939 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hd99r"] Oct 30 20:03:31.776088 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.776068 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t85sd" Oct 30 20:03:31.778998 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.778978 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-gksz8"] Oct 30 20:03:31.779107 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.779010 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-c262w"] Oct 30 20:03:31.779107 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.779032 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-ffthk"] Oct 30 20:03:31.779107 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.779052 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8586cfd6bb-wzm9m"] Oct 30 20:03:31.779107 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.779070 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-dr852"] Oct 30 20:03:31.779107 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.779087 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f94f8f65c-dqcj8"] Oct 30 20:03:31.779107 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.779094 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:31.779107 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.779107 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj"] Oct 30 20:03:31.786135 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.786106 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-sb9tl"] Oct 30 20:03:31.786251 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.786202 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m"] Oct 30 20:03:31.786251 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.786234 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hd99r"] Oct 30 20:03:31.786359 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.786258 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t85sd"] Oct 30 20:03:31.786359 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.786276 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j"] Oct 30 20:03:31.786703 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.786656 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75c856df5f-jdst9"] Oct 30 20:03:31.805862 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.805829 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Oct 30 20:03:31.805967 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.805887 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 20:03:31.805967 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.805888 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 20:03:31.806078 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.806039 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Oct 30 20:03:31.806078 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.806051 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 20:03:31.806078 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.806065 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 20:03:31.806221 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.806090 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Oct 30 20:03:31.806221 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.806100 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 20:03:31.806221 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.806129 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Oct 30 20:03:31.806418 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.806401 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 20:03:31.806476 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.806415 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Oct 30 20:03:31.806476 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.806440 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Oct 30 20:03:31.806476 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.806458 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Oct 30 20:03:31.806476 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.806470 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 20:03:31.806933 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.806909 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Oct 30 20:03:31.807459 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.807441 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Oct 30 20:03:31.807885 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.807868 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Oct 30 20:03:31.807953 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.807903 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Oct 30 20:03:31.808009 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.807949 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Oct 30 20:03:31.808009 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.807970 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Oct 30 20:03:31.808009 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.807982 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Oct 30 20:03:31.808554 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.808533 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Oct 30 20:03:31.808644 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.808557 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Oct 30 20:03:31.808644 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.808571 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Oct 30 20:03:31.808710 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.808694 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 20:03:31.809159 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.809137 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 20:03:31.809260 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.809145 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Oct 30 20:03:31.809347 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.809266 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Oct 30 20:03:31.813166 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.813140 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Oct 30 20:03:31.816483 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.816465 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:31.822350 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.822317 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Oct 30 20:03:31.822501 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.822345 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Oct 30 20:03:31.823959 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.823905 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Oct 30 20:03:31.824054 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.824025 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-k8q4l\"" Oct 30 20:03:31.824141 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.824107 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Oct 30 20:03:31.824733 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.824718 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Oct 30 20:03:31.824837 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.824778 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Oct 30 20:03:31.824885 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.824867 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Oct 30 20:03:31.824935 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.824922 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Oct 30 20:03:31.824981 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.824963 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Oct 30 20:03:31.824981 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.824923 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Oct 30 20:03:31.825138 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.824991 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-d99xr\"" Oct 30 20:03:31.825138 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.825008 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c2z8r\"" Oct 30 20:03:31.825138 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.825119 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Oct 30 20:03:31.825138 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.825128 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Oct 30 20:03:31.825138 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.825134 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-kgzch\"" Oct 30 20:03:31.825402 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.825252 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xh4ts\"" Oct 30 20:03:31.825402 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.825370 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pxq5r\"" Oct 30 20:03:31.825402 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.825397 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 20:03:31.825552 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.825466 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-nfbvj\"" Oct 30 20:03:31.825552 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.825481 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Oct 30 20:03:31.825552 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.825510 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 20:03:31.825552 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.825537 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z4rcb\"" Oct 30 20:03:31.825552 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.825542 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Oct 30 20:03:31.826166 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.826148 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7rvzz\"" Oct 30 20:03:31.826166 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.826162 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 20:03:31.826291 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.826188 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cm4f9\"" Oct 30 20:03:31.826421 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.826407 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-l7p25\"" Oct 30 20:03:31.826489 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.826479 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7scj5\"" Oct 30 20:03:31.827641 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.827618 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvpxr_caeeb8a7-4283-4c38-b3be-c036eeeceb65/konnectivity-agent/0.log" limit=1024 Oct 30 20:03:31.875770 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.875591 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae25b031-7ac9-4041-bc3a-7a6679eab74d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-gksz8\" (UID: \"ae25b031-7ac9-4041-bc3a-7a6679eab74d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-gksz8" Oct 30 20:03:31.875770 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.875629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adb774f6-0266-4c60-92e9-f0a5f8ac831e-service-ca-bundle\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:31.875770 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.875680 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20ba9ea0-10d3-419c-a429-3a6dcf153171-serving-cert\") pod \"service-ca-operator-544d749c8c-5hdqj\" (UID: \"20ba9ea0-10d3-419c-a429-3a6dcf153171\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" Oct 30 20:03:31.875770 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.875707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ae25b031-7ac9-4041-bc3a-7a6679eab74d-nginx-conf\") pod \"networking-console-plugin-86c478bb88-gksz8\" (UID: \"ae25b031-7ac9-4041-bc3a-7a6679eab74d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-gksz8" Oct 30 20:03:31.875770 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.875733 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb7sg\" (UniqueName: \"kubernetes.io/projected/7f941d6e-cd94-47d5-a641-fb608c05a903-kube-api-access-bb7sg\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:31.875770 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.875762 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jb98m\" (UID: \"28ba2930-e73c-4716-b061-d7cb2bbd0400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:31.876157 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.875827 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/24b57f65-bf27-4659-a922-83a241893696-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-bbm2j\" (UID: \"24b57f65-bf27-4659-a922-83a241893696\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:31.876157 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.875868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nkhw\" (UniqueName: \"kubernetes.io/projected/93a3069b-7891-4146-a085-7b218eeff695-kube-api-access-2nkhw\") pod \"kas-connection-checker-685895c7c9-4zrr5\" (UID: \"93a3069b-7891-4146-a085-7b218eeff695\") " pod="kube-system/kas-connection-checker-685895c7c9-4zrr5" Oct 30 20:03:31.876157 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.875911 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ac859bf-692b-4447-891a-32541e1e244d-ca-trust-extracted\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.876157 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.875948 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-certificates\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.876157 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:31.875948 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 20:03:31.876157 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.876095 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2cpl\" (UniqueName: \"kubernetes.io/projected/a7d2c4e7-accb-4388-97c7-62c0b40ebb4c-kube-api-access-r2cpl\") pod \"kas-connection-checker-685895c7c9-xh8v8\" (UID: \"a7d2c4e7-accb-4388-97c7-62c0b40ebb4c\") " pod="kube-system/kas-connection-checker-685895c7c9-xh8v8" Oct 30 20:03:31.876421 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:31.876166 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae25b031-7ac9-4041-bc3a-7a6679eab74d-networking-console-plugin-cert podName:ae25b031-7ac9-4041-bc3a-7a6679eab74d nodeName:}" failed. No retries permitted until 2026-10-30 20:03:32.376141156 +0000 UTC m=+31.055423407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae25b031-7ac9-4041-bc3a-7a6679eab74d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-gksz8" (UID: "ae25b031-7ac9-4041-bc3a-7a6679eab74d") : secret "networking-console-plugin-cert" not found Oct 30 20:03:31.876421 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.876192 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee5e6319-c93c-4713-b99c-9e5660af5192-trusted-ca\") pod \"console-operator-7cd56b8dbc-dr852\" (UID: \"ee5e6319-c93c-4713-b99c-9e5660af5192\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:31.876421 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.876373 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8af5bdb-cf19-4210-85c0-815d452cb701-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz\" (UID: \"e8af5bdb-cf19-4210-85c0-815d452cb701\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" Oct 30 20:03:31.876421 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.876404 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-bound-sa-token\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.876575 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.876429 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzghk\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-kube-api-access-qzghk\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.876575 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.876455 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b644\" (UniqueName: \"kubernetes.io/projected/24b57f65-bf27-4659-a922-83a241893696-kube-api-access-4b644\") pod \"cluster-monitoring-operator-884576c57-bbm2j\" (UID: \"24b57f65-bf27-4659-a922-83a241893696\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:31.876575 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.876504 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfdr6\" (UniqueName: \"kubernetes.io/projected/364408a3-5d56-4e76-9c96-a2a08841b50f-kube-api-access-nfdr6\") pod \"kas-connection-checker-685895c7c9-ffthk\" (UID: \"364408a3-5d56-4e76-9c96-a2a08841b50f\") " pod="kube-system/kas-connection-checker-685895c7c9-ffthk" Oct 30 20:03:31.876575 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.876547 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adb774f6-0266-4c60-92e9-f0a5f8ac831e-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:31.876788 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.876591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:31.876788 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.876634 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-jb98m\" (UID: \"28ba2930-e73c-4716-b061-d7cb2bbd0400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:31.876788 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.876706 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ac859bf-692b-4447-891a-32541e1e244d-registry-certificates\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.876788 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.876712 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ae25b031-7ac9-4041-bc3a-7a6679eab74d-nginx-conf\") pod \"networking-console-plugin-86c478bb88-gksz8\" (UID: \"ae25b031-7ac9-4041-bc3a-7a6679eab74d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-gksz8" Oct 30 20:03:31.876788 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.876749 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adb774f6-0266-4c60-92e9-f0a5f8ac831e-tmp\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:31.876995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.876800 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44fgw\" (UniqueName: \"kubernetes.io/projected/f5dddacb-f3d8-43cc-9191-c9f63e56db20-kube-api-access-44fgw\") pod \"volume-data-source-validator-58c9f5f46d-s4s25\" (UID: \"f5dddacb-f3d8-43cc-9191-c9f63e56db20\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-s4s25" Oct 30 20:03:31.876995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.876829 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8af5bdb-cf19-4210-85c0-815d452cb701-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz\" (UID: \"e8af5bdb-cf19-4210-85c0-815d452cb701\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" Oct 30 20:03:31.876995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.876853 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jncv5\" (UniqueName: \"kubernetes.io/projected/28ba2930-e73c-4716-b061-d7cb2bbd0400-kube-api-access-jncv5\") pod \"cluster-samples-operator-6ddb6c8b94-jb98m\" (UID: \"28ba2930-e73c-4716-b061-d7cb2bbd0400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:31.876995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.876896 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/27e4937d-367a-4ccc-9580-74a3982a49fe-image-registry-private-configuration\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.876995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.876936 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.876995 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.876968 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f941d6e-cd94-47d5-a641-fb608c05a903-tmp-dir\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:31.877162 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877007 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlxdg\" (UniqueName: \"kubernetes.io/projected/2e5941e6-4fc9-4353-a518-8ad492e9ad61-kube-api-access-jlxdg\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:31.877162 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877032 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsbbs\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-kube-api-access-fsbbs\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.877162 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877092 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmj4v\" (UniqueName: \"kubernetes.io/projected/fbfa2cf8-ef21-4485-91f3-6ca0b0b0d55d-kube-api-access-tmj4v\") pod \"network-check-source-6f78d59f99-sb9tl\" (UID: \"fbfa2cf8-ef21-4485-91f3-6ca0b0b0d55d\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-sb9tl" Oct 30 20:03:31.877162 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877119 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-bound-sa-token\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.877162 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877142 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spmg8\" (UniqueName: \"kubernetes.io/projected/e8af5bdb-cf19-4210-85c0-815d452cb701-kube-api-access-spmg8\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz\" (UID: \"e8af5bdb-cf19-4210-85c0-815d452cb701\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" Oct 30 20:03:31.877162 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877161 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.877422 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877216 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee5e6319-c93c-4713-b99c-9e5660af5192-serving-cert\") pod \"console-operator-7cd56b8dbc-dr852\" (UID: \"ee5e6319-c93c-4713-b99c-9e5660af5192\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:31.877422 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877256 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27e4937d-367a-4ccc-9580-74a3982a49fe-trusted-ca\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.877422 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877286 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/27e4937d-367a-4ccc-9580-74a3982a49fe-installation-pull-secrets\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.877422 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877310 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ac859bf-692b-4447-891a-32541e1e244d-installation-pull-secrets\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.877422 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877372 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq82v\" (UniqueName: \"kubernetes.io/projected/20ba9ea0-10d3-419c-a429-3a6dcf153171-kube-api-access-jq82v\") pod \"service-ca-operator-544d749c8c-5hdqj\" (UID: \"20ba9ea0-10d3-419c-a429-3a6dcf153171\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" Oct 30 20:03:31.877422 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877388 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-default-certificate\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:31.877422 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877402 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/adb774f6-0266-4c60-92e9-f0a5f8ac831e-serving-cert\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:31.877422 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877418 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvqn4\" (UniqueName: \"kubernetes.io/projected/22e3da9c-5201-4bd9-b247-1caaa18f5d7d-kube-api-access-rvqn4\") pod \"ingress-canary-t85sd\" (UID: \"22e3da9c-5201-4bd9-b247-1caaa18f5d7d\") " pod="openshift-ingress-canary/ingress-canary-t85sd" Oct 30 20:03:31.877829 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877434 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee5e6319-c93c-4713-b99c-9e5660af5192-config\") pod \"console-operator-7cd56b8dbc-dr852\" (UID: \"ee5e6319-c93c-4713-b99c-9e5660af5192\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:31.877829 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877509 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjzcw\" (UniqueName: \"kubernetes.io/projected/ee5e6319-c93c-4713-b99c-9e5660af5192-kube-api-access-tjzcw\") pod \"console-operator-7cd56b8dbc-dr852\" (UID: \"ee5e6319-c93c-4713-b99c-9e5660af5192\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:31.877829 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877541 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ac859bf-692b-4447-891a-32541e1e244d-trusted-ca\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.877829 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877579 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/20ba9ea0-10d3-419c-a429-3a6dcf153171-config\") pod \"service-ca-operator-544d749c8c-5hdqj\" (UID: \"20ba9ea0-10d3-419c-a429-3a6dcf153171\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" Oct 30 20:03:31.877829 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877603 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-stats-auth\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:31.877829 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877646 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7f941d6e-cd94-47d5-a641-fb608c05a903-config-volume\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:31.877829 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877681 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnfwb\" (UniqueName: \"kubernetes.io/projected/adb774f6-0266-4c60-92e9-f0a5f8ac831e-kube-api-access-qnfwb\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:31.877829 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877726 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-metrics-certs\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:31.877829 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877752 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22e3da9c-5201-4bd9-b247-1caaa18f5d7d-cert\") pod \"ingress-canary-t85sd\" (UID: \"22e3da9c-5201-4bd9-b247-1caaa18f5d7d\") " pod="openshift-ingress-canary/ingress-canary-t85sd" Oct 30 20:03:31.877829 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877798 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ac859bf-692b-4447-891a-32541e1e244d-image-registry-private-configuration\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.877829 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877825 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/27e4937d-367a-4ccc-9580-74a3982a49fe-ca-trust-extracted\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.878141 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877847 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/adb774f6-0266-4c60-92e9-f0a5f8ac831e-snapshots\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:31.878141 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877870 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f941d6e-cd94-47d5-a641-fb608c05a903-metrics-tls\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:31.878141 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.877896 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-bbm2j\" (UID: \"24b57f65-bf27-4659-a922-83a241893696\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:31.889938 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.889909 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfdr6\" (UniqueName: \"kubernetes.io/projected/364408a3-5d56-4e76-9c96-a2a08841b50f-kube-api-access-nfdr6\") pod \"kas-connection-checker-685895c7c9-ffthk\" (UID: \"364408a3-5d56-4e76-9c96-a2a08841b50f\") " pod="kube-system/kas-connection-checker-685895c7c9-ffthk" Oct 30 20:03:31.890060 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.889910 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nkhw\" (UniqueName: \"kubernetes.io/projected/93a3069b-7891-4146-a085-7b218eeff695-kube-api-access-2nkhw\") pod \"kas-connection-checker-685895c7c9-4zrr5\" (UID: \"93a3069b-7891-4146-a085-7b218eeff695\") " pod="kube-system/kas-connection-checker-685895c7c9-4zrr5" Oct 30 20:03:31.890060 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.889970 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2cpl\" (UniqueName: \"kubernetes.io/projected/a7d2c4e7-accb-4388-97c7-62c0b40ebb4c-kube-api-access-r2cpl\") pod \"kas-connection-checker-685895c7c9-xh8v8\" (UID: \"a7d2c4e7-accb-4388-97c7-62c0b40ebb4c\") " pod="kube-system/kas-connection-checker-685895c7c9-xh8v8" Oct 30 20:03:31.978247 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.978215 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20ba9ea0-10d3-419c-a429-3a6dcf153171-serving-cert\") pod \"service-ca-operator-544d749c8c-5hdqj\" (UID: \"20ba9ea0-10d3-419c-a429-3a6dcf153171\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" Oct 30 20:03:31.978247 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.978249 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb7sg\" (UniqueName: \"kubernetes.io/projected/7f941d6e-cd94-47d5-a641-fb608c05a903-kube-api-access-bb7sg\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:31.978247 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.978267 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jb98m\" (UID: \"28ba2930-e73c-4716-b061-d7cb2bbd0400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:31.978618 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.978285 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/24b57f65-bf27-4659-a922-83a241893696-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-bbm2j\" (UID: \"24b57f65-bf27-4659-a922-83a241893696\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:31.978618 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.978302 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ac859bf-692b-4447-891a-32541e1e244d-ca-trust-extracted\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.978618 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.978320 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-certificates\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.978618 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.978355 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee5e6319-c93c-4713-b99c-9e5660af5192-trusted-ca\") pod \"console-operator-7cd56b8dbc-dr852\" (UID: \"ee5e6319-c93c-4713-b99c-9e5660af5192\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:31.978618 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:31.978423 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 20:03:31.978618 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.978468 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8af5bdb-cf19-4210-85c0-815d452cb701-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz\" (UID: \"e8af5bdb-cf19-4210-85c0-815d452cb701\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" Oct 30 20:03:31.978618 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:31.978504 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-tls podName:28ba2930-e73c-4716-b061-d7cb2bbd0400 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:32.478484219 +0000 UTC m=+31.157766475 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-jb98m" (UID: "28ba2930-e73c-4716-b061-d7cb2bbd0400") : secret "samples-operator-tls" not found Oct 30 20:03:31.978998 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.978655 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-bound-sa-token\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.978998 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.978693 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzghk\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-kube-api-access-qzghk\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.978998 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.978720 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b644\" (UniqueName: \"kubernetes.io/projected/24b57f65-bf27-4659-a922-83a241893696-kube-api-access-4b644\") pod \"cluster-monitoring-operator-884576c57-bbm2j\" (UID: \"24b57f65-bf27-4659-a922-83a241893696\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:31.978998 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.978765 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adb774f6-0266-4c60-92e9-f0a5f8ac831e-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:31.978998 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.978801 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:31.978998 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.978827 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-jb98m\" (UID: \"28ba2930-e73c-4716-b061-d7cb2bbd0400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:31.978998 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.978851 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ac859bf-692b-4447-891a-32541e1e244d-registry-certificates\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.978998 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.978878 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adb774f6-0266-4c60-92e9-f0a5f8ac831e-tmp\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:31.978998 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.978906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44fgw\" (UniqueName: \"kubernetes.io/projected/f5dddacb-f3d8-43cc-9191-c9f63e56db20-kube-api-access-44fgw\") pod \"volume-data-source-validator-58c9f5f46d-s4s25\" (UID: \"f5dddacb-f3d8-43cc-9191-c9f63e56db20\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-s4s25" Oct 30 20:03:31.978998 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.978931 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8af5bdb-cf19-4210-85c0-815d452cb701-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz\" (UID: \"e8af5bdb-cf19-4210-85c0-815d452cb701\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" Oct 30 20:03:31.978998 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.978957 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jncv5\" (UniqueName: \"kubernetes.io/projected/28ba2930-e73c-4716-b061-d7cb2bbd0400-kube-api-access-jncv5\") pod \"cluster-samples-operator-6ddb6c8b94-jb98m\" (UID: \"28ba2930-e73c-4716-b061-d7cb2bbd0400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:31.978998 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.978984 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/27e4937d-367a-4ccc-9580-74a3982a49fe-image-registry-private-configuration\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.979570 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.979013 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.979570 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.979038 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f941d6e-cd94-47d5-a641-fb608c05a903-tmp-dir\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:31.979570 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.979068 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlxdg\" (UniqueName: \"kubernetes.io/projected/2e5941e6-4fc9-4353-a518-8ad492e9ad61-kube-api-access-jlxdg\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:31.979570 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.979093 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsbbs\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-kube-api-access-fsbbs\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.979570 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.979135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmj4v\" (UniqueName: \"kubernetes.io/projected/fbfa2cf8-ef21-4485-91f3-6ca0b0b0d55d-kube-api-access-tmj4v\") pod \"network-check-source-6f78d59f99-sb9tl\" (UID: \"fbfa2cf8-ef21-4485-91f3-6ca0b0b0d55d\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-sb9tl" Oct 30 20:03:31.979570 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.979157 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-bound-sa-token\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.979570 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.979181 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spmg8\" (UniqueName: \"kubernetes.io/projected/e8af5bdb-cf19-4210-85c0-815d452cb701-kube-api-access-spmg8\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz\" (UID: \"e8af5bdb-cf19-4210-85c0-815d452cb701\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" Oct 30 20:03:31.979570 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.979186 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/24b57f65-bf27-4659-a922-83a241893696-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-bbm2j\" (UID: \"24b57f65-bf27-4659-a922-83a241893696\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:31.979570 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.979206 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.979570 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.979269 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee5e6319-c93c-4713-b99c-9e5660af5192-serving-cert\") pod \"console-operator-7cd56b8dbc-dr852\" (UID: \"ee5e6319-c93c-4713-b99c-9e5660af5192\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:31.979570 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:31.979288 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 20:03:31.979570 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:31.979303 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c856df5f-jdst9: secret "image-registry-tls" not found Oct 30 20:03:31.979570 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:31.979380 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls podName:4ac859bf-692b-4447-891a-32541e1e244d nodeName:}" failed. No retries permitted until 2026-10-30 20:03:32.479363936 +0000 UTC m=+31.158646162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls") pod "image-registry-75c856df5f-jdst9" (UID: "4ac859bf-692b-4447-891a-32541e1e244d") : secret "image-registry-tls" not found Oct 30 20:03:31.979570 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.978800 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ac859bf-692b-4447-891a-32541e1e244d-ca-trust-extracted\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.979570 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:31.979583 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle podName:2e5941e6-4fc9-4353-a518-8ad492e9ad61 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:32.479562882 +0000 UTC m=+31.158845129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle") pod "router-default-7f94f8f65c-dqcj8" (UID: "2e5941e6-4fc9-4353-a518-8ad492e9ad61") : configmap references non-existent config key: service-ca.crt Oct 30 20:03:31.980282 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.979947 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-certificates\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.980282 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980085 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ac859bf-692b-4447-891a-32541e1e244d-registry-certificates\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.980282 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980125 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8af5bdb-cf19-4210-85c0-815d452cb701-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz\" (UID: \"e8af5bdb-cf19-4210-85c0-815d452cb701\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" Oct 30 20:03:31.980282 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980272 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adb774f6-0266-4c60-92e9-f0a5f8ac831e-tmp\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:31.980556 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980299 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27e4937d-367a-4ccc-9580-74a3982a49fe-trusted-ca\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.980556 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:31.980355 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 20:03:31.980556 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:31.980370 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8586cfd6bb-wzm9m: secret "image-registry-tls" not found Oct 30 20:03:31.980556 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980384 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adb774f6-0266-4c60-92e9-f0a5f8ac831e-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:31.980556 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:31.980427 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls podName:27e4937d-367a-4ccc-9580-74a3982a49fe nodeName:}" failed. No retries permitted until 2026-10-30 20:03:32.480413027 +0000 UTC m=+31.159695276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls") pod "image-registry-8586cfd6bb-wzm9m" (UID: "27e4937d-367a-4ccc-9580-74a3982a49fe") : secret "image-registry-tls" not found Oct 30 20:03:31.980556 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.979300 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27e4937d-367a-4ccc-9580-74a3982a49fe-trusted-ca\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.980556 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980517 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/27e4937d-367a-4ccc-9580-74a3982a49fe-installation-pull-secrets\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.980556 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ac859bf-692b-4447-891a-32541e1e244d-installation-pull-secrets\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.980980 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980592 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq82v\" (UniqueName: \"kubernetes.io/projected/20ba9ea0-10d3-419c-a429-3a6dcf153171-kube-api-access-jq82v\") pod \"service-ca-operator-544d749c8c-5hdqj\" (UID: \"20ba9ea0-10d3-419c-a429-3a6dcf153171\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" Oct 30 20:03:31.980980 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980618 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-default-certificate\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:31.980980 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/adb774f6-0266-4c60-92e9-f0a5f8ac831e-serving-cert\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:31.980980 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvqn4\" (UniqueName: \"kubernetes.io/projected/22e3da9c-5201-4bd9-b247-1caaa18f5d7d-kube-api-access-rvqn4\") pod \"ingress-canary-t85sd\" (UID: \"22e3da9c-5201-4bd9-b247-1caaa18f5d7d\") " pod="openshift-ingress-canary/ingress-canary-t85sd" Oct 30 20:03:31.980980 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980674 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f941d6e-cd94-47d5-a641-fb608c05a903-tmp-dir\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:31.980980 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980698 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee5e6319-c93c-4713-b99c-9e5660af5192-config\") pod \"console-operator-7cd56b8dbc-dr852\" (UID: \"ee5e6319-c93c-4713-b99c-9e5660af5192\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:31.980980 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjzcw\" (UniqueName: \"kubernetes.io/projected/ee5e6319-c93c-4713-b99c-9e5660af5192-kube-api-access-tjzcw\") pod \"console-operator-7cd56b8dbc-dr852\" (UID: \"ee5e6319-c93c-4713-b99c-9e5660af5192\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:31.980980 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ac859bf-692b-4447-891a-32541e1e244d-trusted-ca\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.980980 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980788 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/20ba9ea0-10d3-419c-a429-3a6dcf153171-config\") pod \"service-ca-operator-544d749c8c-5hdqj\" (UID: \"20ba9ea0-10d3-419c-a429-3a6dcf153171\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" Oct 30 20:03:31.980980 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980815 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-stats-auth\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:31.980980 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980840 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7f941d6e-cd94-47d5-a641-fb608c05a903-config-volume\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:31.980980 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980871 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnfwb\" (UniqueName: \"kubernetes.io/projected/adb774f6-0266-4c60-92e9-f0a5f8ac831e-kube-api-access-qnfwb\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:31.980980 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980904 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-metrics-certs\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:31.980980 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22e3da9c-5201-4bd9-b247-1caaa18f5d7d-cert\") pod \"ingress-canary-t85sd\" (UID: \"22e3da9c-5201-4bd9-b247-1caaa18f5d7d\") " pod="openshift-ingress-canary/ingress-canary-t85sd" Oct 30 20:03:31.980980 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980970 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ac859bf-692b-4447-891a-32541e1e244d-image-registry-private-configuration\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.981791 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.980996 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/27e4937d-367a-4ccc-9580-74a3982a49fe-ca-trust-extracted\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.981791 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.981021 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/adb774f6-0266-4c60-92e9-f0a5f8ac831e-snapshots\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:31.981791 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.981044 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f941d6e-cd94-47d5-a641-fb608c05a903-metrics-tls\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:31.981791 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.981070 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-bbm2j\" (UID: \"24b57f65-bf27-4659-a922-83a241893696\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:31.981791 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.981122 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adb774f6-0266-4c60-92e9-f0a5f8ac831e-service-ca-bundle\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:31.981791 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.981685 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-jb98m\" (UID: \"28ba2930-e73c-4716-b061-d7cb2bbd0400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:31.981791 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.981698 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adb774f6-0266-4c60-92e9-f0a5f8ac831e-service-ca-bundle\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:31.982129 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.981991 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20ba9ea0-10d3-419c-a429-3a6dcf153171-serving-cert\") pod \"service-ca-operator-544d749c8c-5hdqj\" (UID: \"20ba9ea0-10d3-419c-a429-3a6dcf153171\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" Oct 30 20:03:31.982181 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.982154 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee5e6319-c93c-4713-b99c-9e5660af5192-trusted-ca\") pod \"console-operator-7cd56b8dbc-dr852\" (UID: \"ee5e6319-c93c-4713-b99c-9e5660af5192\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:31.982236 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.982190 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8af5bdb-cf19-4210-85c0-815d452cb701-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz\" (UID: \"e8af5bdb-cf19-4210-85c0-815d452cb701\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" Oct 30 20:03:31.982376 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:31.982357 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 20:03:31.982447 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:31.982415 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f941d6e-cd94-47d5-a641-fb608c05a903-metrics-tls podName:7f941d6e-cd94-47d5-a641-fb608c05a903 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:32.482402698 +0000 UTC m=+31.161684924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f941d6e-cd94-47d5-a641-fb608c05a903-metrics-tls") pod "dns-default-hd99r" (UID: "7f941d6e-cd94-47d5-a641-fb608c05a903") : secret "dns-default-metrics-tls" not found Oct 30 20:03:31.982512 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:31.982473 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 20:03:31.982563 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:31.982511 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls podName:24b57f65-bf27-4659-a922-83a241893696 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:32.482498406 +0000 UTC m=+31.161780637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-bbm2j" (UID: "24b57f65-bf27-4659-a922-83a241893696") : secret "cluster-monitoring-operator-tls" not found Oct 30 20:03:31.982782 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.982757 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/adb774f6-0266-4c60-92e9-f0a5f8ac831e-snapshots\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:31.983046 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.983020 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee5e6319-c93c-4713-b99c-9e5660af5192-config\") pod \"console-operator-7cd56b8dbc-dr852\" (UID: \"ee5e6319-c93c-4713-b99c-9e5660af5192\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:31.983509 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.983482 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7f941d6e-cd94-47d5-a641-fb608c05a903-config-volume\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:31.983679 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.983656 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/20ba9ea0-10d3-419c-a429-3a6dcf153171-config\") pod \"service-ca-operator-544d749c8c-5hdqj\" (UID: \"20ba9ea0-10d3-419c-a429-3a6dcf153171\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" Oct 30 20:03:31.983798 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.983731 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/27e4937d-367a-4ccc-9580-74a3982a49fe-image-registry-private-configuration\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.983889 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:31.983762 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 20:03:31.983999 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:31.983989 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-metrics-certs podName:2e5941e6-4fc9-4353-a518-8ad492e9ad61 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:32.48397276 +0000 UTC m=+31.163255004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-metrics-certs") pod "router-default-7f94f8f65c-dqcj8" (UID: "2e5941e6-4fc9-4353-a518-8ad492e9ad61") : secret "router-metrics-certs-default" not found Oct 30 20:03:31.984169 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.984146 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/27e4937d-367a-4ccc-9580-74a3982a49fe-ca-trust-extracted\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.984498 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.984478 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ac859bf-692b-4447-891a-32541e1e244d-trusted-ca\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.984994 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.984971 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee5e6319-c93c-4713-b99c-9e5660af5192-serving-cert\") pod \"console-operator-7cd56b8dbc-dr852\" (UID: \"ee5e6319-c93c-4713-b99c-9e5660af5192\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:31.985129 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.985111 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-stats-auth\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:31.985358 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.985323 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ac859bf-692b-4447-891a-32541e1e244d-installation-pull-secrets\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.985525 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.985502 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/27e4937d-367a-4ccc-9580-74a3982a49fe-installation-pull-secrets\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.986171 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.986150 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-default-certificate\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:31.986171 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.986165 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/adb774f6-0266-4c60-92e9-f0a5f8ac831e-serving-cert\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:31.986551 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.986525 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22e3da9c-5201-4bd9-b247-1caaa18f5d7d-cert\") pod \"ingress-canary-t85sd\" (UID: \"22e3da9c-5201-4bd9-b247-1caaa18f5d7d\") " pod="openshift-ingress-canary/ingress-canary-t85sd" Oct 30 20:03:31.986974 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.986953 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ac859bf-692b-4447-891a-32541e1e244d-image-registry-private-configuration\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:31.993597 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.993567 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-bound-sa-token\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.993733 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.993604 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzghk\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-kube-api-access-qzghk\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:31.993979 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.993955 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb7sg\" (UniqueName: \"kubernetes.io/projected/7f941d6e-cd94-47d5-a641-fb608c05a903-kube-api-access-bb7sg\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:31.996324 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.996201 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44fgw\" (UniqueName: \"kubernetes.io/projected/f5dddacb-f3d8-43cc-9191-c9f63e56db20-kube-api-access-44fgw\") pod \"volume-data-source-validator-58c9f5f46d-s4s25\" (UID: \"f5dddacb-f3d8-43cc-9191-c9f63e56db20\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-s4s25" Oct 30 20:03:31.996435 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.996387 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq82v\" (UniqueName: \"kubernetes.io/projected/20ba9ea0-10d3-419c-a429-3a6dcf153171-kube-api-access-jq82v\") pod \"service-ca-operator-544d749c8c-5hdqj\" (UID: \"20ba9ea0-10d3-419c-a429-3a6dcf153171\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" Oct 30 20:03:31.996588 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.996564 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b644\" (UniqueName: \"kubernetes.io/projected/24b57f65-bf27-4659-a922-83a241893696-kube-api-access-4b644\") pod \"cluster-monitoring-operator-884576c57-bbm2j\" (UID: \"24b57f65-bf27-4659-a922-83a241893696\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:31.996809 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.996774 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnfwb\" (UniqueName: \"kubernetes.io/projected/adb774f6-0266-4c60-92e9-f0a5f8ac831e-kube-api-access-qnfwb\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:31.997806 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.997493 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jncv5\" (UniqueName: \"kubernetes.io/projected/28ba2930-e73c-4716-b061-d7cb2bbd0400-kube-api-access-jncv5\") pod \"cluster-samples-operator-6ddb6c8b94-jb98m\" (UID: \"28ba2930-e73c-4716-b061-d7cb2bbd0400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:31.999968 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:31.999945 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvpxr_caeeb8a7-4283-4c38-b3be-c036eeeceb65/konnectivity-agent/0.log" limit=1024 Oct 30 20:03:32.000170 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.000150 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsbbs\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-kube-api-access-fsbbs\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:32.000320 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.000301 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-bound-sa-token\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:32.000713 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.000695 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvqn4\" (UniqueName: \"kubernetes.io/projected/22e3da9c-5201-4bd9-b247-1caaa18f5d7d-kube-api-access-rvqn4\") pod \"ingress-canary-t85sd\" (UID: \"22e3da9c-5201-4bd9-b247-1caaa18f5d7d\") " pod="openshift-ingress-canary/ingress-canary-t85sd" Oct 30 20:03:32.001967 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.001945 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlxdg\" (UniqueName: \"kubernetes.io/projected/2e5941e6-4fc9-4353-a518-8ad492e9ad61-kube-api-access-jlxdg\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:32.002066 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.001954 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmj4v\" (UniqueName: \"kubernetes.io/projected/fbfa2cf8-ef21-4485-91f3-6ca0b0b0d55d-kube-api-access-tmj4v\") pod \"network-check-source-6f78d59f99-sb9tl\" (UID: \"fbfa2cf8-ef21-4485-91f3-6ca0b0b0d55d\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-sb9tl" Oct 30 20:03:32.002605 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.002585 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjzcw\" (UniqueName: \"kubernetes.io/projected/ee5e6319-c93c-4713-b99c-9e5660af5192-kube-api-access-tjzcw\") pod \"console-operator-7cd56b8dbc-dr852\" (UID: \"ee5e6319-c93c-4713-b99c-9e5660af5192\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:32.003091 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.003074 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spmg8\" (UniqueName: \"kubernetes.io/projected/e8af5bdb-cf19-4210-85c0-815d452cb701-kube-api-access-spmg8\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz\" (UID: \"e8af5bdb-cf19-4210-85c0-815d452cb701\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" Oct 30 20:03:32.011713 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.011688 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-xh8v8" Oct 30 20:03:32.022101 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.022079 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-4zrr5" Oct 30 20:03:32.042125 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.042103 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-ffthk" Oct 30 20:03:32.058374 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.058347 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:32.074842 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.074621 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" Oct 30 20:03:32.094185 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.093996 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-s4s25" Oct 30 20:03:32.099206 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.099151 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" Oct 30 20:03:32.112000 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.111976 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:32.118587 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.118403 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-sb9tl" Oct 30 20:03:32.150837 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.150799 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t85sd" Oct 30 20:03:32.313089 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.313058 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-4zrr5"] Oct 30 20:03:32.315647 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.315627 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-xh8v8"] Oct 30 20:03:32.321138 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:32.317530 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93a3069b_7891_4146_a085_7b218eeff695.slice/crio-2c3248e11effa8401bfbdf8863f1f12ee5383c987c4d745a8c7d94b2d45b1de1 WatchSource:0}: Error finding container 2c3248e11effa8401bfbdf8863f1f12ee5383c987c4d745a8c7d94b2d45b1de1: Status 404 returned error can't find the container with id 2c3248e11effa8401bfbdf8863f1f12ee5383c987c4d745a8c7d94b2d45b1de1 Oct 30 20:03:32.376965 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.376841 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-c262w"] Oct 30 20:03:32.380960 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.380315 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-ffthk"] Oct 30 20:03:32.382610 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:32.382576 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb774f6_0266_4c60_92e9_f0a5f8ac831e.slice/crio-249a58cfe615161e0c5f34eef91fcf7ca53cf693debfc4ea4a621880ff4a908a WatchSource:0}: Error finding container 249a58cfe615161e0c5f34eef91fcf7ca53cf693debfc4ea4a621880ff4a908a: Status 404 returned error can't find the container with id 249a58cfe615161e0c5f34eef91fcf7ca53cf693debfc4ea4a621880ff4a908a Oct 30 20:03:32.383155 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:32.383128 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod364408a3_5d56_4e76_9c96_a2a08841b50f.slice/crio-e80e69eb675a654c64413896124bacb23bcf0205a897312c2043ead6ffa7a9ed WatchSource:0}: Error finding container e80e69eb675a654c64413896124bacb23bcf0205a897312c2043ead6ffa7a9ed: Status 404 returned error can't find the container with id e80e69eb675a654c64413896124bacb23bcf0205a897312c2043ead6ffa7a9ed Oct 30 20:03:32.389503 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.389171 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae25b031-7ac9-4041-bc3a-7a6679eab74d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-gksz8\" (UID: \"ae25b031-7ac9-4041-bc3a-7a6679eab74d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-gksz8" Oct 30 20:03:32.389503 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:32.389413 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 20:03:32.389503 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:32.389473 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae25b031-7ac9-4041-bc3a-7a6679eab74d-networking-console-plugin-cert podName:ae25b031-7ac9-4041-bc3a-7a6679eab74d nodeName:}" failed. No retries permitted until 2026-10-30 20:03:33.389453746 +0000 UTC m=+32.068735992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae25b031-7ac9-4041-bc3a-7a6679eab74d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-gksz8" (UID: "ae25b031-7ac9-4041-bc3a-7a6679eab74d") : secret "networking-console-plugin-cert" not found Oct 30 20:03:32.437244 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.437207 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz"] Oct 30 20:03:32.439435 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.439324 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj"] Oct 30 20:03:32.477760 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.477725 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-sb9tl"] Oct 30 20:03:32.479167 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.479135 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-s4s25"] Oct 30 20:03:32.479419 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:32.479394 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ba9ea0_10d3_419c_a429_3a6dcf153171.slice/crio-fa10fbaba8687e9e16c8165832a2ff5da4e11ed632cdf6bc45f673d551dcef99 WatchSource:0}: Error finding container fa10fbaba8687e9e16c8165832a2ff5da4e11ed632cdf6bc45f673d551dcef99: Status 404 returned error can't find the container with id fa10fbaba8687e9e16c8165832a2ff5da4e11ed632cdf6bc45f673d551dcef99 Oct 30 20:03:32.487481 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:32.487198 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbfa2cf8_ef21_4485_91f3_6ca0b0b0d55d.slice/crio-8a43513eaeac2f133ea80b861ce261ab15b0c07dae379980f8584d800fe8b123 WatchSource:0}: Error finding container 8a43513eaeac2f133ea80b861ce261ab15b0c07dae379980f8584d800fe8b123: Status 404 returned error can't find the container with id 8a43513eaeac2f133ea80b861ce261ab15b0c07dae379980f8584d800fe8b123 Oct 30 20:03:32.491472 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.489895 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jb98m\" (UID: \"28ba2930-e73c-4716-b061-d7cb2bbd0400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:32.491472 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.489974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:32.491472 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.490002 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:32.491472 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.490037 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:32.491472 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.490109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-metrics-certs\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:32.491472 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.490132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f941d6e-cd94-47d5-a641-fb608c05a903-metrics-tls\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:32.491472 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.490155 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-bbm2j\" (UID: \"24b57f65-bf27-4659-a922-83a241893696\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:32.491472 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:32.490282 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle podName:2e5941e6-4fc9-4353-a518-8ad492e9ad61 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:33.490267222 +0000 UTC m=+32.169549468 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle") pod "router-default-7f94f8f65c-dqcj8" (UID: "2e5941e6-4fc9-4353-a518-8ad492e9ad61") : configmap references non-existent config key: service-ca.crt Oct 30 20:03:32.491472 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:32.490301 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 20:03:32.491472 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:32.490424 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 20:03:32.491472 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:32.490465 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-tls podName:28ba2930-e73c-4716-b061-d7cb2bbd0400 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:33.490452513 +0000 UTC m=+32.169734757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-jb98m" (UID: "28ba2930-e73c-4716-b061-d7cb2bbd0400") : secret "samples-operator-tls" not found Oct 30 20:03:32.491472 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:32.490517 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 20:03:32.491472 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:32.490546 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls podName:24b57f65-bf27-4659-a922-83a241893696 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:33.49053622 +0000 UTC m=+32.169818470 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-bbm2j" (UID: "24b57f65-bf27-4659-a922-83a241893696") : secret "cluster-monitoring-operator-tls" not found Oct 30 20:03:32.491472 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:32.490600 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 20:03:32.491472 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:32.490611 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8586cfd6bb-wzm9m: secret "image-registry-tls" not found Oct 30 20:03:32.491472 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:32.490637 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls podName:27e4937d-367a-4ccc-9580-74a3982a49fe nodeName:}" failed. No retries permitted until 2026-10-30 20:03:33.49062896 +0000 UTC m=+32.169911231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls") pod "image-registry-8586cfd6bb-wzm9m" (UID: "27e4937d-367a-4ccc-9580-74a3982a49fe") : secret "image-registry-tls" not found Oct 30 20:03:32.491943 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:32.490689 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 20:03:32.491943 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:32.490697 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c856df5f-jdst9: secret "image-registry-tls" not found Oct 30 20:03:32.491943 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:32.490721 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls podName:4ac859bf-692b-4447-891a-32541e1e244d nodeName:}" failed. No retries permitted until 2026-10-30 20:03:33.490712851 +0000 UTC m=+32.169995119 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls") pod "image-registry-75c856df5f-jdst9" (UID: "4ac859bf-692b-4447-891a-32541e1e244d") : secret "image-registry-tls" not found Oct 30 20:03:32.491943 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:32.490775 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 20:03:32.491943 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:32.490799 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f941d6e-cd94-47d5-a641-fb608c05a903-metrics-tls podName:7f941d6e-cd94-47d5-a641-fb608c05a903 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:33.490790983 +0000 UTC m=+32.170073263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f941d6e-cd94-47d5-a641-fb608c05a903-metrics-tls") pod "dns-default-hd99r" (UID: "7f941d6e-cd94-47d5-a641-fb608c05a903") : secret "dns-default-metrics-tls" not found Oct 30 20:03:32.491943 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:32.490969 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-metrics-certs podName:2e5941e6-4fc9-4353-a518-8ad492e9ad61 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:33.490954194 +0000 UTC m=+32.170236434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-metrics-certs") pod "router-default-7f94f8f65c-dqcj8" (UID: "2e5941e6-4fc9-4353-a518-8ad492e9ad61") : secret "router-metrics-certs-default" not found Oct 30 20:03:32.502488 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.502417 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-dr852"] Oct 30 20:03:32.516523 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.516496 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t85sd"] Oct 30 20:03:32.816728 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.816698 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:32.817114 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.816698 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:32.825556 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.825531 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 20:03:32.825556 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.825555 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-9mzsl\"" Oct 30 20:03:32.825749 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:32.825618 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-qkmrx\"" Oct 30 20:03:33.064084 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.064042 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-s4s25" event={"ID":"f5dddacb-f3d8-43cc-9191-c9f63e56db20","Type":"ContainerStarted","Data":"92c970e1df14ad98487d0f35ec59d224f4d8209c6e3bd748910a3aef9d2804b8"} Oct 30 20:03:33.065663 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.065635 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-4zrr5" event={"ID":"93a3069b-7891-4146-a085-7b218eeff695","Type":"ContainerStarted","Data":"c94a61706d4db4b277473a7197ae1a18dc4e5f60f9e2cdb5ddf42ec930cf7fc6"} Oct 30 20:03:33.065811 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.065685 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-4zrr5" event={"ID":"93a3069b-7891-4146-a085-7b218eeff695","Type":"ContainerStarted","Data":"2c3248e11effa8401bfbdf8863f1f12ee5383c987c4d745a8c7d94b2d45b1de1"} Oct 30 20:03:33.066925 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.066863 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-sb9tl" event={"ID":"fbfa2cf8-ef21-4485-91f3-6ca0b0b0d55d","Type":"ContainerStarted","Data":"8a43513eaeac2f133ea80b861ce261ab15b0c07dae379980f8584d800fe8b123"} Oct 30 20:03:33.068104 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.068081 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" event={"ID":"20ba9ea0-10d3-419c-a429-3a6dcf153171","Type":"ContainerStarted","Data":"fa10fbaba8687e9e16c8165832a2ff5da4e11ed632cdf6bc45f673d551dcef99"} Oct 30 20:03:33.069562 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.069537 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-ffthk" event={"ID":"364408a3-5d56-4e76-9c96-a2a08841b50f","Type":"ContainerStarted","Data":"3a3661145f165ad723140cac1ab944ec92cda5b85d8bbe5f38954028bbaea4c4"} Oct 30 20:03:33.069690 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.069579 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-ffthk" event={"ID":"364408a3-5d56-4e76-9c96-a2a08841b50f","Type":"ContainerStarted","Data":"e80e69eb675a654c64413896124bacb23bcf0205a897312c2043ead6ffa7a9ed"} Oct 30 20:03:33.071108 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.071083 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-xh8v8" event={"ID":"a7d2c4e7-accb-4388-97c7-62c0b40ebb4c","Type":"ContainerStarted","Data":"ebff944b25e1d1874abd748d72a180124f0cd3c62ec01bb1035a2b4db1cc276d"} Oct 30 20:03:33.071218 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.071124 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-xh8v8" event={"ID":"a7d2c4e7-accb-4388-97c7-62c0b40ebb4c","Type":"ContainerStarted","Data":"a959734ab7f3bd0f5152b51b0ad36a121822ce27595256ce13ae777f35afd792"} Oct 30 20:03:33.072341 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.072308 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t85sd" event={"ID":"22e3da9c-5201-4bd9-b247-1caaa18f5d7d","Type":"ContainerStarted","Data":"e16a56a652f650f0e5f57b669d048e0b9d275ecb8e983bac9dcd4921c35dca0f"} Oct 30 20:03:33.073477 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.073452 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" event={"ID":"ee5e6319-c93c-4713-b99c-9e5660af5192","Type":"ContainerStarted","Data":"aa907cc6d48f34d4ca30164a69e2fa072c65fd20df45e04823ae90262e667889"} Oct 30 20:03:33.074536 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.074508 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" event={"ID":"e8af5bdb-cf19-4210-85c0-815d452cb701","Type":"ContainerStarted","Data":"893a1bf6e8d077f2fb6f9e55470d5d3efc7a40dd8bd63f290c476b4b0e0d3742"} Oct 30 20:03:33.075597 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.075576 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-c262w" event={"ID":"adb774f6-0266-4c60-92e9-f0a5f8ac831e","Type":"ContainerStarted","Data":"249a58cfe615161e0c5f34eef91fcf7ca53cf693debfc4ea4a621880ff4a908a"} Oct 30 20:03:33.086619 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.086578 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-4zrr5" podStartSLOduration=303.086564672 podStartE2EDuration="5m3.086564672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:58:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:33.085221427 +0000 UTC m=+31.764503694" watchObservedRunningTime="2026-10-30 20:03:33.086564672 +0000 UTC m=+31.765846921" Oct 30 20:03:33.105097 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.105038 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-xh8v8" podStartSLOduration=303.105025047 podStartE2EDuration="5m3.105025047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:58:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:33.104501892 +0000 UTC m=+31.783784154" watchObservedRunningTime="2026-10-30 20:03:33.105025047 +0000 UTC m=+31.784307296" Oct 30 20:03:33.125266 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.125216 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-ffthk" podStartSLOduration=303.125201132 podStartE2EDuration="5m3.125201132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:58:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:33.123828856 +0000 UTC m=+31.803111112" watchObservedRunningTime="2026-10-30 20:03:33.125201132 +0000 UTC m=+31.804483377" Oct 30 20:03:33.397898 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.397811 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae25b031-7ac9-4041-bc3a-7a6679eab74d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-gksz8\" (UID: \"ae25b031-7ac9-4041-bc3a-7a6679eab74d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-gksz8" Oct 30 20:03:33.398056 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:33.398001 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 20:03:33.398056 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:33.398052 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae25b031-7ac9-4041-bc3a-7a6679eab74d-networking-console-plugin-cert podName:ae25b031-7ac9-4041-bc3a-7a6679eab74d nodeName:}" failed. No retries permitted until 2026-10-30 20:03:35.398040166 +0000 UTC m=+34.077322406 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae25b031-7ac9-4041-bc3a-7a6679eab74d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-gksz8" (UID: "ae25b031-7ac9-4041-bc3a-7a6679eab74d") : secret "networking-console-plugin-cert" not found Oct 30 20:03:33.499044 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.498959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:33.499044 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.499036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:33.499569 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.499086 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-metrics-certs\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:33.499569 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.499174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f941d6e-cd94-47d5-a641-fb608c05a903-metrics-tls\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:33.499569 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.499202 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-bbm2j\" (UID: \"24b57f65-bf27-4659-a922-83a241893696\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:33.499569 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.499294 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jb98m\" (UID: \"28ba2930-e73c-4716-b061-d7cb2bbd0400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:33.499569 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:33.499367 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:33.499569 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:33.499511 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle podName:2e5941e6-4fc9-4353-a518-8ad492e9ad61 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:35.499496359 +0000 UTC m=+34.178778599 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle") pod "router-default-7f94f8f65c-dqcj8" (UID: "2e5941e6-4fc9-4353-a518-8ad492e9ad61") : configmap references non-existent config key: service-ca.crt Oct 30 20:03:33.500660 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:33.499931 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 20:03:33.500660 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:33.499948 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8586cfd6bb-wzm9m: secret "image-registry-tls" not found Oct 30 20:03:33.500660 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:33.499994 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls podName:27e4937d-367a-4ccc-9580-74a3982a49fe nodeName:}" failed. No retries permitted until 2026-10-30 20:03:35.499978958 +0000 UTC m=+34.179261199 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls") pod "image-registry-8586cfd6bb-wzm9m" (UID: "27e4937d-367a-4ccc-9580-74a3982a49fe") : secret "image-registry-tls" not found Oct 30 20:03:33.500660 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:33.500052 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 20:03:33.500660 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:33.500061 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c856df5f-jdst9: secret "image-registry-tls" not found Oct 30 20:03:33.500660 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:33.500089 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls podName:4ac859bf-692b-4447-891a-32541e1e244d nodeName:}" failed. No retries permitted until 2026-10-30 20:03:35.500079926 +0000 UTC m=+34.179362168 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls") pod "image-registry-75c856df5f-jdst9" (UID: "4ac859bf-692b-4447-891a-32541e1e244d") : secret "image-registry-tls" not found Oct 30 20:03:33.500660 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:33.500143 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 20:03:33.500660 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:33.500195 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-metrics-certs podName:2e5941e6-4fc9-4353-a518-8ad492e9ad61 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:35.500178927 +0000 UTC m=+34.179461170 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-metrics-certs") pod "router-default-7f94f8f65c-dqcj8" (UID: "2e5941e6-4fc9-4353-a518-8ad492e9ad61") : secret "router-metrics-certs-default" not found Oct 30 20:03:33.500660 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:33.500250 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 20:03:33.500660 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:33.500283 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f941d6e-cd94-47d5-a641-fb608c05a903-metrics-tls podName:7f941d6e-cd94-47d5-a641-fb608c05a903 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:35.500274389 +0000 UTC m=+34.179556631 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f941d6e-cd94-47d5-a641-fb608c05a903-metrics-tls") pod "dns-default-hd99r" (UID: "7f941d6e-cd94-47d5-a641-fb608c05a903") : secret "dns-default-metrics-tls" not found Oct 30 20:03:33.500660 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:33.500350 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 20:03:33.500660 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:33.500373 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls podName:24b57f65-bf27-4659-a922-83a241893696 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:35.500367151 +0000 UTC m=+34.179649391 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-bbm2j" (UID: "24b57f65-bf27-4659-a922-83a241893696") : secret "cluster-monitoring-operator-tls" not found Oct 30 20:03:33.500660 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:33.500427 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 20:03:33.500660 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:33.500457 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-tls podName:28ba2930-e73c-4716-b061-d7cb2bbd0400 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:35.500448111 +0000 UTC m=+34.179730351 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-jb98m" (UID: "28ba2930-e73c-4716-b061-d7cb2bbd0400") : secret "samples-operator-tls" not found Oct 30 20:03:34.518296 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:34.518257 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvpxr_caeeb8a7-4283-4c38-b3be-c036eeeceb65/konnectivity-agent/0.log" limit=1024 Oct 30 20:03:34.639994 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:34.639919 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvpxr_caeeb8a7-4283-4c38-b3be-c036eeeceb65/konnectivity-agent/0.log" limit=1024 Oct 30 20:03:35.082971 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:35.082933 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-s4s25" event={"ID":"f5dddacb-f3d8-43cc-9191-c9f63e56db20","Type":"ContainerStarted","Data":"d7f2653d94b4acc8a462373eb42bcb8099113aa977420a3558a35028d2187d28"} Oct 30 20:03:35.285153 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:35.285070 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvpxr_caeeb8a7-4283-4c38-b3be-c036eeeceb65/konnectivity-agent/0.log" limit=1024 Oct 30 20:03:35.381383 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:35.381280 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvpxr_caeeb8a7-4283-4c38-b3be-c036eeeceb65/konnectivity-agent/0.log" limit=1024 Oct 30 20:03:35.420251 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:35.420119 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae25b031-7ac9-4041-bc3a-7a6679eab74d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-gksz8\" (UID: \"ae25b031-7ac9-4041-bc3a-7a6679eab74d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-gksz8" Oct 30 20:03:35.420450 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:35.420284 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 20:03:35.420450 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:35.420381 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae25b031-7ac9-4041-bc3a-7a6679eab74d-networking-console-plugin-cert podName:ae25b031-7ac9-4041-bc3a-7a6679eab74d nodeName:}" failed. No retries permitted until 2026-10-30 20:03:39.420358989 +0000 UTC m=+38.099641235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae25b031-7ac9-4041-bc3a-7a6679eab74d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-gksz8" (UID: "ae25b031-7ac9-4041-bc3a-7a6679eab74d") : secret "networking-console-plugin-cert" not found Oct 30 20:03:35.521106 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:35.521063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:35.521622 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:35.521148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-metrics-certs\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:35.521622 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:35.521177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f941d6e-cd94-47d5-a641-fb608c05a903-metrics-tls\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:35.521622 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:35.521213 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-bbm2j\" (UID: \"24b57f65-bf27-4659-a922-83a241893696\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:35.521622 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:35.521282 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jb98m\" (UID: \"28ba2930-e73c-4716-b061-d7cb2bbd0400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:35.521622 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:35.521357 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:35.521622 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:35.521393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:35.521622 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:35.521527 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 20:03:35.521622 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:35.521542 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8586cfd6bb-wzm9m: secret "image-registry-tls" not found Oct 30 20:03:35.521622 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:35.521601 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls podName:27e4937d-367a-4ccc-9580-74a3982a49fe nodeName:}" failed. No retries permitted until 2026-10-30 20:03:39.521581717 +0000 UTC m=+38.200863960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls") pod "image-registry-8586cfd6bb-wzm9m" (UID: "27e4937d-367a-4ccc-9580-74a3982a49fe") : secret "image-registry-tls" not found Oct 30 20:03:35.522115 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:35.522002 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 20:03:35.522115 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:35.522018 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c856df5f-jdst9: secret "image-registry-tls" not found Oct 30 20:03:35.522115 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:35.522060 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls podName:4ac859bf-692b-4447-891a-32541e1e244d nodeName:}" failed. No retries permitted until 2026-10-30 20:03:39.522046502 +0000 UTC m=+38.201328745 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls") pod "image-registry-75c856df5f-jdst9" (UID: "4ac859bf-692b-4447-891a-32541e1e244d") : secret "image-registry-tls" not found Oct 30 20:03:35.522254 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:35.522122 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 20:03:35.522254 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:35.522153 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-metrics-certs podName:2e5941e6-4fc9-4353-a518-8ad492e9ad61 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:39.52214291 +0000 UTC m=+38.201425152 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-metrics-certs") pod "router-default-7f94f8f65c-dqcj8" (UID: "2e5941e6-4fc9-4353-a518-8ad492e9ad61") : secret "router-metrics-certs-default" not found Oct 30 20:03:35.522254 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:35.522205 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 20:03:35.522254 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:35.522232 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f941d6e-cd94-47d5-a641-fb608c05a903-metrics-tls podName:7f941d6e-cd94-47d5-a641-fb608c05a903 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:39.522223108 +0000 UTC m=+38.201505348 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f941d6e-cd94-47d5-a641-fb608c05a903-metrics-tls") pod "dns-default-hd99r" (UID: "7f941d6e-cd94-47d5-a641-fb608c05a903") : secret "dns-default-metrics-tls" not found Oct 30 20:03:35.522475 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:35.522284 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 20:03:35.522475 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:35.522315 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls podName:24b57f65-bf27-4659-a922-83a241893696 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:39.522305205 +0000 UTC m=+38.201587447 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-bbm2j" (UID: "24b57f65-bf27-4659-a922-83a241893696") : secret "cluster-monitoring-operator-tls" not found Oct 30 20:03:35.522475 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:35.522380 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 20:03:35.522475 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:35.522411 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-tls podName:28ba2930-e73c-4716-b061-d7cb2bbd0400 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:39.522401263 +0000 UTC m=+38.201683507 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-jb98m" (UID: "28ba2930-e73c-4716-b061-d7cb2bbd0400") : secret "samples-operator-tls" not found Oct 30 20:03:35.522475 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:35.522473 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle podName:2e5941e6-4fc9-4353-a518-8ad492e9ad61 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:39.522464161 +0000 UTC m=+38.201746404 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle") pod "router-default-7f94f8f65c-dqcj8" (UID: "2e5941e6-4fc9-4353-a518-8ad492e9ad61") : configmap references non-existent config key: service-ca.crt Oct 30 20:03:35.622565 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:35.622526 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs\") pod \"network-metrics-daemon-698hj\" (UID: \"f69d831c-d9e4-4060-a2bd-9d85265000f6\") " pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:35.622737 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:35.622624 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:35.623258 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:35.623238 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 20:03:35.623343 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:35.623312 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs podName:f69d831c-d9e4-4060-a2bd-9d85265000f6 nodeName:}" failed. No retries permitted until 2026-10-30 20:04:07.623290486 +0000 UTC m=+66.302572732 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs") pod "network-metrics-daemon-698hj" (UID: "f69d831c-d9e4-4060-a2bd-9d85265000f6") : secret "metrics-daemon-secret" not found Oct 30 20:03:35.626909 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:35.626880 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:35.724249 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:35.724207 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnl5q\" (UniqueName: \"kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q\") pod \"network-check-target-l5w4q\" (UID: \"9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e\") " pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:35.728392 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:35.728360 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnl5q\" (UniqueName: \"kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q\") pod \"network-check-target-l5w4q\" (UID: \"9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e\") " pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:35.851102 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:35.851047 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:35.872110 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:35.872082 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:36.158986 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:36.158448 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-s4s25" podStartSLOduration=270.761804054 podStartE2EDuration="4m33.158425828s" totalImagesPullingTime="2.396621774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:35.108516911 +0000 UTC m=+33.787799178" watchObservedRunningTime="2026-10-30 20:03:36.158425828 +0000 UTC m=+34.837708079" Oct 30 20:03:36.158986 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:36.158875 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dw59s"] Oct 30 20:03:36.163606 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:36.163565 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dabf5d4_7787_40b3_b01e_fe430c316887.slice/crio-ff9ae114405803b5e237564cc7ffb19d0dce24272b5bafcd04a660d7da9d173d WatchSource:0}: Error finding container ff9ae114405803b5e237564cc7ffb19d0dce24272b5bafcd04a660d7da9d173d: Status 404 returned error can't find the container with id ff9ae114405803b5e237564cc7ffb19d0dce24272b5bafcd04a660d7da9d173d Oct 30 20:03:36.230779 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:36.230738 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l5w4q"] Oct 30 20:03:36.237468 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:36.237441 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9062fd01_6aa0_4de9_ad7a_63e94ff4fa5e.slice/crio-2a70624f76cbfc8d2726b77b502ef5060ca1b06bd4e5b9b8eb32ec6fa340289d WatchSource:0}: Error finding container 2a70624f76cbfc8d2726b77b502ef5060ca1b06bd4e5b9b8eb32ec6fa340289d: Status 404 returned error can't find the container with id 2a70624f76cbfc8d2726b77b502ef5060ca1b06bd4e5b9b8eb32ec6fa340289d Oct 30 20:03:37.091012 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.090888 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-c262w" event={"ID":"adb774f6-0266-4c60-92e9-f0a5f8ac831e","Type":"ContainerStarted","Data":"356431446b400958ea088de978170341092781b326aab41598fd69f4a628ed08"} Oct 30 20:03:37.092188 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.092160 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dw59s" event={"ID":"9dabf5d4-7787-40b3-b01e-fe430c316887","Type":"ContainerStarted","Data":"ff9ae114405803b5e237564cc7ffb19d0dce24272b5bafcd04a660d7da9d173d"} Oct 30 20:03:37.093371 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.093350 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l5w4q" event={"ID":"9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e","Type":"ContainerStarted","Data":"2a70624f76cbfc8d2726b77b502ef5060ca1b06bd4e5b9b8eb32ec6fa340289d"} Oct 30 20:03:37.113803 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.113749 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-c262w" podStartSLOduration=269.67700414 podStartE2EDuration="4m34.113733595s" totalImagesPullingTime="4.436729455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:37.112709906 +0000 UTC m=+35.791992155" watchObservedRunningTime="2026-10-30 20:03:37.113733595 +0000 UTC m=+35.793015838" Oct 30 20:03:37.657088 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.657052 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-qqhv7-c6vvh"] Oct 30 20:03:37.693453 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.693419 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-js96l"] Oct 30 20:03:37.693815 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.693795 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:37.707340 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.707300 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-qqhv7-c6vvh"] Oct 30 20:03:37.707470 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.707359 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-js96l"] Oct 30 20:03:37.707522 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.707500 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:37.718054 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.714229 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 20:03:37.718389 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.718359 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j5tm5\"" Oct 30 20:03:37.718461 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.718405 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 20:03:37.849490 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.848926 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-data-volume\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:37.849490 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.848972 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgk5m\" (UniqueName: \"kubernetes.io/projected/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-api-access-kgk5m\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:37.849490 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.849027 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:37.849490 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.849070 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:37.849490 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.849109 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/1f847152-ec65-4b3c-bcb6-d8cac177e31d-archives-path\") pod \"periodic-gathering-qqhv7-c6vvh\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:37.849490 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.849192 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-crio-socket\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:37.849490 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.849236 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9px9m\" (UniqueName: \"kubernetes.io/projected/1f847152-ec65-4b3c-bcb6-d8cac177e31d-kube-api-access-9px9m\") pod \"periodic-gathering-qqhv7-c6vvh\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:37.849490 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.849284 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f847152-ec65-4b3c-bcb6-d8cac177e31d-trusted-ca-bundle\") pod \"periodic-gathering-qqhv7-c6vvh\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:37.849490 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.849312 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f847152-ec65-4b3c-bcb6-d8cac177e31d-service-ca-bundle\") pod \"periodic-gathering-qqhv7-c6vvh\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:37.950345 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.950242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-crio-socket\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:37.950345 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.950339 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9px9m\" (UniqueName: \"kubernetes.io/projected/1f847152-ec65-4b3c-bcb6-d8cac177e31d-kube-api-access-9px9m\") pod \"periodic-gathering-qqhv7-c6vvh\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:37.950558 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.950387 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-crio-socket\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:37.950558 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.950397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f847152-ec65-4b3c-bcb6-d8cac177e31d-trusted-ca-bundle\") pod \"periodic-gathering-qqhv7-c6vvh\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:37.950558 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.950463 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f847152-ec65-4b3c-bcb6-d8cac177e31d-service-ca-bundle\") pod \"periodic-gathering-qqhv7-c6vvh\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:37.950558 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.950500 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-data-volume\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:37.950558 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.950515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgk5m\" (UniqueName: \"kubernetes.io/projected/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-api-access-kgk5m\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:37.950558 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.950552 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:37.950827 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.950580 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:37.950827 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.950606 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/1f847152-ec65-4b3c-bcb6-d8cac177e31d-archives-path\") pod \"periodic-gathering-qqhv7-c6vvh\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:37.950940 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.950924 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/1f847152-ec65-4b3c-bcb6-d8cac177e31d-archives-path\") pod \"periodic-gathering-qqhv7-c6vvh\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:37.951342 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.951303 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f847152-ec65-4b3c-bcb6-d8cac177e31d-service-ca-bundle\") pod \"periodic-gathering-qqhv7-c6vvh\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:37.951475 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.951348 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f847152-ec65-4b3c-bcb6-d8cac177e31d-trusted-ca-bundle\") pod \"periodic-gathering-qqhv7-c6vvh\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:37.951475 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:37.951380 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 20:03:37.951475 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:37.951435 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-rbac-proxy-cm podName:b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc nodeName:}" failed. No retries permitted until 2026-10-30 20:03:38.451420266 +0000 UTC m=+37.130702507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-js96l" (UID: "b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc") : configmap "kube-rbac-proxy" not found Oct 30 20:03:37.951624 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:37.951507 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 20:03:37.951624 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:37.951546 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls podName:b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc nodeName:}" failed. No retries permitted until 2026-10-30 20:03:38.451534506 +0000 UTC m=+37.130816767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-js96l" (UID: "b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc") : secret "insights-runtime-extractor-tls" not found Oct 30 20:03:37.951624 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.951612 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-data-volume\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:37.964766 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.964738 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgk5m\" (UniqueName: \"kubernetes.io/projected/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-api-access-kgk5m\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:37.964928 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:37.964869 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9px9m\" (UniqueName: \"kubernetes.io/projected/1f847152-ec65-4b3c-bcb6-d8cac177e31d-kube-api-access-9px9m\") pod \"periodic-gathering-qqhv7-c6vvh\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:38.022632 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.022593 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:38.129369 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.128443 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" event={"ID":"20ba9ea0-10d3-419c-a429-3a6dcf153171","Type":"ContainerStarted","Data":"f4e65a71f01c261674d30498663ff163fbd98e67f4596833685278e507843529"} Oct 30 20:03:38.132660 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.131958 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/0.log" Oct 30 20:03:38.132660 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.132004 2578 generic.go:356] "Generic (PLEG): container finished" podID="ee5e6319-c93c-4713-b99c-9e5660af5192" containerID="b55b8729c2b7df3d2f75df07c067a3f6cafee7e04b65e88a8f9af2ec089a0782" exitCode=255 Oct 30 20:03:38.132660 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.132084 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" event={"ID":"ee5e6319-c93c-4713-b99c-9e5660af5192","Type":"ContainerDied","Data":"b55b8729c2b7df3d2f75df07c067a3f6cafee7e04b65e88a8f9af2ec089a0782"} Oct 30 20:03:38.132660 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.132480 2578 scope.go:122] "RemoveContainer" containerID="b55b8729c2b7df3d2f75df07c067a3f6cafee7e04b65e88a8f9af2ec089a0782" Oct 30 20:03:38.139233 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.139202 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" event={"ID":"e8af5bdb-cf19-4210-85c0-815d452cb701","Type":"ContainerStarted","Data":"517007075ca1aef58a909595ebf220c8db058ed82c0f3e8742db6b0553cce8ee"} Oct 30 20:03:38.154736 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.154681 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" podStartSLOduration=269.998508303 podStartE2EDuration="4m35.154661672s" totalImagesPullingTime="5.156153369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:38.153119295 +0000 UTC m=+36.832401562" watchObservedRunningTime="2026-10-30 20:03:38.154661672 +0000 UTC m=+36.833943923" Oct 30 20:03:38.345105 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.344940 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" podStartSLOduration=293.169778327 podStartE2EDuration="4m58.344899728s" totalImagesPullingTime="5.175121401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:58:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:38.20162068 +0000 UTC m=+36.880902932" watchObservedRunningTime="2026-10-30 20:03:38.344899728 +0000 UTC m=+37.024181981" Oct 30 20:03:38.347142 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.347060 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-qqhv7-c6vvh"] Oct 30 20:03:38.457404 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.457296 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:38.457404 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.457392 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:38.457605 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:38.457585 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 20:03:38.457674 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:38.457663 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-rbac-proxy-cm podName:b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc nodeName:}" failed. No retries permitted until 2026-10-30 20:03:39.457641282 +0000 UTC m=+38.136923527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-js96l" (UID: "b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc") : configmap "kube-rbac-proxy" not found Oct 30 20:03:38.457750 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:38.457700 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 20:03:38.457750 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:38.457743 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls podName:b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc nodeName:}" failed. No retries permitted until 2026-10-30 20:03:39.457730704 +0000 UTC m=+38.137012947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-js96l" (UID: "b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc") : secret "insights-runtime-extractor-tls" not found Oct 30 20:03:38.541947 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.540580 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-fx4v7"] Oct 30 20:03:38.562571 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.562539 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-zkfjx"] Oct 30 20:03:38.562755 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.562650 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fx4v7" Oct 30 20:03:38.578718 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.578684 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-fx4v7"] Oct 30 20:03:38.578877 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.578726 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-zkfjx"] Oct 30 20:03:38.578877 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.578809 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-zkfjx" Oct 30 20:03:38.591480 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.581648 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 30 20:03:38.591480 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.581726 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 30 20:03:38.624874 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.624823 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4qzg7\"" Oct 30 20:03:38.660264 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.660057 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mww9f\" (UniqueName: \"kubernetes.io/projected/1696437d-23f3-4078-afc4-69e3a94f5ec7-kube-api-access-mww9f\") pod \"migrator-66df5d496b-fx4v7\" (UID: \"1696437d-23f3-4078-afc4-69e3a94f5ec7\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fx4v7" Oct 30 20:03:38.760899 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.760817 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mww9f\" (UniqueName: \"kubernetes.io/projected/1696437d-23f3-4078-afc4-69e3a94f5ec7-kube-api-access-mww9f\") pod \"migrator-66df5d496b-fx4v7\" (UID: \"1696437d-23f3-4078-afc4-69e3a94f5ec7\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fx4v7" Oct 30 20:03:38.760899 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.760901 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvl5j\" (UniqueName: \"kubernetes.io/projected/fdac1f33-fb1f-4835-bbec-f34005f53979-kube-api-access-rvl5j\") pod \"migrator-66df5d496b-zkfjx\" (UID: \"fdac1f33-fb1f-4835-bbec-f34005f53979\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-zkfjx" Oct 30 20:03:38.783871 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.783818 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mww9f\" (UniqueName: \"kubernetes.io/projected/1696437d-23f3-4078-afc4-69e3a94f5ec7-kube-api-access-mww9f\") pod \"migrator-66df5d496b-fx4v7\" (UID: \"1696437d-23f3-4078-afc4-69e3a94f5ec7\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fx4v7" Oct 30 20:03:38.863151 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.862925 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvl5j\" (UniqueName: \"kubernetes.io/projected/fdac1f33-fb1f-4835-bbec-f34005f53979-kube-api-access-rvl5j\") pod \"migrator-66df5d496b-zkfjx\" (UID: \"fdac1f33-fb1f-4835-bbec-f34005f53979\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-zkfjx" Oct 30 20:03:38.877731 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.877698 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvl5j\" (UniqueName: \"kubernetes.io/projected/fdac1f33-fb1f-4835-bbec-f34005f53979-kube-api-access-rvl5j\") pod \"migrator-66df5d496b-zkfjx\" (UID: \"fdac1f33-fb1f-4835-bbec-f34005f53979\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-zkfjx" Oct 30 20:03:38.901722 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.901400 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fx4v7" Oct 30 20:03:38.915242 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.915203 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-wktp2"] Oct 30 20:03:38.921098 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.921065 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-zkfjx" Oct 30 20:03:38.937481 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.934465 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-wktp2" Oct 30 20:03:38.937481 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.935321 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-wktp2"] Oct 30 20:03:38.944199 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.944172 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Oct 30 20:03:38.944840 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.944815 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-cfkxt\"" Oct 30 20:03:38.968837 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.968652 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Oct 30 20:03:38.968837 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.968765 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Oct 30 20:03:38.968837 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:38.968815 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Oct 30 20:03:39.064651 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.064375 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssghm\" (UniqueName: \"kubernetes.io/projected/6ce6c965-80be-4c82-826c-a9dc4dd19592-kube-api-access-ssghm\") pod \"service-ca-5fffc97bdf-wktp2\" (UID: \"6ce6c965-80be-4c82-826c-a9dc4dd19592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wktp2" Oct 30 20:03:39.064651 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.064528 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6ce6c965-80be-4c82-826c-a9dc4dd19592-signing-cabundle\") pod \"service-ca-5fffc97bdf-wktp2\" (UID: \"6ce6c965-80be-4c82-826c-a9dc4dd19592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wktp2" Oct 30 20:03:39.064651 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.064552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6ce6c965-80be-4c82-826c-a9dc4dd19592-signing-key\") pod \"service-ca-5fffc97bdf-wktp2\" (UID: \"6ce6c965-80be-4c82-826c-a9dc4dd19592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wktp2" Oct 30 20:03:39.145803 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.145770 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/1.log" Oct 30 20:03:39.146367 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.146324 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/0.log" Oct 30 20:03:39.146435 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.146391 2578 generic.go:356] "Generic (PLEG): container finished" podID="ee5e6319-c93c-4713-b99c-9e5660af5192" containerID="347addf553f8c84e3334f4a707bf8f84da8f3d56f4e94ea30c7f293c0fbf0b2e" exitCode=255 Oct 30 20:03:39.146487 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.146470 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" event={"ID":"ee5e6319-c93c-4713-b99c-9e5660af5192","Type":"ContainerDied","Data":"347addf553f8c84e3334f4a707bf8f84da8f3d56f4e94ea30c7f293c0fbf0b2e"} Oct 30 20:03:39.146544 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.146525 2578 scope.go:122] "RemoveContainer" containerID="b55b8729c2b7df3d2f75df07c067a3f6cafee7e04b65e88a8f9af2ec089a0782" Oct 30 20:03:39.146970 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.146947 2578 scope.go:122] "RemoveContainer" containerID="347addf553f8c84e3334f4a707bf8f84da8f3d56f4e94ea30c7f293c0fbf0b2e" Oct 30 20:03:39.147205 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.147175 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-dr852_openshift-console-operator(ee5e6319-c93c-4713-b99c-9e5660af5192)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" podUID="ee5e6319-c93c-4713-b99c-9e5660af5192" Oct 30 20:03:39.150287 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.150257 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" event={"ID":"1f847152-ec65-4b3c-bcb6-d8cac177e31d","Type":"ContainerStarted","Data":"1bb6423564c72af5315053685b4a970d5781a6cf40b473085f41bffdbd90913e"} Oct 30 20:03:39.150408 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.150314 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" event={"ID":"1f847152-ec65-4b3c-bcb6-d8cac177e31d","Type":"ContainerStarted","Data":"208d31340929213c2e8e7364a9a8d5cea18b913b39921a385a3c5b25f37953de"} Oct 30 20:03:39.152664 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.152597 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-sb9tl" event={"ID":"fbfa2cf8-ef21-4485-91f3-6ca0b0b0d55d","Type":"ContainerStarted","Data":"3ca6745527bb800041347d990f2b42fadd89673432ada2b14640b4254911b3a2"} Oct 30 20:03:39.165593 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.165563 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssghm\" (UniqueName: \"kubernetes.io/projected/6ce6c965-80be-4c82-826c-a9dc4dd19592-kube-api-access-ssghm\") pod \"service-ca-5fffc97bdf-wktp2\" (UID: \"6ce6c965-80be-4c82-826c-a9dc4dd19592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wktp2" Oct 30 20:03:39.165747 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.165735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6ce6c965-80be-4c82-826c-a9dc4dd19592-signing-cabundle\") pod \"service-ca-5fffc97bdf-wktp2\" (UID: \"6ce6c965-80be-4c82-826c-a9dc4dd19592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wktp2" Oct 30 20:03:39.165818 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.165771 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6ce6c965-80be-4c82-826c-a9dc4dd19592-signing-key\") pod \"service-ca-5fffc97bdf-wktp2\" (UID: \"6ce6c965-80be-4c82-826c-a9dc4dd19592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wktp2" Oct 30 20:03:39.166889 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.166838 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6ce6c965-80be-4c82-826c-a9dc4dd19592-signing-cabundle\") pod \"service-ca-5fffc97bdf-wktp2\" (UID: \"6ce6c965-80be-4c82-826c-a9dc4dd19592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wktp2" Oct 30 20:03:39.169006 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.168980 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6ce6c965-80be-4c82-826c-a9dc4dd19592-signing-key\") pod \"service-ca-5fffc97bdf-wktp2\" (UID: \"6ce6c965-80be-4c82-826c-a9dc4dd19592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wktp2" Oct 30 20:03:39.182150 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.182118 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssghm\" (UniqueName: \"kubernetes.io/projected/6ce6c965-80be-4c82-826c-a9dc4dd19592-kube-api-access-ssghm\") pod \"service-ca-5fffc97bdf-wktp2\" (UID: \"6ce6c965-80be-4c82-826c-a9dc4dd19592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wktp2" Oct 30 20:03:39.190898 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.190839 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" podStartSLOduration=2.190822024 podStartE2EDuration="2.190822024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:03:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:39.189549757 +0000 UTC m=+37.868832007" watchObservedRunningTime="2026-10-30 20:03:39.190822024 +0000 UTC m=+37.870104273" Oct 30 20:03:39.209277 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.209210 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-sb9tl" podStartSLOduration=264.642425181 podStartE2EDuration="4m30.2091895s" totalImagesPullingTime="5.566764319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:39.207471418 +0000 UTC m=+37.886753691" watchObservedRunningTime="2026-10-30 20:03:39.2091895 +0000 UTC m=+37.888471744" Oct 30 20:03:39.243809 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.243770 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-fx4v7"] Oct 30 20:03:39.250805 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.250743 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-zkfjx"] Oct 30 20:03:39.254652 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:39.254624 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdac1f33_fb1f_4835_bbec_f34005f53979.slice/crio-923b77654cdccbede2198a35b11c9f8a675a265500dc5c00ec5676af62533704 WatchSource:0}: Error finding container 923b77654cdccbede2198a35b11c9f8a675a265500dc5c00ec5676af62533704: Status 404 returned error can't find the container with id 923b77654cdccbede2198a35b11c9f8a675a265500dc5c00ec5676af62533704 Oct 30 20:03:39.255154 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:39.255119 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1696437d_23f3_4078_afc4_69e3a94f5ec7.slice/crio-0c524506c6844ccd84e0c8f223c0dd6f2faa58c813b8d23a2b36c9bd15c51da0 WatchSource:0}: Error finding container 0c524506c6844ccd84e0c8f223c0dd6f2faa58c813b8d23a2b36c9bd15c51da0: Status 404 returned error can't find the container with id 0c524506c6844ccd84e0c8f223c0dd6f2faa58c813b8d23a2b36c9bd15c51da0 Oct 30 20:03:39.294183 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.294116 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-wktp2" Oct 30 20:03:39.469344 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.469299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:39.469522 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.469378 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:39.469522 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.469458 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 20:03:39.469625 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.469527 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-rbac-proxy-cm podName:b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc nodeName:}" failed. No retries permitted until 2026-10-30 20:03:41.469512603 +0000 UTC m=+40.148794843 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-js96l" (UID: "b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc") : configmap "kube-rbac-proxy" not found Oct 30 20:03:39.469625 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.469561 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 20:03:39.469712 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.469628 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae25b031-7ac9-4041-bc3a-7a6679eab74d-networking-console-plugin-cert podName:ae25b031-7ac9-4041-bc3a-7a6679eab74d nodeName:}" failed. No retries permitted until 2026-10-30 20:03:47.469612659 +0000 UTC m=+46.148894889 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae25b031-7ac9-4041-bc3a-7a6679eab74d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-gksz8" (UID: "ae25b031-7ac9-4041-bc3a-7a6679eab74d") : secret "networking-console-plugin-cert" not found Oct 30 20:03:39.469712 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.469693 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 20:03:39.469785 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.469727 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls podName:b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc nodeName:}" failed. No retries permitted until 2026-10-30 20:03:41.469716524 +0000 UTC m=+40.148998756 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-js96l" (UID: "b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc") : secret "insights-runtime-extractor-tls" not found Oct 30 20:03:39.469785 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.469465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae25b031-7ac9-4041-bc3a-7a6679eab74d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-gksz8\" (UID: \"ae25b031-7ac9-4041-bc3a-7a6679eab74d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-gksz8" Oct 30 20:03:39.571091 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.570774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:39.571091 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.570831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:39.571091 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.570873 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-metrics-certs\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:39.571091 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.570893 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f941d6e-cd94-47d5-a641-fb608c05a903-metrics-tls\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:39.571091 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.570912 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-bbm2j\" (UID: \"24b57f65-bf27-4659-a922-83a241893696\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:39.571091 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.570939 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 20:03:39.571091 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.570962 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8586cfd6bb-wzm9m: secret "image-registry-tls" not found Oct 30 20:03:39.571091 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.571012 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 20:03:39.571091 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.571026 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 20:03:39.571091 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.571028 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls podName:27e4937d-367a-4ccc-9580-74a3982a49fe nodeName:}" failed. No retries permitted until 2026-10-30 20:03:47.571009094 +0000 UTC m=+46.250291322 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls") pod "image-registry-8586cfd6bb-wzm9m" (UID: "27e4937d-367a-4ccc-9580-74a3982a49fe") : secret "image-registry-tls" not found Oct 30 20:03:39.571673 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.571122 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 20:03:39.571673 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.571134 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c856df5f-jdst9: secret "image-registry-tls" not found Oct 30 20:03:39.571673 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.571194 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 20:03:39.572267 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.571807 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-metrics-certs podName:2e5941e6-4fc9-4353-a518-8ad492e9ad61 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:47.571068361 +0000 UTC m=+46.250350592 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-metrics-certs") pod "router-default-7f94f8f65c-dqcj8" (UID: "2e5941e6-4fc9-4353-a518-8ad492e9ad61") : secret "router-metrics-certs-default" not found Oct 30 20:03:39.572267 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.571844 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f941d6e-cd94-47d5-a641-fb608c05a903-metrics-tls podName:7f941d6e-cd94-47d5-a641-fb608c05a903 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:47.571830038 +0000 UTC m=+46.251112264 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f941d6e-cd94-47d5-a641-fb608c05a903-metrics-tls") pod "dns-default-hd99r" (UID: "7f941d6e-cd94-47d5-a641-fb608c05a903") : secret "dns-default-metrics-tls" not found Oct 30 20:03:39.572267 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.571870 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls podName:4ac859bf-692b-4447-891a-32541e1e244d nodeName:}" failed. No retries permitted until 2026-10-30 20:03:47.571862755 +0000 UTC m=+46.251145038 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls") pod "image-registry-75c856df5f-jdst9" (UID: "4ac859bf-692b-4447-891a-32541e1e244d") : secret "image-registry-tls" not found Oct 30 20:03:39.572267 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.571932 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jb98m\" (UID: \"28ba2930-e73c-4716-b061-d7cb2bbd0400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:39.572267 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.571994 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:39.572267 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.572123 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle podName:2e5941e6-4fc9-4353-a518-8ad492e9ad61 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:47.572111798 +0000 UTC m=+46.251394037 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle") pod "router-default-7f94f8f65c-dqcj8" (UID: "2e5941e6-4fc9-4353-a518-8ad492e9ad61") : configmap references non-existent config key: service-ca.crt Oct 30 20:03:39.572267 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.572145 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls podName:24b57f65-bf27-4659-a922-83a241893696 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:47.572136579 +0000 UTC m=+46.251418854 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-bbm2j" (UID: "24b57f65-bf27-4659-a922-83a241893696") : secret "cluster-monitoring-operator-tls" not found Oct 30 20:03:39.572267 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.572204 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 20:03:39.572267 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:39.572237 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-tls podName:28ba2930-e73c-4716-b061-d7cb2bbd0400 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:47.572227534 +0000 UTC m=+46.251509764 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-jb98m" (UID: "28ba2930-e73c-4716-b061-d7cb2bbd0400") : secret "samples-operator-tls" not found Oct 30 20:03:39.611802 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:39.611765 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-wktp2"] Oct 30 20:03:39.615923 ip-10-0-139-217 kubenswrapper[2578]: W1030 20:03:39.615893 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce6c965_80be_4c82_826c_a9dc4dd19592.slice/crio-fbf231f4ba8bcffc7c74df21cf0d38b69a58464c5b212ab941da3605cf17115b WatchSource:0}: Error finding container fbf231f4ba8bcffc7c74df21cf0d38b69a58464c5b212ab941da3605cf17115b: Status 404 returned error can't find the container with id fbf231f4ba8bcffc7c74df21cf0d38b69a58464c5b212ab941da3605cf17115b Oct 30 20:03:40.160792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:40.159729 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/1.log" Oct 30 20:03:40.160792 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:40.160145 2578 scope.go:122] "RemoveContainer" containerID="347addf553f8c84e3334f4a707bf8f84da8f3d56f4e94ea30c7f293c0fbf0b2e" Oct 30 20:03:40.160792 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:40.160347 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-dr852_openshift-console-operator(ee5e6319-c93c-4713-b99c-9e5660af5192)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" podUID="ee5e6319-c93c-4713-b99c-9e5660af5192" Oct 30 20:03:40.162673 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:40.162641 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-wktp2" event={"ID":"6ce6c965-80be-4c82-826c-a9dc4dd19592","Type":"ContainerStarted","Data":"acd4a24e3be425b60482d26c5bad52cb5e1c77fe49b70e3c4cfe47acb754e0d9"} Oct 30 20:03:40.162808 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:40.162700 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-wktp2" event={"ID":"6ce6c965-80be-4c82-826c-a9dc4dd19592","Type":"ContainerStarted","Data":"fbf231f4ba8bcffc7c74df21cf0d38b69a58464c5b212ab941da3605cf17115b"} Oct 30 20:03:40.164362 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:40.164311 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-zkfjx" event={"ID":"fdac1f33-fb1f-4835-bbec-f34005f53979","Type":"ContainerStarted","Data":"923b77654cdccbede2198a35b11c9f8a675a265500dc5c00ec5676af62533704"} Oct 30 20:03:40.165973 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:40.165912 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fx4v7" event={"ID":"1696437d-23f3-4078-afc4-69e3a94f5ec7","Type":"ContainerStarted","Data":"0c524506c6844ccd84e0c8f223c0dd6f2faa58c813b8d23a2b36c9bd15c51da0"} Oct 30 20:03:40.203846 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:40.203789 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-wktp2" podStartSLOduration=2.20377038 podStartE2EDuration="2.20377038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:03:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:40.201443545 +0000 UTC m=+38.880725818" watchObservedRunningTime="2026-10-30 20:03:40.20377038 +0000 UTC m=+38.883052615" Oct 30 20:03:40.723274 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:40.723244 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sxszz_bea5c7b2-5ad1-43f5-8f43-07e3af665d6a/dns-node-resolver/0.log" Oct 30 20:03:41.178073 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:41.175559 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l5w4q" event={"ID":"9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e","Type":"ContainerStarted","Data":"9578cbde14feebcd9ab51104538f776d3f2c9db49015f8054a256da3ad5880ce"} Oct 30 20:03:41.178073 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:41.175711 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:41.181398 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:41.181319 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t85sd" event={"ID":"22e3da9c-5201-4bd9-b247-1caaa18f5d7d","Type":"ContainerStarted","Data":"09f23b66f654f57d8fb6be5af33f7e63832c0cfb7cd98421e9081f852afdc073"} Oct 30 20:03:41.195861 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:41.195815 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-l5w4q" podStartSLOduration=35.211050079 podStartE2EDuration="39.195803379s" totalImagesPullingTime="3.9847533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:41.195439507 +0000 UTC m=+39.874721761" watchObservedRunningTime="2026-10-30 20:03:41.195803379 +0000 UTC m=+39.875085639" Oct 30 20:03:41.216869 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:41.216805 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-t85sd" podStartSLOduration=2.525700593 podStartE2EDuration="10.216785175s" totalImagesPullingTime="7.691084582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:41.214835803 +0000 UTC m=+39.894118071" watchObservedRunningTime="2026-10-30 20:03:41.216785175 +0000 UTC m=+39.896067425" Oct 30 20:03:41.498145 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:41.498071 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:41.498145 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:41.498135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:41.498368 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:41.498203 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 20:03:41.498368 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:41.498266 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 20:03:41.498368 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:41.498284 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-rbac-proxy-cm podName:b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc nodeName:}" failed. No retries permitted until 2026-10-30 20:03:45.498265116 +0000 UTC m=+44.177547356 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-js96l" (UID: "b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc") : configmap "kube-rbac-proxy" not found Oct 30 20:03:41.498368 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:41.498349 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls podName:b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc nodeName:}" failed. No retries permitted until 2026-10-30 20:03:45.498314705 +0000 UTC m=+44.177596947 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-js96l" (UID: "b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc") : secret "insights-runtime-extractor-tls" not found Oct 30 20:03:41.544637 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:41.544608 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fc6gd_ff5da8ed-018c-4182-82f0-a8a3266aff52/node-ca/0.log" Oct 30 20:03:42.111503 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:42.111469 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:42.111930 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:42.111897 2578 scope.go:122] "RemoveContainer" containerID="347addf553f8c84e3334f4a707bf8f84da8f3d56f4e94ea30c7f293c0fbf0b2e" Oct 30 20:03:42.112144 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:42.112119 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-dr852_openshift-console-operator(ee5e6319-c93c-4713-b99c-9e5660af5192)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" podUID="ee5e6319-c93c-4713-b99c-9e5660af5192" Oct 30 20:03:42.112467 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:42.112441 2578 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:42.186802 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:42.186763 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-zkfjx" event={"ID":"fdac1f33-fb1f-4835-bbec-f34005f53979","Type":"ContainerStarted","Data":"7b211bcade16b8c14385fc4b5e3e4aa5acf350aefa7377d6844dbc716a148954"} Oct 30 20:03:42.189001 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:42.188676 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fx4v7" event={"ID":"1696437d-23f3-4078-afc4-69e3a94f5ec7","Type":"ContainerStarted","Data":"a1c42f87eca7105795df3b8ee9952e8fb4c3a84570b105864e7ddd374f1659df"} Oct 30 20:03:42.189226 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:42.189209 2578 scope.go:122] "RemoveContainer" containerID="347addf553f8c84e3334f4a707bf8f84da8f3d56f4e94ea30c7f293c0fbf0b2e" Oct 30 20:03:42.189418 ip-10-0-139-217 kubenswrapper[2578]: E1030 20:03:42.189399 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-dr852_openshift-console-operator(ee5e6319-c93c-4713-b99c-9e5660af5192)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" podUID="ee5e6319-c93c-4713-b99c-9e5660af5192" Oct 30 20:03:42.206551 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:42.206505 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-zkfjx" podStartSLOduration=1.430490056 podStartE2EDuration="4.206491717s" totalImagesPullingTime="2.776001661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:03:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:42.205223843 +0000 UTC m=+40.884506115" watchObservedRunningTime="2026-10-30 20:03:42.206491717 +0000 UTC m=+40.885773988" Oct 30 20:03:42.225884 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:42.225827 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fx4v7" podStartSLOduration=1.747107588 podStartE2EDuration="4.225811795s" totalImagesPullingTime="2.478704207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:03:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:42.225446783 +0000 UTC m=+40.904729033" watchObservedRunningTime="2026-10-30 20:03:42.225811795 +0000 UTC m=+40.905094044" Oct 30 20:03:42.321172 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:42.321139 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t85sd_22e3da9c-5201-4bd9-b247-1caaa18f5d7d/serve-healthcheck-canary/0.log" Oct 30 20:03:42.520994 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:42.520966 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-fx4v7_1696437d-23f3-4078-afc4-69e3a94f5ec7/migrator/0.log" Oct 30 20:03:42.725195 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:42.725122 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-zkfjx_fdac1f33-fb1f-4835-bbec-f34005f53979/migrator/0.log" Oct 30 20:03:42.922053 ip-10-0-139-217 kubenswrapper[2578]: I1030 20:03:42.922016 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz_e8af5bdb-cf19-4210-85c0-815d452cb701/kube-storage-version-migrator-operator/0.log" Oct 30 20:03:45.405606 ip-10-0-139-217 systemd[1]: Stopping Kubernetes Kubelet... Oct 30 20:03:45.418851 ip-10-0-139-217 systemd[1]: kubelet.service: Deactivated successfully. Oct 30 20:03:45.419024 ip-10-0-139-217 systemd[1]: Stopped Kubernetes Kubelet. Oct 30 20:03:45.419081 ip-10-0-139-217 systemd[1]: kubelet.service: Consumed 3.353s CPU time. Oct 30 20:03:45.431356 ip-10-0-139-217 systemd[1]: Starting Kubernetes Kubelet... Oct 30 20:03:45.497682 ip-10-0-139-217 kubenswrapper[5078]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 20:03:45.497682 ip-10-0-139-217 kubenswrapper[5078]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 20:03:45.497682 ip-10-0-139-217 kubenswrapper[5078]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 20:03:45.497682 ip-10-0-139-217 kubenswrapper[5078]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 20:03:45.499819 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499725 5078 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 20:03:45.499819 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499819 5078 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 20:03:45.499898 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499824 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 20:03:45.499898 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499827 5078 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 20:03:45.499898 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499830 5078 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 20:03:45.499898 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499833 5078 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 20:03:45.499898 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499837 5078 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 20:03:45.499898 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499840 5078 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 20:03:45.499898 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499849 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 20:03:45.499898 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499852 5078 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 20:03:45.499898 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499855 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 20:03:45.499898 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499858 5078 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 20:03:45.499898 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499860 5078 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 20:03:45.499898 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499863 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 20:03:45.499898 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499866 5078 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 20:03:45.499898 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499868 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 20:03:45.499898 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499871 5078 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 20:03:45.499898 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499874 5078 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 20:03:45.499898 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499876 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 20:03:45.499898 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499879 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 20:03:45.499898 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499882 5078 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 20:03:45.499898 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499885 5078 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 20:03:45.500436 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499887 5078 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 20:03:45.500436 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499890 5078 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 20:03:45.500436 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499893 5078 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 20:03:45.500436 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499895 5078 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 20:03:45.500436 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499898 5078 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 20:03:45.500436 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499901 5078 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 20:03:45.500436 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499904 5078 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 20:03:45.500436 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499907 5078 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 20:03:45.500436 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499909 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 20:03:45.500436 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499912 5078 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 20:03:45.500436 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499915 5078 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 20:03:45.500436 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499918 5078 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 20:03:45.500436 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499920 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 20:03:45.500436 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499923 5078 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 20:03:45.500436 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499926 5078 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 20:03:45.500436 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499928 5078 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 20:03:45.500436 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499931 5078 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 20:03:45.500436 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499934 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 20:03:45.500436 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499937 5078 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 20:03:45.500436 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499939 5078 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 20:03:45.500989 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499942 5078 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 20:03:45.500989 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499945 5078 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 20:03:45.500989 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499948 5078 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 20:03:45.500989 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499950 5078 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 20:03:45.500989 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499953 5078 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 20:03:45.500989 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499956 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 20:03:45.500989 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499960 5078 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 20:03:45.500989 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499962 5078 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 20:03:45.500989 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499965 5078 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 20:03:45.500989 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499967 5078 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 20:03:45.500989 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499970 5078 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 20:03:45.500989 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499973 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 20:03:45.500989 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499975 5078 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 20:03:45.500989 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499978 5078 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 20:03:45.500989 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499982 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 20:03:45.500989 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499984 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 20:03:45.500989 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499987 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 20:03:45.500989 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499990 5078 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 20:03:45.500989 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499992 5078 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 20:03:45.501588 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499995 5078 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 20:03:45.501588 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.499998 5078 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 20:03:45.501588 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500000 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 20:03:45.501588 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500003 5078 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 20:03:45.501588 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500005 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 20:03:45.501588 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500008 5078 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 20:03:45.501588 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500010 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 20:03:45.501588 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500015 5078 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 20:03:45.501588 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500018 5078 feature_gate.go:386] unrecognized feature gate: Example Oct 30 20:03:45.501588 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500021 5078 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 20:03:45.501588 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500025 5078 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 20:03:45.501588 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500028 5078 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 20:03:45.501588 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500031 5078 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 20:03:45.501588 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500033 5078 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 20:03:45.501588 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500036 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 20:03:45.501588 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500038 5078 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 20:03:45.501588 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500041 5078 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 20:03:45.501588 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500043 5078 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 20:03:45.501588 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500046 5078 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 20:03:45.502108 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500048 5078 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 20:03:45.502108 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500051 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 20:03:45.502108 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500053 5078 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 20:03:45.502108 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500056 5078 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 20:03:45.502108 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500058 5078 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 20:03:45.502108 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500061 5078 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 20:03:45.502108 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500064 5078 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 20:03:45.502108 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500067 5078 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 20:03:45.502108 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500071 5078 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 20:03:45.502108 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500075 5078 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 20:03:45.502108 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500078 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 20:03:45.502108 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500081 5078 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 20:03:45.502108 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500084 5078 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 20:03:45.502108 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500087 5078 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 20:03:45.502108 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500090 5078 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 20:03:45.502108 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500092 5078 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 20:03:45.502108 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500095 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 20:03:45.502108 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500097 5078 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 20:03:45.502108 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500100 5078 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 20:03:45.502108 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500102 5078 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 20:03:45.502631 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500106 5078 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 20:03:45.502631 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500109 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 20:03:45.502631 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500133 5078 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 20:03:45.502631 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500138 5078 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 20:03:45.502631 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500141 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 20:03:45.502631 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500144 5078 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 20:03:45.502631 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500948 5078 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 20:03:45.502631 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500957 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 20:03:45.502631 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500961 5078 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 20:03:45.502631 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500964 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 20:03:45.502631 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500966 5078 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 20:03:45.502631 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500969 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 20:03:45.502631 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500972 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 20:03:45.502631 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500975 5078 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 20:03:45.502631 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500978 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 20:03:45.502631 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500980 5078 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 20:03:45.502631 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500983 5078 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 20:03:45.502631 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500986 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 20:03:45.503128 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500989 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 20:03:45.503128 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500991 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 20:03:45.503128 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500994 5078 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 20:03:45.503128 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.500997 5078 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 20:03:45.503128 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501000 5078 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 20:03:45.503128 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501003 5078 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 20:03:45.503128 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501006 5078 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 20:03:45.503128 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501009 5078 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 20:03:45.503128 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501011 5078 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 20:03:45.503128 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501013 5078 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 20:03:45.503128 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501016 5078 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 20:03:45.503128 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501019 5078 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 20:03:45.503128 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501022 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 20:03:45.503128 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501026 5078 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 20:03:45.503128 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501030 5078 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 20:03:45.503128 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501034 5078 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 20:03:45.503128 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501037 5078 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 20:03:45.503128 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501040 5078 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 20:03:45.503128 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501042 5078 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 20:03:45.503128 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501045 5078 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 20:03:45.503645 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501059 5078 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 20:03:45.503645 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501062 5078 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 20:03:45.503645 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501065 5078 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 20:03:45.503645 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501067 5078 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 20:03:45.503645 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501070 5078 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 20:03:45.503645 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501072 5078 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 20:03:45.503645 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501075 5078 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 20:03:45.503645 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501078 5078 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 20:03:45.503645 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501081 5078 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 20:03:45.503645 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501084 5078 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 20:03:45.503645 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501086 5078 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 20:03:45.503645 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501089 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 20:03:45.503645 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501092 5078 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 20:03:45.503645 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501094 5078 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 20:03:45.503645 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501097 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 20:03:45.503645 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501100 5078 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 20:03:45.503645 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501103 5078 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 20:03:45.503645 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501106 5078 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 20:03:45.503645 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501108 5078 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 20:03:45.504132 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501111 5078 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 20:03:45.504132 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501113 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 20:03:45.504132 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501116 5078 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 20:03:45.504132 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501119 5078 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 20:03:45.504132 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501121 5078 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 20:03:45.504132 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501124 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 20:03:45.504132 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501126 5078 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 20:03:45.504132 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501129 5078 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 20:03:45.504132 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501131 5078 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 20:03:45.504132 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501134 5078 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 20:03:45.504132 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501136 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 20:03:45.504132 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501139 5078 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 20:03:45.504132 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501143 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 20:03:45.504132 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501148 5078 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 20:03:45.504132 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501156 5078 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 20:03:45.504132 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501159 5078 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 20:03:45.504132 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501162 5078 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 20:03:45.504132 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501164 5078 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 20:03:45.504132 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501167 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 20:03:45.504132 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501170 5078 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 20:03:45.504686 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501173 5078 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 20:03:45.504686 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501175 5078 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 20:03:45.504686 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501177 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 20:03:45.504686 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501180 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 20:03:45.504686 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501193 5078 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 20:03:45.504686 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501197 5078 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 20:03:45.504686 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501200 5078 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 20:03:45.504686 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501203 5078 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 20:03:45.504686 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501206 5078 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 20:03:45.504686 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501209 5078 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 20:03:45.504686 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501211 5078 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 20:03:45.504686 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501214 5078 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 20:03:45.504686 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501216 5078 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 20:03:45.504686 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501219 5078 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 20:03:45.504686 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501221 5078 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 20:03:45.504686 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501224 5078 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 20:03:45.504686 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501227 5078 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 20:03:45.504686 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501229 5078 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 20:03:45.504686 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501232 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 20:03:45.504686 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501235 5078 feature_gate.go:386] unrecognized feature gate: Example Oct 30 20:03:45.505208 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501238 5078 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 20:03:45.505208 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501240 5078 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 20:03:45.505208 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501245 5078 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 20:03:45.505208 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501248 5078 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 20:03:45.505208 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501251 5078 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 20:03:45.505208 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501255 5078 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 20:03:45.505208 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501258 5078 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 20:03:45.505208 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501261 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 20:03:45.505208 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501264 5078 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 20:03:45.505208 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501267 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 20:03:45.505208 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501269 5078 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 20:03:45.505208 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501272 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 20:03:45.505208 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501274 5078 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 20:03:45.505208 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501277 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 20:03:45.505208 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501280 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 20:03:45.505208 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501784 5078 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 20:03:45.505208 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501790 5078 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 20:03:45.505208 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501792 5078 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 20:03:45.505208 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501795 5078 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 20:03:45.505208 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501798 5078 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 20:03:45.505800 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501802 5078 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 20:03:45.505800 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501805 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 20:03:45.505800 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501807 5078 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 20:03:45.505800 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501810 5078 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 20:03:45.505800 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501813 5078 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 20:03:45.505800 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501815 5078 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 20:03:45.505800 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501818 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 20:03:45.505800 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501821 5078 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 20:03:45.505800 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501823 5078 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 20:03:45.505800 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501826 5078 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 20:03:45.505800 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501829 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 20:03:45.505800 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501831 5078 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 20:03:45.505800 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501834 5078 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 20:03:45.505800 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501837 5078 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 20:03:45.505800 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501839 5078 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 20:03:45.505800 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501842 5078 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 20:03:45.505800 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501844 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 20:03:45.505800 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501848 5078 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 20:03:45.505800 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501851 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 20:03:45.506267 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501854 5078 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 20:03:45.506267 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501857 5078 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 20:03:45.506267 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501859 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 20:03:45.506267 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501862 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 20:03:45.506267 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501865 5078 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 20:03:45.506267 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501867 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 20:03:45.506267 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501870 5078 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 20:03:45.506267 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501872 5078 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 20:03:45.506267 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501877 5078 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 20:03:45.506267 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501879 5078 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 20:03:45.506267 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501882 5078 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 20:03:45.506267 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501884 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 20:03:45.506267 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501887 5078 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 20:03:45.506267 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501890 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 20:03:45.506267 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501892 5078 feature_gate.go:386] unrecognized feature gate: Example Oct 30 20:03:45.506267 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501895 5078 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 20:03:45.506267 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501897 5078 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 20:03:45.506267 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501901 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 20:03:45.506267 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501903 5078 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 20:03:45.506769 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501906 5078 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 20:03:45.506769 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501908 5078 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 20:03:45.506769 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501911 5078 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 20:03:45.506769 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501913 5078 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 20:03:45.506769 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501916 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 20:03:45.506769 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501919 5078 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 20:03:45.506769 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501921 5078 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 20:03:45.506769 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501923 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 20:03:45.506769 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501926 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 20:03:45.506769 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501929 5078 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 20:03:45.506769 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501931 5078 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 20:03:45.506769 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501935 5078 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 20:03:45.506769 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501938 5078 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 20:03:45.506769 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501940 5078 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 20:03:45.506769 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501943 5078 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 20:03:45.506769 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501946 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 20:03:45.506769 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501949 5078 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 20:03:45.506769 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501951 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 20:03:45.506769 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501954 5078 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 20:03:45.507233 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501956 5078 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 20:03:45.507233 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501959 5078 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 20:03:45.507233 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501963 5078 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 20:03:45.507233 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501966 5078 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 20:03:45.507233 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501968 5078 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 20:03:45.507233 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501971 5078 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 20:03:45.507233 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501973 5078 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 20:03:45.507233 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501976 5078 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 20:03:45.507233 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501979 5078 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 20:03:45.507233 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501983 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 20:03:45.507233 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501986 5078 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 20:03:45.507233 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501988 5078 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 20:03:45.507233 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501991 5078 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 20:03:45.507233 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501994 5078 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 20:03:45.507233 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501996 5078 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 20:03:45.507233 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.501999 5078 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 20:03:45.507233 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502001 5078 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 20:03:45.507233 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502004 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 20:03:45.507233 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502007 5078 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 20:03:45.507233 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502009 5078 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 20:03:45.507749 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502012 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 20:03:45.507749 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502014 5078 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 20:03:45.507749 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502017 5078 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 20:03:45.507749 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502019 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 20:03:45.507749 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502024 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 20:03:45.507749 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502028 5078 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 20:03:45.507749 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502031 5078 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 20:03:45.507749 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502035 5078 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 20:03:45.507749 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502038 5078 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 20:03:45.507749 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502042 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 20:03:45.507749 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502044 5078 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 20:03:45.507749 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502047 5078 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 20:03:45.507749 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502049 5078 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 20:03:45.507749 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502052 5078 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 20:03:45.507749 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502056 5078 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 20:03:45.507749 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502058 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 20:03:45.507749 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502061 5078 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 20:03:45.507749 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502064 5078 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 20:03:45.507749 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502066 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502069 5078 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502071 5078 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502074 5078 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502076 5078 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502080 5078 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502184 5078 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502195 5078 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502202 5078 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502207 5078 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502212 5078 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502216 5078 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502221 5078 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502225 5078 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502229 5078 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502232 5078 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502236 5078 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502239 5078 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502244 5078 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502247 5078 flags.go:64] FLAG: --cgroup-root="" Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502251 5078 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502254 5078 flags.go:64] FLAG: --client-ca-file="" Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502257 5078 flags.go:64] FLAG: --cloud-provider="external" Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502261 5078 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 20:03:45.508219 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502266 5078 flags.go:64] FLAG: --cluster-domain="" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502269 5078 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502272 5078 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502276 5078 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502280 5078 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502284 5078 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502288 5078 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502291 5078 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502294 5078 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502297 5078 flags.go:64] FLAG: --contention-profiling="false" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502301 5078 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502304 5078 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502307 5078 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502310 5078 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502314 5078 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502318 5078 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502321 5078 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502324 5078 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502342 5078 flags.go:64] FLAG: --enable-server="true" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502345 5078 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502350 5078 flags.go:64] FLAG: --event-burst="100" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502353 5078 flags.go:64] FLAG: --event-qps="50" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502357 5078 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502360 5078 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 20:03:45.508845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502363 5078 flags.go:64] FLAG: --eviction-hard="" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502368 5078 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502372 5078 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502376 5078 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502379 5078 flags.go:64] FLAG: --eviction-soft="" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502382 5078 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502386 5078 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502389 5078 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502392 5078 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502396 5078 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502399 5078 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502402 5078 flags.go:64] FLAG: --feature-gates="" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502407 5078 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502410 5078 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502414 5078 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502417 5078 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502420 5078 flags.go:64] FLAG: --healthz-port="10248" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502423 5078 flags.go:64] FLAG: --help="false" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502427 5078 flags.go:64] FLAG: --hostname-override="ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502430 5078 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502433 5078 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502436 5078 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502440 5078 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 20:03:45.509471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502444 5078 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502447 5078 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502450 5078 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502453 5078 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502457 5078 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502460 5078 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502463 5078 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502466 5078 flags.go:64] FLAG: --kube-reserved="" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502469 5078 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502472 5078 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502476 5078 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502480 5078 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502483 5078 flags.go:64] FLAG: --lock-file="" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502486 5078 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502489 5078 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502493 5078 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502498 5078 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502502 5078 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502505 5078 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502509 5078 flags.go:64] FLAG: --logging-format="text" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502512 5078 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502515 5078 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502519 5078 flags.go:64] FLAG: --manifest-url="" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502522 5078 flags.go:64] FLAG: --manifest-url-header="" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502526 5078 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 20:03:45.510559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502529 5078 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502533 5078 flags.go:64] FLAG: --max-pods="110" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502536 5078 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502539 5078 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502543 5078 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502546 5078 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502549 5078 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502553 5078 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502556 5078 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502564 5078 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502567 5078 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502570 5078 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502574 5078 flags.go:64] FLAG: --pod-cidr="" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502577 5078 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502580 5078 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502583 5078 flags.go:64] FLAG: --pods-per-core="0" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502586 5078 flags.go:64] FLAG: --port="10250" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502589 5078 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502594 5078 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0b812eebadafa4378" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502597 5078 flags.go:64] FLAG: --qos-reserved="" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502600 5078 flags.go:64] FLAG: --read-only-port="10255" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502604 5078 flags.go:64] FLAG: --register-node="true" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502607 5078 flags.go:64] FLAG: --register-with-taints="" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502614 5078 flags.go:64] FLAG: --registry-burst="10" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502617 5078 flags.go:64] FLAG: --registry-qps="5" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502621 5078 flags.go:64] FLAG: --reserved-cpus="" Oct 30 20:03:45.511565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502624 5078 flags.go:64] FLAG: --reserved-memory="" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502628 5078 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502632 5078 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502636 5078 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502639 5078 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502642 5078 flags.go:64] FLAG: --runonce="false" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502645 5078 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502648 5078 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502651 5078 flags.go:64] FLAG: --seccomp-default="false" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502654 5078 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502657 5078 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502660 5078 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502664 5078 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502667 5078 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502671 5078 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502674 5078 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502677 5078 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502680 5078 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502683 5078 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502686 5078 flags.go:64] FLAG: --system-cgroups="" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502689 5078 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502695 5078 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502698 5078 flags.go:64] FLAG: --tls-cert-file="" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502701 5078 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502707 5078 flags.go:64] FLAG: --tls-min-version="" Oct 30 20:03:45.512682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502710 5078 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 20:03:45.513930 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502713 5078 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 20:03:45.513930 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502716 5078 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 20:03:45.513930 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502719 5078 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 20:03:45.513930 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502722 5078 flags.go:64] FLAG: --v="2" Oct 30 20:03:45.513930 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502726 5078 flags.go:64] FLAG: --version="false" Oct 30 20:03:45.513930 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502731 5078 flags.go:64] FLAG: --vmodule="" Oct 30 20:03:45.513930 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502737 5078 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 20:03:45.513930 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.502741 5078 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 20:03:45.513930 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502882 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 20:03:45.513930 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502886 5078 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 20:03:45.513930 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502889 5078 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 20:03:45.513930 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502892 5078 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 20:03:45.513930 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502897 5078 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 20:03:45.513930 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502901 5078 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 20:03:45.513930 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502904 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 20:03:45.513930 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502907 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 20:03:45.513930 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502909 5078 feature_gate.go:386] unrecognized feature gate: Example Oct 30 20:03:45.513930 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502912 5078 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 20:03:45.513930 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502915 5078 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 20:03:45.513930 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502917 5078 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 20:03:45.513930 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502920 5078 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 20:03:45.514840 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502923 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 20:03:45.514840 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502926 5078 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 20:03:45.514840 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502928 5078 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 20:03:45.514840 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502931 5078 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 20:03:45.514840 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502934 5078 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 20:03:45.514840 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502936 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 20:03:45.514840 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502939 5078 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 20:03:45.514840 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502941 5078 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 20:03:45.514840 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502944 5078 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 20:03:45.514840 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502948 5078 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 20:03:45.514840 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502950 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 20:03:45.514840 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502953 5078 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 20:03:45.514840 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502956 5078 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 20:03:45.514840 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502958 5078 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 20:03:45.514840 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502961 5078 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 20:03:45.514840 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502964 5078 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 20:03:45.514840 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502968 5078 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 20:03:45.514840 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502976 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 20:03:45.514840 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502979 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 20:03:45.515666 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502983 5078 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 20:03:45.515666 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502986 5078 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 20:03:45.515666 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502988 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 20:03:45.515666 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502991 5078 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 20:03:45.515666 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502994 5078 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 20:03:45.515666 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502996 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 20:03:45.515666 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.502999 5078 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 20:03:45.515666 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503002 5078 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 20:03:45.515666 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503004 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 20:03:45.515666 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503007 5078 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 20:03:45.515666 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503009 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 20:03:45.515666 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503012 5078 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 20:03:45.515666 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503014 5078 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 20:03:45.515666 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503017 5078 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 20:03:45.515666 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503019 5078 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 20:03:45.515666 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503022 5078 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 20:03:45.515666 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503025 5078 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 20:03:45.515666 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503027 5078 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 20:03:45.515666 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503030 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 20:03:45.515666 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503032 5078 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 20:03:45.516240 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503035 5078 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 20:03:45.516240 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503038 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 20:03:45.516240 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503042 5078 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 20:03:45.516240 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503045 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 20:03:45.516240 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503047 5078 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 20:03:45.516240 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503050 5078 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 20:03:45.516240 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503052 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 20:03:45.516240 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503055 5078 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 20:03:45.516240 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503058 5078 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 20:03:45.516240 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503060 5078 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 20:03:45.516240 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503064 5078 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 20:03:45.516240 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503067 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 20:03:45.516240 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503069 5078 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 20:03:45.516240 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503072 5078 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 20:03:45.516240 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503075 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 20:03:45.516240 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503078 5078 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 20:03:45.516240 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503081 5078 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 20:03:45.516240 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503083 5078 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 20:03:45.516240 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503086 5078 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 20:03:45.516860 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503088 5078 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 20:03:45.516860 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503091 5078 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 20:03:45.516860 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503093 5078 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 20:03:45.516860 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503096 5078 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 20:03:45.516860 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503098 5078 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 20:03:45.516860 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503101 5078 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 20:03:45.516860 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503103 5078 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 20:03:45.516860 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503106 5078 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 20:03:45.516860 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503109 5078 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 20:03:45.516860 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503111 5078 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 20:03:45.516860 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503114 5078 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 20:03:45.516860 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503116 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 20:03:45.516860 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503119 5078 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 20:03:45.516860 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503122 5078 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 20:03:45.516860 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503124 5078 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 20:03:45.516860 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503128 5078 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 20:03:45.516860 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503132 5078 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 20:03:45.516860 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503134 5078 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 20:03:45.516860 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503137 5078 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 20:03:45.516860 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503140 5078 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 20:03:45.517505 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503142 5078 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 20:03:45.517505 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503145 5078 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 20:03:45.517505 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503148 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 20:03:45.517505 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503151 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 20:03:45.517505 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503154 5078 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 20:03:45.517505 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503157 5078 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 20:03:45.517505 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503159 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 20:03:45.517505 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503162 5078 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 20:03:45.517505 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503165 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 20:03:45.517505 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503168 5078 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 20:03:45.517505 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503170 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 20:03:45.517505 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503173 5078 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 20:03:45.517505 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503175 5078 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 20:03:45.517505 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503178 5078 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 20:03:45.517505 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503181 5078 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 20:03:45.517914 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.503206 5078 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 20:03:45.517914 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503241 5078 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 20:03:45.517914 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503246 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 20:03:45.517914 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503249 5078 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 20:03:45.517914 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503252 5078 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 20:03:45.517914 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503255 5078 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 20:03:45.517914 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503258 5078 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 20:03:45.517914 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503260 5078 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 20:03:45.517914 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503264 5078 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 20:03:45.517914 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503268 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 20:03:45.517914 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503271 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 20:03:45.517914 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503274 5078 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 20:03:45.517914 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503278 5078 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 20:03:45.517914 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503282 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 20:03:45.517914 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503285 5078 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 20:03:45.518394 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503288 5078 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 20:03:45.518394 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503290 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 20:03:45.518394 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503293 5078 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 20:03:45.518394 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503296 5078 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 20:03:45.518394 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503298 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 20:03:45.518394 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503302 5078 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 20:03:45.518394 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503305 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 20:03:45.518394 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503307 5078 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 20:03:45.518394 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503310 5078 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 20:03:45.518394 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503312 5078 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 20:03:45.518394 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503316 5078 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 20:03:45.518394 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503318 5078 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 20:03:45.518394 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503321 5078 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 20:03:45.518394 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503323 5078 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 20:03:45.518394 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503339 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 20:03:45.518394 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503343 5078 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 20:03:45.518394 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503346 5078 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 20:03:45.518394 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503349 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 20:03:45.518394 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503351 5078 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 20:03:45.518394 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503354 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 20:03:45.518991 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503357 5078 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 20:03:45.518991 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503359 5078 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 20:03:45.518991 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503362 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 20:03:45.518991 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503365 5078 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 20:03:45.518991 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503368 5078 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 20:03:45.518991 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503370 5078 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 20:03:45.518991 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503373 5078 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 20:03:45.518991 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503376 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 20:03:45.518991 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503379 5078 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 20:03:45.518991 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503381 5078 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 20:03:45.518991 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503384 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 20:03:45.518991 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503387 5078 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 20:03:45.518991 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503390 5078 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 20:03:45.518991 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503392 5078 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 20:03:45.518991 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503395 5078 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 20:03:45.518991 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503398 5078 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 20:03:45.518991 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503400 5078 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 20:03:45.518991 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503404 5078 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 20:03:45.518991 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503407 5078 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 20:03:45.519659 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503409 5078 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 20:03:45.519659 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503412 5078 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 20:03:45.519659 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503415 5078 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 20:03:45.519659 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503417 5078 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 20:03:45.519659 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503422 5078 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 20:03:45.519659 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503425 5078 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 20:03:45.519659 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503428 5078 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 20:03:45.519659 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503430 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 20:03:45.519659 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503433 5078 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 20:03:45.519659 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503436 5078 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 20:03:45.519659 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503438 5078 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 20:03:45.519659 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503441 5078 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 20:03:45.519659 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503444 5078 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 20:03:45.519659 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503446 5078 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 20:03:45.519659 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503449 5078 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 20:03:45.519659 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503451 5078 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 20:03:45.519659 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503454 5078 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 20:03:45.519659 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503457 5078 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 20:03:45.519659 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503459 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 20:03:45.519659 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503462 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 20:03:45.520147 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503464 5078 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 20:03:45.520147 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503467 5078 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 20:03:45.520147 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503470 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 20:03:45.520147 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503472 5078 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 20:03:45.520147 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503475 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 20:03:45.520147 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503477 5078 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 20:03:45.520147 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503480 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 20:03:45.520147 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503482 5078 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 20:03:45.520147 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503485 5078 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 20:03:45.520147 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503488 5078 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 20:03:45.520147 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503492 5078 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 20:03:45.520147 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503494 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 20:03:45.520147 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503497 5078 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 20:03:45.520147 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503499 5078 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 20:03:45.520147 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503502 5078 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 20:03:45.520147 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503506 5078 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 20:03:45.520147 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503509 5078 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 20:03:45.520147 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503513 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 20:03:45.520147 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503517 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 20:03:45.520147 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503520 5078 feature_gate.go:386] unrecognized feature gate: Example Oct 30 20:03:45.520681 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503522 5078 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 20:03:45.520681 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503525 5078 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 20:03:45.520681 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503527 5078 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 20:03:45.520681 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503531 5078 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 20:03:45.520681 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503534 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 20:03:45.520681 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503536 5078 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 20:03:45.520681 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503539 5078 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 20:03:45.520681 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503541 5078 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 20:03:45.520681 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503544 5078 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 20:03:45.520681 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503546 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 20:03:45.520681 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503549 5078 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 20:03:45.520681 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503551 5078 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 20:03:45.520681 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.503554 5078 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 20:03:45.520681 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.507749 5078 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 20:03:45.520681 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.507766 5078 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 20:03:45.520681 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.507784 5078 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 20:03:45.520681 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.507789 5078 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 20:03:45.520681 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507870 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 20:03:45.520681 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507875 5078 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 20:03:45.520681 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507879 5078 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 20:03:45.521181 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507883 5078 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 20:03:45.521181 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507886 5078 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 20:03:45.521181 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507889 5078 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 20:03:45.521181 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507892 5078 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 20:03:45.521181 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507895 5078 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 20:03:45.521181 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507899 5078 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 20:03:45.521181 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507903 5078 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 20:03:45.521181 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507907 5078 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 20:03:45.521181 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507910 5078 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 20:03:45.521181 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507919 5078 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 20:03:45.521181 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507922 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 20:03:45.521181 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507925 5078 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 20:03:45.521181 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507927 5078 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 20:03:45.521181 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507930 5078 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 20:03:45.521181 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507933 5078 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 20:03:45.521181 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507935 5078 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 20:03:45.521181 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507938 5078 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 20:03:45.521181 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507941 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 20:03:45.521181 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507943 5078 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 20:03:45.521181 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507946 5078 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 20:03:45.521702 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507948 5078 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 20:03:45.521702 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507951 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 20:03:45.521702 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507954 5078 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 20:03:45.521702 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507957 5078 feature_gate.go:386] unrecognized feature gate: Example Oct 30 20:03:45.521702 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507960 5078 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 20:03:45.521702 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507962 5078 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 20:03:45.521702 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507965 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 20:03:45.521702 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507968 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 20:03:45.521702 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507970 5078 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 20:03:45.521702 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507973 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 20:03:45.521702 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507976 5078 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 20:03:45.521702 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507978 5078 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 20:03:45.521702 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507981 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 20:03:45.521702 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507983 5078 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 20:03:45.521702 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507986 5078 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 20:03:45.521702 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507989 5078 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 20:03:45.521702 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507992 5078 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 20:03:45.521702 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507995 5078 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 20:03:45.521702 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.507998 5078 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 20:03:45.522215 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508000 5078 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 20:03:45.522215 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508003 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 20:03:45.522215 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508005 5078 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 20:03:45.522215 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508014 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 20:03:45.522215 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508017 5078 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 20:03:45.522215 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508019 5078 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 20:03:45.522215 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508022 5078 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 20:03:45.522215 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508024 5078 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 20:03:45.522215 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508027 5078 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 20:03:45.522215 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508030 5078 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 20:03:45.522215 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508032 5078 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 20:03:45.522215 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508035 5078 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 20:03:45.522215 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508038 5078 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 20:03:45.522215 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508040 5078 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 20:03:45.522215 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508043 5078 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 20:03:45.522215 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508046 5078 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 20:03:45.522215 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508048 5078 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 20:03:45.522215 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508051 5078 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 20:03:45.522215 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508054 5078 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 20:03:45.522215 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508056 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 20:03:45.522733 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508059 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 20:03:45.522733 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508062 5078 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 20:03:45.522733 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508064 5078 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 20:03:45.522733 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508067 5078 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 20:03:45.522733 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508069 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 20:03:45.522733 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508072 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 20:03:45.522733 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508075 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 20:03:45.522733 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508078 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 20:03:45.522733 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508080 5078 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 20:03:45.522733 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508083 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 20:03:45.522733 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508086 5078 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 20:03:45.522733 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508088 5078 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 20:03:45.522733 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508091 5078 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 20:03:45.522733 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508094 5078 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 20:03:45.522733 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508096 5078 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 20:03:45.522733 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508099 5078 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 20:03:45.522733 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508107 5078 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 20:03:45.522733 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508110 5078 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 20:03:45.522733 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508112 5078 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 20:03:45.522733 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508115 5078 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 20:03:45.523242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508118 5078 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 20:03:45.523242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508120 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 20:03:45.523242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508123 5078 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 20:03:45.523242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508125 5078 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 20:03:45.523242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508128 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 20:03:45.523242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508131 5078 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 20:03:45.523242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508134 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 20:03:45.523242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508136 5078 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 20:03:45.523242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508139 5078 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 20:03:45.523242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508142 5078 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 20:03:45.523242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508144 5078 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 20:03:45.523242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508147 5078 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 20:03:45.523242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508149 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 20:03:45.523242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508152 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 20:03:45.523242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508154 5078 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 20:03:45.523242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508157 5078 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 20:03:45.523242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508160 5078 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 20:03:45.523242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508162 5078 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 20:03:45.523242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508164 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 20:03:45.523849 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508167 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 20:03:45.523849 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508170 5078 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 20:03:45.523849 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508172 5078 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 20:03:45.523849 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508175 5078 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 20:03:45.523849 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508178 5078 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 20:03:45.523849 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.508206 5078 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 20:03:45.523849 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508466 5078 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 20:03:45.523849 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508474 5078 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 20:03:45.523849 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508477 5078 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 20:03:45.523849 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508481 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 20:03:45.523849 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508490 5078 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 20:03:45.523849 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508493 5078 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 20:03:45.523849 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508495 5078 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 20:03:45.523849 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508498 5078 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 20:03:45.523849 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508500 5078 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 20:03:45.523849 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508503 5078 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 20:03:45.524246 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508506 5078 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 20:03:45.524246 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508508 5078 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 20:03:45.524246 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508511 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 20:03:45.524246 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508513 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 20:03:45.524246 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508516 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 20:03:45.524246 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508519 5078 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 20:03:45.524246 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508522 5078 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 20:03:45.524246 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508525 5078 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 20:03:45.524246 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508527 5078 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 20:03:45.524246 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508530 5078 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 20:03:45.524246 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508533 5078 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 20:03:45.524246 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508535 5078 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 20:03:45.524246 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508538 5078 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 20:03:45.524246 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508540 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 20:03:45.524246 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508543 5078 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 20:03:45.524246 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508546 5078 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 20:03:45.524246 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508548 5078 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 20:03:45.524246 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508551 5078 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 20:03:45.524246 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508553 5078 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 20:03:45.524820 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508556 5078 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 20:03:45.524820 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508559 5078 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 20:03:45.524820 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508561 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 20:03:45.524820 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508564 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 20:03:45.524820 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508567 5078 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 20:03:45.524820 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508569 5078 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 20:03:45.524820 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508572 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 20:03:45.524820 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508574 5078 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 20:03:45.524820 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508584 5078 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 20:03:45.524820 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508587 5078 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 20:03:45.524820 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508589 5078 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 20:03:45.524820 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508591 5078 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 20:03:45.524820 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508594 5078 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 20:03:45.524820 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508597 5078 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 20:03:45.524820 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508599 5078 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 20:03:45.524820 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508602 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 20:03:45.524820 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508605 5078 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 20:03:45.524820 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508607 5078 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 20:03:45.524820 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508610 5078 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 20:03:45.525295 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508612 5078 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 20:03:45.525295 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508615 5078 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 20:03:45.525295 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508617 5078 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 20:03:45.525295 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508620 5078 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 20:03:45.525295 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508622 5078 feature_gate.go:386] unrecognized feature gate: Example Oct 30 20:03:45.525295 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508625 5078 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 20:03:45.525295 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508628 5078 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 20:03:45.525295 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508630 5078 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 20:03:45.525295 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508633 5078 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 20:03:45.525295 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508636 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 20:03:45.525295 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508639 5078 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 20:03:45.525295 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508643 5078 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 20:03:45.525295 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508646 5078 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 20:03:45.525295 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508649 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 20:03:45.525295 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508652 5078 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 20:03:45.525295 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508654 5078 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 20:03:45.525295 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508657 5078 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 20:03:45.525295 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508660 5078 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 20:03:45.525295 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508662 5078 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 20:03:45.525779 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508665 5078 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 20:03:45.525779 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508667 5078 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 20:03:45.525779 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508670 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 20:03:45.525779 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508678 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 20:03:45.525779 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508681 5078 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 20:03:45.525779 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508684 5078 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 20:03:45.525779 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508686 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 20:03:45.525779 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508689 5078 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 20:03:45.525779 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508694 5078 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 20:03:45.525779 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508696 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 20:03:45.525779 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508700 5078 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 20:03:45.525779 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508705 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 20:03:45.525779 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508708 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 20:03:45.525779 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508710 5078 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 20:03:45.525779 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508713 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 20:03:45.525779 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508716 5078 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 20:03:45.525779 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508718 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 20:03:45.525779 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508721 5078 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 20:03:45.525779 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508723 5078 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 20:03:45.526285 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508726 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 20:03:45.526285 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508729 5078 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 20:03:45.526285 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508731 5078 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 20:03:45.526285 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508734 5078 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 20:03:45.526285 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508737 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 20:03:45.526285 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508739 5078 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 20:03:45.526285 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508744 5078 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 20:03:45.526285 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508747 5078 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 20:03:45.526285 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508749 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 20:03:45.526285 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508752 5078 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 20:03:45.526285 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508754 5078 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 20:03:45.526285 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508757 5078 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 20:03:45.526285 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508760 5078 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 20:03:45.526285 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508762 5078 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 20:03:45.526285 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508766 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 20:03:45.526285 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508771 5078 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 20:03:45.526285 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508775 5078 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 20:03:45.526285 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508791 5078 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 20:03:45.526285 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508796 5078 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 20:03:45.526285 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508799 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 20:03:45.526799 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.508825 5078 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 20:03:45.526799 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508880 5078 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 20:03:45.526799 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508885 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 20:03:45.526799 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508888 5078 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 20:03:45.526799 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508891 5078 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 20:03:45.526799 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508893 5078 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 20:03:45.526799 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508896 5078 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 20:03:45.526799 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508899 5078 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 20:03:45.526799 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508902 5078 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 20:03:45.526799 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508905 5078 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 20:03:45.526799 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508907 5078 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 20:03:45.526799 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508910 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 20:03:45.526799 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508912 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 20:03:45.526799 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508915 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 20:03:45.526799 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508918 5078 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 20:03:45.526799 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508921 5078 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 20:03:45.527211 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508924 5078 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 20:03:45.527211 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508926 5078 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 20:03:45.527211 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508929 5078 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 20:03:45.527211 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508934 5078 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 20:03:45.527211 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508938 5078 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 20:03:45.527211 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508942 5078 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 20:03:45.527211 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508947 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 20:03:45.527211 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508951 5078 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 20:03:45.527211 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508954 5078 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 20:03:45.527211 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508956 5078 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 20:03:45.527211 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508959 5078 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 20:03:45.527211 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508962 5078 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 20:03:45.527211 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508964 5078 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 20:03:45.527211 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508967 5078 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 20:03:45.527211 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508976 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 20:03:45.527211 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508979 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 20:03:45.527211 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508982 5078 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 20:03:45.527211 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508985 5078 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 20:03:45.527211 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508988 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 20:03:45.527732 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508990 5078 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 20:03:45.527732 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508993 5078 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 20:03:45.527732 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508996 5078 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 20:03:45.527732 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.508998 5078 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 20:03:45.527732 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509001 5078 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 20:03:45.527732 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509004 5078 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 20:03:45.527732 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509006 5078 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 20:03:45.527732 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509009 5078 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 20:03:45.527732 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509011 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 20:03:45.527732 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509015 5078 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 20:03:45.527732 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509019 5078 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 20:03:45.527732 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509023 5078 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 20:03:45.527732 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509028 5078 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 20:03:45.527732 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509031 5078 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 20:03:45.527732 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509034 5078 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 20:03:45.527732 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509036 5078 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 20:03:45.527732 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509040 5078 feature_gate.go:386] unrecognized feature gate: Example Oct 30 20:03:45.527732 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509043 5078 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 20:03:45.527732 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509046 5078 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 20:03:45.527732 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509049 5078 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 20:03:45.528242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509052 5078 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 20:03:45.528242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509054 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 20:03:45.528242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509058 5078 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 20:03:45.528242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509062 5078 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 20:03:45.528242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509065 5078 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 20:03:45.528242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509068 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 20:03:45.528242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509071 5078 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 20:03:45.528242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509073 5078 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 20:03:45.528242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509085 5078 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 20:03:45.528242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509088 5078 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 20:03:45.528242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509090 5078 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 20:03:45.528242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509094 5078 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 20:03:45.528242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509098 5078 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 20:03:45.528242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509103 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 20:03:45.528242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509107 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 20:03:45.528242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509109 5078 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 20:03:45.528242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509112 5078 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 20:03:45.528242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509114 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 20:03:45.528242 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509117 5078 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 20:03:45.528939 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509120 5078 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 20:03:45.528939 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509122 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 20:03:45.528939 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509127 5078 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 20:03:45.528939 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509130 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 20:03:45.528939 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509134 5078 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 20:03:45.528939 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509137 5078 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 20:03:45.528939 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509140 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 20:03:45.528939 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509142 5078 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 20:03:45.528939 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509145 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 20:03:45.528939 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509149 5078 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 20:03:45.528939 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509152 5078 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 20:03:45.528939 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509154 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 20:03:45.528939 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509157 5078 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 20:03:45.528939 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509160 5078 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 20:03:45.528939 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509163 5078 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 20:03:45.528939 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509165 5078 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 20:03:45.528939 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509168 5078 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 20:03:45.528939 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509172 5078 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 20:03:45.528939 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509176 5078 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 20:03:45.529703 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509181 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 20:03:45.529703 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509192 5078 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 20:03:45.529703 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509195 5078 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 20:03:45.529703 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509205 5078 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 20:03:45.529703 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509208 5078 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 20:03:45.529703 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509211 5078 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 20:03:45.529703 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509213 5078 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 20:03:45.529703 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509216 5078 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 20:03:45.529703 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509218 5078 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 20:03:45.529703 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509221 5078 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 20:03:45.529703 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509224 5078 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 20:03:45.529703 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509226 5078 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 20:03:45.529703 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509229 5078 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 20:03:45.529703 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:45.509233 5078 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 20:03:45.529703 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.509292 5078 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 20:03:45.529703 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.512427 5078 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Oct 30 20:03:45.529703 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.512503 5078 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 30 20:03:45.529703 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.512798 5078 server.go:1014] "Starting client certificate rotation" Oct 30 20:03:45.529703 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.512923 5078 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 20:03:45.530274 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.512976 5078 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 19:58:02 +0000 UTC" deadline="2028-04-15 21:12:28.053753915 +0000 UTC" Oct 30 20:03:45.530274 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.513004 5078 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12793h8m42.540752438s" Oct 30 20:03:45.530274 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.513544 5078 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 20:03:45.530274 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.515309 5078 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 20:03:45.530274 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.516595 5078 log.go:25] "Validated CRI v1 runtime API" Oct 30 20:03:45.530274 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.518306 5078 log.go:25] "Validated CRI v1 image API" Oct 30 20:03:45.530274 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.519025 5078 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 20:03:45.530274 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.521025 5078 fs.go:135] Filesystem UUIDs: map[0b9c55da-2e89-4cab-89d9-24bb4d47ffb9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7c77a14d-f6b9-4e08-bfb1-44d3997a17aa:/dev/nvme0n1p4] Oct 30 20:03:45.530566 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.521046 5078 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0be6720bf54e45526d7b411465dbb59399d96ea97ffc361a16c2d7308d71044f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0be6720bf54e45526d7b411465dbb59399d96ea97ffc361a16c2d7308d71044f/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0c524506c6844ccd84e0c8f223c0dd6f2faa58c813b8d23a2b36c9bd15c51da0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0c524506c6844ccd84e0c8f223c0dd6f2faa58c813b8d23a2b36c9bd15c51da0/userdata/shm major:0 minor:340 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/12a8bde498ee3f14827b8ff9662c5ea7765ea171e601dc973f2836de752851ab/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/12a8bde498ee3f14827b8ff9662c5ea7765ea171e601dc973f2836de752851ab/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/208d31340929213c2e8e7364a9a8d5cea18b913b39921a385a3c5b25f37953de/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/208d31340929213c2e8e7364a9a8d5cea18b913b39921a385a3c5b25f37953de/userdata/shm major:0 minor:310 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/249a58cfe615161e0c5f34eef91fcf7ca53cf693debfc4ea4a621880ff4a908a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/249a58cfe615161e0c5f34eef91fcf7ca53cf693debfc4ea4a621880ff4a908a/userdata/shm major:0 minor:234 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2a70624f76cbfc8d2726b77b502ef5060ca1b06bd4e5b9b8eb32ec6fa340289d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2a70624f76cbfc8d2726b77b502ef5060ca1b06bd4e5b9b8eb32ec6fa340289d/userdata/shm major:0 minor:296 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2c3248e11effa8401bfbdf8863f1f12ee5383c987c4d745a8c7d94b2d45b1de1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2c3248e11effa8401bfbdf8863f1f12ee5383c987c4d745a8c7d94b2d45b1de1/userdata/shm major:0 minor:230 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8087d186464b3111c28de8068816ab6edc3abecac3bb35e7927728d803a7e457/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8087d186464b3111c28de8068816ab6edc3abecac3bb35e7927728d803a7e457/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/83569e0f3f3c833e2b4533d25bc58421c22c2ea556096f2ef757f6d4903df1c9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/83569e0f3f3c833e2b4533d25bc58421c22c2ea556096f2ef757f6d4903df1c9/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/893a1bf6e8d077f2fb6f9e55470d5d3efc7a40dd8bd63f290c476b4b0e0d3742/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/893a1bf6e8d077f2fb6f9e55470d5d3efc7a40dd8bd63f290c476b4b0e0d3742/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8a43513eaeac2f133ea80b861ce261ab15b0c07dae379980f8584d800fe8b123/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8a43513eaeac2f133ea80b861ce261ab15b0c07dae379980f8584d800fe8b123/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/923b77654cdccbede2198a35b11c9f8a675a265500dc5c00ec5676af62533704/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/923b77654cdccbede2198a35b11c9f8a675a265500dc5c00ec5676af62533704/userdata/shm major:0 minor:342 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/92c970e1df14ad98487d0f35ec59d224f4d8209c6e3bd748910a3aef9d2804b8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/92c970e1df14ad98487d0f35ec59d224f4d8209c6e3bd748910a3aef9d2804b8/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9f975a3b11e1e139184bad1d22d45b0046129a9ca0bb480ab6564bf5272bf68d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9f975a3b11e1e139184bad1d22d45b0046129a9ca0bb480ab6564bf5272bf68d/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a959734ab7f3bd0f5152b51b0ad36a121822ce27595256ce13ae777f35afd792/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a959734ab7f3bd0f5152b51b0ad36a121822ce27595256ce13ae777f35afd792/userdata/shm major:0 minor:228 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/aa907cc6d48f34d4ca30164a69e2fa072c65fd20df45e04823ae90262e667889/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/aa907cc6d48f34d4ca30164a69e2fa072c65fd20df45e04823ae90262e667889/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b8f3f28d5b76156ba3d153f22b582bfd1646174540202df9682a6aa1bd780612/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b8f3f28d5b76156ba3d153f22b582bfd1646174540202df9682a6aa1bd780612/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bde0c876d0985d2fbefc7fdb46a7a94dadaf157d085859cc86ecc627d3261a63/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bde0c876d0985d2fbefc7fdb46a7a94dadaf157d085859cc86ecc627d3261a63/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d4855521a8fd7fbe3df2536038291b21c212a53ac0d8dbbe9b6a0da401132f8e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d4855521a8fd7fbe3df2536038291b21c212a53ac0d8dbbe9b6a0da401132f8e/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e16a56a652f650f0e5f57b669d048e0b9d275ecb8e983bac9dcd4921c35dca0f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e16a56a652f650f0e5f57b669d048e0b9d275ecb8e983bac9dcd4921c35dca0f/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e2aa29bcb30843d9c098e8ef496822e709e2f1874bd80a4c5d1baf020427aaee/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e2aa29bcb30843d9c098e8ef496822e709e2f1874bd80a4c5d1baf020427aaee/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e80e69eb675a654c64413896124bacb23bcf0205a897312c2043ead6ffa7a9ed/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e80e69eb675a654c64413896124bacb23bcf0205a897312c2043ead6ffa7a9ed/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e9fd457133bc0eb0f8fe85226bae5306358f5acde9a1829ea334a2667d6d45a4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e9fd457133bc0eb0f8fe85226bae5306358f5acde9a1829ea334a2667d6d45a4/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fa10fbaba8687e9e16c8165832a2ff5da4e11ed632cdf6bc45f673d551dcef99/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fa10fbaba8687e9e16c8165832a2ff5da4e11ed632cdf6bc45f673d551dcef99/userdata/shm major:0 minor:239 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fbf231f4ba8bcffc7c74df21cf0d38b69a58464c5b212ab941da3605cf17115b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fbf231f4ba8bcffc7c74df21cf0d38b69a58464c5b212ab941da3605cf17115b/userdata/shm major:0 minor:350 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ff9ae114405803b5e237564cc7ffb19d0dce24272b5bafcd04a660d7da9d173d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ff9ae114405803b5e237564cc7ffb19d0dce24272b5bafcd04a660d7da9d173d/userdata/shm major:0 minor:294 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/14006e48-475b-4dbe-8994-1f908f897884/volumes/kubernetes.io~projected/kube-api-access-q6m8f:{mountpoint:/var/lib/kubelet/pods/14006e48-475b-4dbe-8994-1f908f897884/volumes/kubernetes.io~projected/kube-api-access-q6m8f major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1696437d-23f3-4078-afc4-69e3a94f5ec7/volumes/kubernetes.io~projected/kube-api-access-mww9f:{mountpoint:/var/lib/kubelet/pods/1696437d-23f3-4078-afc4-69e3a94f5ec7/volumes/kubernetes.io~projected/kube-api-access-mww9f major:0 minor:334 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1f847152-ec65-4b3c-bcb6-d8cac177e31d/volumes/kubernetes.io~projected/kube-api-access-9px9m:{mountpoint:/var/lib/kubelet/pods/1f847152-ec65-4b3c-bcb6-d8cac177e31d/volumes/kubernetes.io~projected/kube-api-access-9px9m major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/20ba9ea0-10d3-419c-a429-3a6dcf153171/volumes/kubernetes.io~projected/kube-api-access-jq82v:{mountpoint:/var/lib/kubelet/pods/20ba9ea0-10d3-419c-a429-3a6dcf153171/volumes/kubernetes.io~projected/kube-api-access-jq82v major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/20ba9ea0-10d3-419c-a429-3a6dcf153171/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/20ba9ea0-10d3-419c-a429-3a6dcf153171/volumes/kubernetes.io~secret/serving-cert major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/22e3da9c-5201-4bd9-b247-1caaa18f5d7d/volumes/kubernetes.io~projected/kube-api-access-rvqn4:{mountpoint:/var/lib/kubelet/pods/22e3da9c-5201-4bd9-b247-1caaa18f5d7d/volumes/kubernetes.io~projected/kube-api-access-rvqn4 major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/22e3da9c-5201-4bd9-b247-1caaa18f5d7d/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/22e3da9c-5201-4bd9-b247-1caaa18f5d7d/volumes/kubernetes.io~secret/cert major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/24b57f65-bf27-4659-a922-83a241893696/volumes/kubernetes.io~projected/kube-api-access-4b644:{mountpoint:/var/lib/kubelet/pods/24b57f65-bf27-4659-a922-83a241893696/volumes/kubernetes.io~projected/kube-api-access-4b644 major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/27e4937d-367a-4ccc-9580-74a3982a49fe/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/27e4937d-367a-4ccc-9580-74a3982a49fe/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/27e4937d-367a-4ccc-9580-74a3982a49fe/volumes/kubernetes.io~projected/kube-api-access-qzghk:{mountpoint:/var/lib/kubelet/pods/27e4937d-367a-4ccc-9580-74a3982a49fe/volumes/kubernetes.io~projected/kube-api-access-qzghk major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/27e4937d-367a-4ccc-9580-74a3982a49fe/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/27e4937d-367a-4ccc-9580-74a3982a49fe/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/27e4937d-367a-4ccc-9580-74a3982a49fe/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/27e4937d-367a-4ccc-9580-74a3982a49fe/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/285be4c1-3c4f-4972-b8fa-7f37f92d72bb/volumes/kubernetes.io~projected/kube-api-access-zr5cv:{mountpoint:/var/lib/kubelet/pods/285be4c1-3c4f-4972-b8fa-7f37f92d72bb/volumes/kubernetes.io~projected/kube-api-access-zr5cv major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/28ba2930-e73c-4716-b061-d7cb2bbd0400/volumes/kubernetes.io~projected/kube-api-access-jncv5:{mountpoint:/var/lib/kubelet/pods/28ba2930-e73c-4716-b061-d7cb2bbd0400/volumes/kubernetes.io~projected/kube-api-access-jncv5 major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2e5941e6-4fc9-4353-a518-8ad492e9ad61/volumes/kubernetes.io~projected/kube-api-access-jlxdg:{mountpoint:/var/lib/kubelet/pods/2e5941e6-4fc9-4353-a518-8ad492e9ad61/volumes/kubernetes.io~projected/kube-api-access-jlxdg major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2e5941e6-4fc9-4353-a518-8ad492e9ad61/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/2e5941e6-4fc9-4353-a518-8ad492e9ad61/volumes/kubernetes.io~secret/default-certificate major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2e5941e6-4fc9-4353-a518-8ad492e9ad61/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/2e5941e6-4fc9-4353-a518-8ad492e9ad61/volumes/kubernetes.io~secret/stats-auth major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/364408a3-5d56-4e76-9c96-a2a08841b50f/volumes/kubernetes.io~projected/kube-api-access-nfdr6:{mountpoint:/var/lib/kubelet/pods/364408a3-5d56-4e76-9c96-a2a08841b50f/volumes/kubernetes.io~projected/kube-api-access-nfdr6 major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a/volumes/kubernetes.io~projected/kube-api-access-8s8zr:{mountpoint:/var/lib/kubelet/pods/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a/volumes/kubernetes.io~projected/kube-api-access-8s8zr major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4ac859bf-692b-4447-891a-32541e1e244d/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/4ac859bf-692b-4447-891a-32541e1e244d/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4ac859bf-692b-4447-891a-32541e1e244d/volumes/kubernetes.io~projected/kube-api-access-fsbbs:{mountpoint:/var/lib/kubelet/pods/4ac859bf-692b-4447-891a-32541e1e244d/volumes/kubernetes.io~projected/kube-api-access-fsbbs major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4ac859bf-692b-4447-891a-32541e1e244d/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/4ac859bf-692b-4447-891a-32541e1e244d/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4ac859bf-692b-4447-891a-32541e1e244d/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/4ac859bf-692b-4447-891a-32541e1e244d/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6ce6c965-80be-4c82-826c-a9dc4dd19592/volumes/kubernetes.io~projected/kube-api-access-ssghm:{mountpoint:/var/lib/kubelet/pods/6ce6c965-80be-4c82-826c-a9dc4dd19592/volumes/kubernetes.io~projected/kube-api-access-ssghm major:0 minor:345 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6ce6c965-80be-4c82-826c-a9dc4dd19592/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/6ce6c965-80be-4c82-826c-a9dc4dd19592/volumes/kubernetes.io~secret/signing-key major:0 minor:344 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7f941d6e-cd94-47d5-a641-fb608c05a903/volumes/kubernetes.io~projected/kube-api-access-bb7sg:{mountpoint:/var/lib/kubelet/pods/7f941d6e-cd94-47d5-a641-fb608c05a903/volumes/kubernetes.io~projected/kube-api-access-bb7sg major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e/volumes/kubernetes.io~projected/kube-api-access-xnl5q:{mountpoint:/var/lib/kubelet/pods/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e/volumes/kubernetes.io~projected/kube-api-access-xnl5q major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/93a3069b-7891-4146-a085-7b218eeff695/volumes/kubernetes.io~projected/kube-api-access-2nkhw:{mountpoint:/var/lib/kubelet/pods/93a3069b-7891-4146-a085-7b218eeff695/volumes/kubernetes.io~projected/kube-api-access-2nkhw major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9dabf5d4-7787-40b3-b01e-fe430c316887/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/9dabf5d4-7787-40b3-b01e-fe430c316887/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a7d2c4e7-accb-4388-97c7-62c0b40ebb4c/volumes/kubernetes.io~projected/kube-api-access-r2cpl:{mountpoint:/var/lib/kubelet/pods/a7d2c4e7-accb-4388-97c7-62c0b40ebb4c/volumes/kubernetes.io~projected/kube-api-access-r2cpl major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/adb774f6-0266-4c60-92e9-f0a5f8ac831e/volumes/kubernetes.io~projected/kube-api-access-qnfwb:{mountpoint:/var/lib/kubelet/pods/adb774f6-0266-4c60-92e9-f0a5f8ac831e/volumes/kubernetes.io~projected/kube-api-access-qnfwb major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/adb774f6-0266-4c60-92e9-f0a5f8ac831e/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/adb774f6-0266-4c60-92e9-f0a5f8ac831e/volumes/kubernetes.io~secret/serving-cert major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc/volumes/kubernetes.io~projected/kube-api-access-kgk5m:{mountpoint:/var/lib/kubelet/pods/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc/volumes/kubernetes.io~projected/kube-api-access-kgk5m major:0 minor:315 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bea5c7b2-5ad1-43f5-8f43-07e3af665d6a/volumes/kubernetes.io~projected/kube-api-access-hl424:{mountpoint:/var/lib/kubelet/pods/bea5c7b2-5ad1-43f5-8f43-07e3af665d6a/volumes/kubernetes.io~projected/kube-api-access-hl424 major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/caeeb8a7-4283-4c38-b3be-c036eeeceb65/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/caeeb8a7-4283-4c38-b3be-c036eeeceb65/volumes/kubernetes.io~secret/agent-certs major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45/volumes/kubernetes.io~projected/kube-api-access-mf4tm:{mountpoint:/var/lib/kubelet/pods/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45/volumes/kubernetes.io~projected/kube-api-access-mf4tm major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d4452f26-53ff-4b31-9417-f550aa50c38d/volumes/kubernetes.io~projected/kube-api-access-qsppj:{mountpoint:/var/lib/kubelet/pods/d4452f26-53ff-4b31-9417-f550aa50c38d/volumes/kubernetes.io~projected/kube-api-access-qsppj major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e8af5bdb-cf19-4210-85c0-815d452cb701/volumes/kubernetes.io~projected/kube-api-access-spmg8:{mountpoint:/var/lib/kubelet/pods/e8af5bdb-cf19-4210-85c0-815d452cb701/volumes/kubernetes.io~projected/kube-api-access-spmg8 major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e8af5bdb-cf19-4210-85c0-815d452cb701/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/e8af5bdb-cf19-4210-85c0-815d452cb701/volumes/kubernetes.io~secret/serving-cert major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ee5e6319-c93c-4713-b99c-9e5660af5192/volumes/kubernetes.io~projected/kube-api-access-tjzcw:{mountpoint:/var/lib/kubelet/pods/ee5e6319-c93c-4713-b99c-9e5660af5192/volumes/kubernetes.io~projected/kube-api-access-tjzcw major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ee5e6319-c93c-4713-b99c-9e5660af5192/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/ee5e6319-c93c-4713-b99c-9e5660af5192/volumes/kubernetes.io~secret/serving-cert major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f5dddacb-f3d8-43cc-9191-c9f63e56db20/volumes/kubernetes.io~projected/kube-api-access-44fgw:{mountpoint:/var/lib/kubelet/pods/f5dddacb-f3d8-43cc-9191-c9f63e56db20/volumes/kubernetes.io~projected/kube-api-access-44fgw major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f69d831c-d9e4-4060-a2bd-9d85265000f6/volumes/kubernetes.io~projected/kube-api-access-l4hpl:{mountpoint:/var/lib/kubelet/pods/f69d831c-d9e4-4060-a2bd-9d85265000f6/volumes/kubernetes.io~projected/kube-api-access-l4hpl major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f8c5839e-f557-4e1d-a26f-17102c15ff8e/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/f8c5839e-f557-4e1d-a26f-17102c15ff8e/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f8c5839e-f557-4e1d-a26f-17102c15ff8e/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/f8c5839e-f557-4e1d-a26f-17102c15ff8e/volumes/kubernetes.io~empty-dir/tmp major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f8c5839e-f557-4e1d-a26f-17102c15ff8e/volumes/kubernetes.io~projected/kube-api-access-7846l:{mountpoint:/var/lib/kubelet/pods/f8c5839e-f557-4e1d-a26f-17102c15ff8e/volumes/kubernetes.io~projected/kube-api-access-7846l major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fbfa2cf8-ef21-4485-91f3-6ca0b0b0d55d/volumes/kubernetes.io~projected/kube-api-access-tmj4v:{mountpoint:/var/lib/kubelet/pods/fbfa2cf8-ef21-4485-91f3-6ca0b0b0d55d/volumes/kubernetes.io~projected/kube-api-access-tmj4v major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fdac1f33-fb1f-4835-bbec-f34005f53979/volumes/kubernetes.io~projected/kube-api-access-rvl5j:{mountpoint:/var/lib/kubelet/pods/fdac1f33-fb1f-4835-bbec-f34005f53979/volumes/kubernetes.io~projected/kube-api-access-rvl5j major:0 minor:339 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ff5da8ed-018c-4182-82f0-a8a3266aff52/volumes/kubernetes.io~projected/kube-api-access-sk9xw:{mountpoint:/var/lib/kubelet/pods/ff5da8ed-018c-4182-82f0-a8a3266aff52/volumes/kubernetes.io~projected/kube-api-access-sk9xw major:0 minor:58 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/b4b3b2db8f56f3f1c07da7102ac2cbfced84de0efab573becd0e0e741c0cb9db/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/fcfca9e5f6489c4763ec0c8167e068635985a6c9381c1b46c2257f4072666b36/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-105:{mountpoint:/var/lib/containers/storage/overlay/f03162ec27311645af713a0f8fd713df70571cb7fb688f2d615e26fe91e3c4d2/merged major:0 minor:105 fsType:overlay blockSize:0} overlay_0-107:{mountpoint:/var/lib/containers/storage/overlay/05868971db90ef94b9569453e19afcab41a27088bb0f313d722648e8081cd3bd/merged major:0 minor:107 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/e1b82c81d47c5780f7a4ae81b8705f3ce1f5131cde8bbd9e701e167b8aad7e5a/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/f245f59b47d25b8b9a5f7f3b0be0a008744c7a4c921a7bde5be63609e9b2b51f/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/3c6e7fcdd1b16733646815f3080226f25b261e256d90841c9905bb23f23d8a9c/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/12a0f224cb3e5c029f31d479e47fe66371bd6c90c83d874a9028f15524d5c718/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/be1648c70b132e2cf39b93b940a373f21e87ec5986f0edd76088cf780103c20b/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/e887b65f19d675f82686862755ca67577065f379545098ab91b84aba15695184/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-142:{mountpoint:/var/lib/containers/storage/overlay/cce683af08326e77d5153710c80381e3484fd191d97213450fb79c7ada70c036/merged major:0 minor:142 fsType:overlay blockSize:0} overlay_0-143:{mountpoint:/var/lib/containers/storage/overlay/c3acd9b0db5c635e6c24cf393d41d7791ef052043abb7d7310a061577cff1fad/merged major:0 minor:143 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/24b166a278b77b3a6ea00c23473cb8adaa5ed636d5bbb54874c722a3a60a8039/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/4549374294d32fd7aa4f993aaeed63cae0ed32231ba18637874fb7560876101c/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/23674eb71b2d9edaa091950617b61223aaaee600d1824cf339ab8ed171867d9a/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/ab9815c11e954c52adb8cf4d6bb282f13bd4eab419295c9fa5ea932b64c191c2/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/405ba5e68a8a8fddc765953265a76be4cd48efb7e73427e78a681ec20d3010ea/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/6339979b44db489beb7b953a7d56029968234c5e5c8d5aac4b633934c6223e8e/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/767e4a2fa68e92ce8c50f20a308af027dd191eef765c3bec150abab28687acbd/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/7b95eb012686f1b7089b782fd6d2636c368ab9b038e7e882810526e8c7551651/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/f83d994b7fc90b60984e9add395781f50d417566e7270a2e57bebd336c9a718a/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/062c2dc48224549c9939f6873776819624b540204a35178a0ba6e7a3d2d0a6cd/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/10e07f62ea67461497bfc9983716bf0788b6e6bb8a2b10d9908699a2d4f1c944/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/de59384c783bdddd5b2c28dbd16be661800fe66b763a53a35cf8ed4875977cb0/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/6e507a18abc967c0e857163bf46527c88ad05c8296d314b0757375ee3ae3773a/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/63666bf2d09ac80c271f21cafc75d82e83b305dd03c4fdd6951d2b20ba7bc16b/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/c81ae6a74ee30509383773cd4893d67e3f3fca35ca534a754f8b26d0fabe9c2d/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/b79f5ada8aa4ae778b920b7452677d3de2252b8527aa043cd51e832fe53ff378/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/00a389309cd1e5b5fc0dd60d4b17654ad65ed65604b8ddcb9ce9ba3b642e7573/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-263:{mountpoint:/var/lib/containers/storage/overlay/5ed4b9755b9fbff2782d24283d5e9048ac373351545085343f0c9e1c8ce259cf/merged major:0 minor:263 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/1974d8765d0452be40a854259af5032c622f93e49662909087363573ca5a8a21/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-274:{mountpoint:/var/lib/containers/storage/overlay/21032c0bb8be864cc31eb5062b2ae3f7d9551c2680b4020ba3706b01d12c4630/merged major:0 minor:274 fsType:overlay blockSize:0} overlay_0-277:{mountpoint:/var/lib/containers/storage/overlay/496502199d5e1bf1e96963433ef2679b80d55bb73128baf3f575d1bfbafaf04f/merged major:0 minor:277 fsType:overlay blockSize:0} overlay_0-279:{mountpoint:/var/lib/containers/storage/overlay/6261ef144688f0abbd98fc9c6e7a8857496028db3398486936883621003d7cc1/merged major:0 minor:279 fsType:overlay blockSize:0} overlay_0-281:{mountpoint:/var/lib/containers/storage/overlay/ee8262efc3bf8c7c5029bb0d3e4700821c82a43e9a0c4b0cec8ce9edd03f8df8/merged major:0 minor:281 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/84c784cd68d2b081846bf665c24c23c91f91bd85e9c221660ea2d87f7a8a110c/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/47bdd5bc9d4c9478a79188b0050bcf546969054de1a48e83692ef8d7c99defb5/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/b3e930d27d534e62ee25f0ac57d3b49383e03e80bda50c5b1564356de9186ffd/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/d48bd7803b549591e8eb29c17b6981448a6b84c8aa03609cb7406aa10c057dd4/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-312:{mountpoint:/var/lib/containers/storage/overlay/4ee16d5a472d489ba566711cbdc7be0fb5722a76b6627947dad7b78b847ed332/merged major:0 minor:312 fsType:overlay blockSize:0} overlay_0-316:{mountpoint:/var/lib/containers/storage/overlay/da74f86fd5f0a42a4bb3a6bf11e845aba91c8d50b82e31f8c591e3ece32d1964/merged major:0 minor:316 fsType:overlay blockSize:0} overlay_0-319:{mountpoint:/var/lib/containers/storage/overlay/5d0912159d496d4737f70436f001212dd6f5b722a08a2a666ee1f267f6390b55/merged major:0 minor:319 fsType:overlay blockSize:0} overlay_0-332:{mountpoint:/var/lib/containers/storage/overlay/6d4a2c0b7c58b7973c2fed74b13a318b3763ae7b3056c36b4984fe2cb8be11d5/merged major:0 minor:332 fsType:overlay blockSize:0} overlay_0-346:{mountpoint:/var/lib/containers/storage/overlay/0b41b1388b112a119b2f1a6999f769622c170d4b540f6931b93dbd4fff732460/merged major:0 minor:346 fsType:overlay blockSize:0} overlay_0-348:{mountpoint:/var/lib/containers/storage/overlay/a1b039dff79b5d637a5af3eedf6b67dcfe8e3f5dbd456c110d4f54cbbc629db8/merged major:0 minor:348 fsType:overlay blockSize:0} overlay_0-352:{mountpoint:/var/lib/containers/storage/overlay/a352702bec773724409845c548038858b8ca1a45429c02cdbe0ebdc2a6f14a34/merged major:0 minor:352 fsType:overlay blockSize:0} overlay_0-354:{mountpoint:/var/lib/containers/storage/overlay/3b9ab4b2edc624f87569d3027859e8da0bf77f012a74f8463eb6f2b2437cfa21/merged major:0 minor:354 fsType:overlay blockSize:0} overlay_0-356:{mountpoint:/var/lib/containers/storage/overlay/8362b8db8c47b3354333080c4aa7a89200d127984ad78012b87c4d57c85a6032/merged major:0 minor:356 fsType:overlay blockSize:0} overlay_0-362:{mountpoint:/var/lib/containers/storage/overlay/a3e63f61b540077c5d5321a1951b6501818b5646727ae2d9cd7dcfc8a7bca76a/merged major:0 minor:362 fsType:overlay blockSize:0} overlay_0-364:{mountpoint:/var/lib/containers/storage/overlay/90a35d9b4ef824c454dec6931706a4e7b79166428efc78e045558b40a4183ec7/merged major:0 minor:364 fsType:overlay blockSize:0} overlay_0-374:{mountpoint:/var/lib/containers/storage/overlay/905c2ab4ddd36d2aa63aac19e3d534de363d712d4974126dea492d2ef5c0968a/merged major:0 minor:374 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/85bd11f0cecd07f49cba78d3aca4689e4e6d287349ef03ae5f3191a5eab5fdd3/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/564d18ee447b3cb9cab6ced6bf97254384ed7c31bfb697bdd598ced3db4fadcd/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/02b99de02857f3a97ef9479f9104ca692d01b3315ec691154ef8399d72749012/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/8c9f616db5d6a240ea577dc5d1c29f6f737010756062733ea030ead0e8573345/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/2f18e6ea439aaa1dcd6e4ead3d9dad50ccf6a6f4e6b93cae62ba2713d77e377c/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/243ccd012cb7b9e03b894e2aee7ef89a538bace8ff21eb21f6fe1e59a26ba0f3/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/eba5bb7cc5b2837e602965b0358b2034895ecd22db5f988c759f4e456d235ccc/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/d450899600d9d2bb8d437a3323e49e2a8803ecac26c905033e759b727035d43d/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/76608b30c0dcc61075a916b57f531bd92bfafdc7524dc556e9170ae6941b63fc/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/e7164d318e7a1728197250827539ffe6c0a2e9f9f39b6fe1eef835506cb4ad7e/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/bd8e62669da17da49010b80caad3557bd5c8271667e7d7c48b0061c4291011ec/merged major:0 minor:96 fsType:overlay blockSize:0}] Oct 30 20:03:45.531015 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.530641 5078 manager.go:217] Machine: {Timestamp:2026-10-30 20:03:45.530136525 +0000 UTC m=+0.063409110 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099542 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24b28f8a39a86ac2a6e5282ab764e9 SystemUUID:ec24b28f-8a39-a86a-c2a6-e5282ab764e9 BootID:a426ad57-1080-42bb-b688-a28aac771f7d Filesystems:[{Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fbfa2cf8-ef21-4485-91f3-6ca0b0b0d55d/volumes/kubernetes.io~projected/kube-api-access-tmj4v DeviceMajor:0 DeviceMinor:225 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fa10fbaba8687e9e16c8165832a2ff5da4e11ed632cdf6bc45f673d551dcef99/userdata/shm DeviceMajor:0 DeviceMinor:239 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ff9ae114405803b5e237564cc7ffb19d0dce24272b5bafcd04a660d7da9d173d/userdata/shm DeviceMajor:0 DeviceMinor:294 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-362 DeviceMajor:0 DeviceMinor:362 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9f975a3b11e1e139184bad1d22d45b0046129a9ca0bb480ab6564bf5272bf68d/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-105 DeviceMajor:0 DeviceMinor:105 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e8af5bdb-cf19-4210-85c0-815d452cb701/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:202 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/27e4937d-367a-4ccc-9580-74a3982a49fe/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:208 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/27e4937d-367a-4ccc-9580-74a3982a49fe/volumes/kubernetes.io~projected/kube-api-access-qzghk DeviceMajor:0 DeviceMinor:213 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7f941d6e-cd94-47d5-a641-fb608c05a903/volumes/kubernetes.io~projected/kube-api-access-bb7sg DeviceMajor:0 DeviceMinor:215 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4ac859bf-692b-4447-891a-32541e1e244d/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:222 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/caeeb8a7-4283-4c38-b3be-c036eeeceb65/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e9fd457133bc0eb0f8fe85226bae5306358f5acde9a1829ea334a2667d6d45a4/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc/volumes/kubernetes.io~projected/kube-api-access-kgk5m DeviceMajor:0 DeviceMinor:315 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-316 DeviceMajor:0 DeviceMinor:316 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-332 DeviceMajor:0 DeviceMinor:332 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e2aa29bcb30843d9c098e8ef496822e709e2f1874bd80a4c5d1baf020427aaee/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/22e3da9c-5201-4bd9-b247-1caaa18f5d7d/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:211 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e/volumes/kubernetes.io~projected/kube-api-access-xnl5q DeviceMajor:0 DeviceMinor:293 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/208d31340929213c2e8e7364a9a8d5cea18b913b39921a385a3c5b25f37953de/userdata/shm DeviceMajor:0 DeviceMinor:310 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-346 DeviceMajor:0 DeviceMinor:346 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/adb774f6-0266-4c60-92e9-f0a5f8ac831e/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:210 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-142 DeviceMajor:0 DeviceMinor:142 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/22e3da9c-5201-4bd9-b247-1caaa18f5d7d/volumes/kubernetes.io~projected/kube-api-access-rvqn4 DeviceMajor:0 DeviceMinor:224 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-312 DeviceMajor:0 DeviceMinor:312 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6ce6c965-80be-4c82-826c-a9dc4dd19592/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:344 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-352 DeviceMajor:0 DeviceMinor:352 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fbf231f4ba8bcffc7c74df21cf0d38b69a58464c5b212ab941da3605cf17115b/userdata/shm DeviceMajor:0 DeviceMinor:350 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:64 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e8af5bdb-cf19-4210-85c0-815d452cb701/volumes/kubernetes.io~projected/kube-api-access-spmg8 DeviceMajor:0 DeviceMinor:227 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-274 DeviceMajor:0 DeviceMinor:274 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/285be4c1-3c4f-4972-b8fa-7f37f92d72bb/volumes/kubernetes.io~projected/kube-api-access-zr5cv DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ee5e6319-c93c-4713-b99c-9e5660af5192/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:207 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ee5e6319-c93c-4713-b99c-9e5660af5192/volumes/kubernetes.io~projected/kube-api-access-tjzcw DeviceMajor:0 DeviceMinor:226 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-348 DeviceMajor:0 DeviceMinor:348 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f8c5839e-f557-4e1d-a26f-17102c15ff8e/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f8c5839e-f557-4e1d-a26f-17102c15ff8e/volumes/kubernetes.io~projected/kube-api-access-7846l DeviceMajor:0 DeviceMinor:60 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f5dddacb-f3d8-43cc-9191-c9f63e56db20/volumes/kubernetes.io~projected/kube-api-access-44fgw DeviceMajor:0 DeviceMinor:216 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-277 DeviceMajor:0 DeviceMinor:277 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45/volumes/kubernetes.io~projected/kube-api-access-mf4tm DeviceMajor:0 DeviceMinor:67 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/93a3069b-7891-4146-a085-7b218eeff695/volumes/kubernetes.io~projected/kube-api-access-2nkhw DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2e5941e6-4fc9-4353-a518-8ad492e9ad61/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:209 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e80e69eb675a654c64413896124bacb23bcf0205a897312c2043ead6ffa7a9ed/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/92c970e1df14ad98487d0f35ec59d224f4d8209c6e3bd748910a3aef9d2804b8/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d4855521a8fd7fbe3df2536038291b21c212a53ac0d8dbbe9b6a0da401132f8e/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8087d186464b3111c28de8068816ab6edc3abecac3bb35e7927728d803a7e457/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a959734ab7f3bd0f5152b51b0ad36a121822ce27595256ce13ae777f35afd792/userdata/shm DeviceMajor:0 DeviceMinor:228 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/aa907cc6d48f34d4ca30164a69e2fa072c65fd20df45e04823ae90262e667889/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6ce6c965-80be-4c82-826c-a9dc4dd19592/volumes/kubernetes.io~projected/kube-api-access-ssghm DeviceMajor:0 DeviceMinor:345 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4ac859bf-692b-4447-891a-32541e1e244d/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:204 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/27e4937d-367a-4ccc-9580-74a3982a49fe/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:205 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/20ba9ea0-10d3-419c-a429-3a6dcf153171/volumes/kubernetes.io~projected/kube-api-access-jq82v DeviceMajor:0 DeviceMinor:218 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-281 DeviceMajor:0 DeviceMinor:281 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bea5c7b2-5ad1-43f5-8f43-07e3af665d6a/volumes/kubernetes.io~projected/kube-api-access-hl424 DeviceMajor:0 DeviceMinor:62 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4ac859bf-692b-4447-891a-32541e1e244d/volumes/kubernetes.io~projected/kube-api-access-fsbbs DeviceMajor:0 DeviceMinor:221 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2c3248e11effa8401bfbdf8863f1f12ee5383c987c4d745a8c7d94b2d45b1de1/userdata/shm DeviceMajor:0 DeviceMinor:230 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f8c5839e-f557-4e1d-a26f-17102c15ff8e/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2a70624f76cbfc8d2726b77b502ef5060ca1b06bd4e5b9b8eb32ec6fa340289d/userdata/shm DeviceMajor:0 DeviceMinor:296 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/fdac1f33-fb1f-4835-bbec-f34005f53979/volumes/kubernetes.io~projected/kube-api-access-rvl5j DeviceMajor:0 DeviceMinor:339 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d4452f26-53ff-4b31-9417-f550aa50c38d/volumes/kubernetes.io~projected/kube-api-access-qsppj DeviceMajor:0 DeviceMinor:65 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0c524506c6844ccd84e0c8f223c0dd6f2faa58c813b8d23a2b36c9bd15c51da0/userdata/shm DeviceMajor:0 DeviceMinor:340 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9dabf5d4-7787-40b3-b01e-fe430c316887/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:288 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-364 DeviceMajor:0 DeviceMinor:364 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4ac859bf-692b-4447-891a-32541e1e244d/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:212 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8a43513eaeac2f133ea80b861ce261ab15b0c07dae379980f8584d800fe8b123/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/14006e48-475b-4dbe-8994-1f908f897884/volumes/kubernetes.io~projected/kube-api-access-q6m8f DeviceMajor:0 DeviceMinor:63 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bde0c876d0985d2fbefc7fdb46a7a94dadaf157d085859cc86ecc627d3261a63/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/28ba2930-e73c-4716-b061-d7cb2bbd0400/volumes/kubernetes.io~projected/kube-api-access-jncv5 DeviceMajor:0 DeviceMinor:220 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-356 DeviceMajor:0 DeviceMinor:356 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/27e4937d-367a-4ccc-9580-74a3982a49fe/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:214 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-319 DeviceMajor:0 DeviceMinor:319 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ff5da8ed-018c-4182-82f0-a8a3266aff52/volumes/kubernetes.io~projected/kube-api-access-sk9xw DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f69d831c-d9e4-4060-a2bd-9d85265000f6/volumes/kubernetes.io~projected/kube-api-access-l4hpl DeviceMajor:0 DeviceMinor:66 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-143 DeviceMajor:0 DeviceMinor:143 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/24b57f65-bf27-4659-a922-83a241893696/volumes/kubernetes.io~projected/kube-api-access-4b644 DeviceMajor:0 DeviceMinor:217 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/923b77654cdccbede2198a35b11c9f8a675a265500dc5c00ec5676af62533704/userdata/shm DeviceMajor:0 DeviceMinor:342 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-107 DeviceMajor:0 DeviceMinor:107 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a7d2c4e7-accb-4388-97c7-62c0b40ebb4c/volumes/kubernetes.io~projected/kube-api-access-r2cpl DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0be6720bf54e45526d7b411465dbb59399d96ea97ffc361a16c2d7308d71044f/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/adb774f6-0266-4c60-92e9-f0a5f8ac831e/volumes/kubernetes.io~projected/kube-api-access-qnfwb DeviceMajor:0 DeviceMinor:219 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/893a1bf6e8d077f2fb6f9e55470d5d3efc7a40dd8bd63f290c476b4b0e0d3742/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2e5941e6-4fc9-4353-a518-8ad492e9ad61/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:206 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-279 DeviceMajor:0 DeviceMinor:279 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/249a58cfe615161e0c5f34eef91fcf7ca53cf693debfc4ea4a621880ff4a908a/userdata/shm DeviceMajor:0 DeviceMinor:234 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e16a56a652f650f0e5f57b669d048e0b9d275ecb8e983bac9dcd4921c35dca0f/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/364408a3-5d56-4e76-9c96-a2a08841b50f/volumes/kubernetes.io~projected/kube-api-access-nfdr6 DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/20ba9ea0-10d3-419c-a429-3a6dcf153171/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:203 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2e5941e6-4fc9-4353-a518-8ad492e9ad61/volumes/kubernetes.io~projected/kube-api-access-jlxdg DeviceMajor:0 DeviceMinor:223 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/83569e0f3f3c833e2b4533d25bc58421c22c2ea556096f2ef757f6d4903df1c9/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a/volumes/kubernetes.io~projected/kube-api-access-8s8zr DeviceMajor:0 DeviceMinor:61 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b8f3f28d5b76156ba3d153f22b582bfd1646174540202df9682a6aa1bd780612/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1f847152-ec65-4b3c-bcb6-d8cac177e31d/volumes/kubernetes.io~projected/kube-api-access-9px9m DeviceMajor:0 DeviceMinor:314 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/12a8bde498ee3f14827b8ff9662c5ea7765ea171e601dc973f2836de752851ab/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-354 DeviceMajor:0 DeviceMinor:354 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-374 DeviceMajor:0 DeviceMinor:374 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-263 DeviceMajor:0 DeviceMinor:263 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1696437d-23f3-4078-afc4-69e3a94f5ec7/volumes/kubernetes.io~projected/kube-api-access-mww9f DeviceMajor:0 DeviceMinor:334 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0c524506c6844cc MacAddress:ae:bc:4f:7d:f9:e2 Speed:10000 Mtu:8901} {Name:208d31340929213 MacAddress:06:5e:16:35:d5:1b Speed:10000 Mtu:8901} {Name:249a58cfe615161 MacAddress:2a:e8:c3:55:6f:58 Speed:10000 Mtu:8901} {Name:2a70624f76cbfc8 MacAddress:1e:df:08:5f:4a:13 Speed:10000 Mtu:8901} {Name:2c3248e11effa84 MacAddress:de:81:b9:4c:11:11 Speed:10000 Mtu:8901} {Name:893a1bf6e8d077f MacAddress:7e:09:04:63:1b:49 Speed:10000 Mtu:8901} {Name:8a43513eaeac2f1 MacAddress:d2:a5:89:2d:92:8a Speed:10000 Mtu:8901} {Name:923b77654cdccbe MacAddress:12:b1:03:dd:6c:70 Speed:10000 Mtu:8901} {Name:92c970e1df14ad9 MacAddress:2e:53:f6:82:a7:06 Speed:10000 Mtu:8901} {Name:a959734ab7f3bd0 MacAddress:02:64:11:1f:13:62 Speed:10000 Mtu:8901} {Name:aa907cc6d48f34d MacAddress:62:4b:0a:3d:d2:39 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:e6:f7:70:73 Speed:0 Mtu:9001} {Name:br-int MacAddress:0e:48:4c:0c:cb:ff Speed:0 Mtu:8901} {Name:e16a56a652f650f MacAddress:4e:70:62:3c:f0:46 Speed:10000 Mtu:8901} {Name:e80e69eb675a654 MacAddress:0e:d5:b0:9c:28:84 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:e6:f7:70:73 Speed:0 Mtu:9001} {Name:fa10fbaba8687e9 MacAddress:3e:5a:4b:38:25:1f Speed:10000 Mtu:8901} {Name:fbf231f4ba8bcff MacAddress:6e:78:28:a6:aa:e5 Speed:10000 Mtu:8901} {Name:ff9ae114405803b MacAddress:96:fa:e7:93:f5:fd Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:5a:12:ee:b3:ad:31 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:ba:e2:0b:72:b2:e2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 20:03:45.531201 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.531020 5078 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 20:03:45.531201 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.531068 5078 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 20:03:45.531405 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.531380 5078 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 20:03:45.531534 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.531406 5078 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-217.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 20:03:45.531581 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.531536 5078 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 20:03:45.531581 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.531544 5078 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 20:03:45.531581 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.531559 5078 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 20:03:45.531581 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.531571 5078 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 20:03:45.531686 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.531591 5078 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 20:03:45.531768 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.531758 5078 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 20:03:45.531877 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.531869 5078 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 20:03:45.531912 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.531907 5078 kubelet.go:493] "Attempting to sync node with API server" Oct 30 20:03:45.531940 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.531923 5078 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 20:03:45.531940 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.531933 5078 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 20:03:45.531996 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.531941 5078 kubelet.go:405] "Adding apiserver pod source" Oct 30 20:03:45.531996 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.531949 5078 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 20:03:45.533051 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.533032 5078 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 20:03:45.533051 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.533050 5078 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 20:03:45.533579 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.533557 5078 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 20:03:45.535802 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.535789 5078 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 20:03:45.535802 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.535802 5078 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 20:03:45.535905 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.535896 5078 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Oct 30 20:03:45.536090 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.536079 5078 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 20:03:45.536131 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.536108 5078 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 20:03:45.536206 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.536196 5078 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 20:03:45.536236 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.536211 5078 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 20:03:45.536236 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.536218 5078 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 20:03:45.536236 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.536223 5078 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 20:03:45.536236 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.536230 5078 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 20:03:45.536236 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.536235 5078 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 20:03:45.536428 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.536249 5078 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 20:03:45.536428 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.536255 5078 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 20:03:45.536428 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.536262 5078 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 20:03:45.536428 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.536268 5078 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 20:03:45.536428 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.536281 5078 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 20:03:45.536428 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.536290 5078 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 20:03:45.536428 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.536310 5078 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 20:03:45.536428 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.536315 5078 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 20:03:45.540029 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.540014 5078 server.go:1263] "Started kubelet" Oct 30 20:03:45.540476 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.540101 5078 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 20:03:45.540476 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.540099 5078 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 20:03:45.540476 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.540200 5078 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 20:03:45.540650 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.540607 5078 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 20:03:45.540536 ip-10-0-139-217 systemd[1]: Started Kubernetes Kubelet. Oct 30 20:03:45.541538 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.541423 5078 server.go:317] "Adding debug handlers to kubelet server" Oct 30 20:03:45.543620 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.543600 5078 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 20:03:45.543764 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.543628 5078 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 20:03:45.543764 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.543681 5078 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 19:58:04 +0000 UTC" deadline="2028-04-29 00:36:32.607511653 +0000 UTC" Oct 30 20:03:45.543764 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.543709 5078 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13108h32m47.063804796s" Oct 30 20:03:45.543764 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.543735 5078 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 20:03:45.543764 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:45.543738 5078 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-217.us-east-2.compute.internal\" not found" Oct 30 20:03:45.543764 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.543746 5078 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 20:03:45.544205 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.543841 5078 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 20:03:45.549654 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549597 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f69d831c-d9e4-4060-a2bd-9d85265000f6" volumeName="kubernetes.io/projected/f69d831c-d9e4-4060-a2bd-9d85265000f6-kube-api-access-l4hpl" seLinuxMountContext="" Oct 30 20:03:45.549800 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549653 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ff5da8ed-018c-4182-82f0-a8a3266aff52" volumeName="kubernetes.io/configmap/ff5da8ed-018c-4182-82f0-a8a3266aff52-serviceca" seLinuxMountContext="" Oct 30 20:03:45.549800 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549669 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1696437d-23f3-4078-afc4-69e3a94f5ec7" volumeName="kubernetes.io/projected/1696437d-23f3-4078-afc4-69e3a94f5ec7-kube-api-access-mww9f" seLinuxMountContext="" Oct 30 20:03:45.549800 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549683 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4ac859bf-692b-4447-891a-32541e1e244d" volumeName="kubernetes.io/configmap/4ac859bf-692b-4447-891a-32541e1e244d-trusted-ca" seLinuxMountContext="" Oct 30 20:03:45.549800 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549695 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7f941d6e-cd94-47d5-a641-fb608c05a903" volumeName="kubernetes.io/projected/7f941d6e-cd94-47d5-a641-fb608c05a903-kube-api-access-bb7sg" seLinuxMountContext="" Oct 30 20:03:45.549800 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549715 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="adb774f6-0266-4c60-92e9-f0a5f8ac831e" volumeName="kubernetes.io/projected/adb774f6-0266-4c60-92e9-f0a5f8ac831e-kube-api-access-qnfwb" seLinuxMountContext="" Oct 30 20:03:45.549800 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549730 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d4452f26-53ff-4b31-9417-f550aa50c38d" volumeName="kubernetes.io/configmap/d4452f26-53ff-4b31-9417-f550aa50c38d-iptables-alerter-script" seLinuxMountContext="" Oct 30 20:03:45.549800 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549745 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8c5839e-f557-4e1d-a26f-17102c15ff8e" volumeName="kubernetes.io/empty-dir/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-tuned" seLinuxMountContext="" Oct 30 20:03:45.549800 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549761 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fbfa2cf8-ef21-4485-91f3-6ca0b0b0d55d" volumeName="kubernetes.io/projected/fbfa2cf8-ef21-4485-91f3-6ca0b0b0d55d-kube-api-access-tmj4v" seLinuxMountContext="" Oct 30 20:03:45.549800 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549774 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="14006e48-475b-4dbe-8994-1f908f897884" volumeName="kubernetes.io/configmap/14006e48-475b-4dbe-8994-1f908f897884-cni-sysctl-allowlist" seLinuxMountContext="" Oct 30 20:03:45.549800 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549790 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="20ba9ea0-10d3-419c-a429-3a6dcf153171" volumeName="kubernetes.io/secret/20ba9ea0-10d3-419c-a429-3a6dcf153171-serving-cert" seLinuxMountContext="" Oct 30 20:03:45.549800 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549803 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc" volumeName="kubernetes.io/empty-dir/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-data-volume" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549819 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="14006e48-475b-4dbe-8994-1f908f897884" volumeName="kubernetes.io/configmap/14006e48-475b-4dbe-8994-1f908f897884-whereabouts-flatfile-configmap" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549833 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e5941e6-4fc9-4353-a518-8ad492e9ad61" volumeName="kubernetes.io/projected/2e5941e6-4fc9-4353-a518-8ad492e9ad61-kube-api-access-jlxdg" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549864 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="caeeb8a7-4283-4c38-b3be-c036eeeceb65" volumeName="kubernetes.io/secret/caeeb8a7-4283-4c38-b3be-c036eeeceb65-agent-certs" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549879 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d28c2db0-9b9a-4c34-a78f-cbf24f67ac45" volumeName="kubernetes.io/projected/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-kube-api-access-mf4tm" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549893 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee5e6319-c93c-4713-b99c-9e5660af5192" volumeName="kubernetes.io/configmap/ee5e6319-c93c-4713-b99c-9e5660af5192-trusted-ca" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549906 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="14006e48-475b-4dbe-8994-1f908f897884" volumeName="kubernetes.io/configmap/14006e48-475b-4dbe-8994-1f908f897884-cni-binary-copy" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549918 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="28ba2930-e73c-4716-b061-d7cb2bbd0400" volumeName="kubernetes.io/configmap/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-config" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549928 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="27e4937d-367a-4ccc-9580-74a3982a49fe" volumeName="kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-bound-sa-token" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549935 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="27e4937d-367a-4ccc-9580-74a3982a49fe" volumeName="kubernetes.io/secret/27e4937d-367a-4ccc-9580-74a3982a49fe-image-registry-private-configuration" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549943 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4ac859bf-692b-4447-891a-32541e1e244d" volumeName="kubernetes.io/empty-dir/4ac859bf-692b-4447-891a-32541e1e244d-ca-trust-extracted" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549951 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4ac859bf-692b-4447-891a-32541e1e244d" volumeName="kubernetes.io/secret/4ac859bf-692b-4447-891a-32541e1e244d-installation-pull-secrets" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549959 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6ce6c965-80be-4c82-826c-a9dc4dd19592" volumeName="kubernetes.io/secret/6ce6c965-80be-4c82-826c-a9dc4dd19592-signing-key" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549968 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e8af5bdb-cf19-4210-85c0-815d452cb701" volumeName="kubernetes.io/configmap/e8af5bdb-cf19-4210-85c0-815d452cb701-config" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549976 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e8af5bdb-cf19-4210-85c0-815d452cb701" volumeName="kubernetes.io/secret/e8af5bdb-cf19-4210-85c0-815d452cb701-serving-cert" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549984 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="27e4937d-367a-4ccc-9580-74a3982a49fe" volumeName="kubernetes.io/empty-dir/27e4937d-367a-4ccc-9580-74a3982a49fe-ca-trust-extracted" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.549991 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7f941d6e-cd94-47d5-a641-fb608c05a903" volumeName="kubernetes.io/configmap/7f941d6e-cd94-47d5-a641-fb608c05a903-config-volume" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550003 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="adb774f6-0266-4c60-92e9-f0a5f8ac831e" volumeName="kubernetes.io/secret/adb774f6-0266-4c60-92e9-f0a5f8ac831e-serving-cert" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550011 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="285be4c1-3c4f-4972-b8fa-7f37f92d72bb" volumeName="kubernetes.io/projected/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-kube-api-access-zr5cv" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550018 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1f847152-ec65-4b3c-bcb6-d8cac177e31d" volumeName="kubernetes.io/configmap/1f847152-ec65-4b3c-bcb6-d8cac177e31d-service-ca-bundle" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550026 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24b57f65-bf27-4659-a922-83a241893696" volumeName="kubernetes.io/projected/24b57f65-bf27-4659-a922-83a241893696-kube-api-access-4b644" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550043 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="27e4937d-367a-4ccc-9580-74a3982a49fe" volumeName="kubernetes.io/configmap/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-certificates" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550051 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="27e4937d-367a-4ccc-9580-74a3982a49fe" volumeName="kubernetes.io/configmap/27e4937d-367a-4ccc-9580-74a3982a49fe-trusted-ca" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550059 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6ce6c965-80be-4c82-826c-a9dc4dd19592" volumeName="kubernetes.io/configmap/6ce6c965-80be-4c82-826c-a9dc4dd19592-signing-cabundle" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550066 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d28c2db0-9b9a-4c34-a78f-cbf24f67ac45" volumeName="kubernetes.io/configmap/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-env-overrides" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550073 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d28c2db0-9b9a-4c34-a78f-cbf24f67ac45" volumeName="kubernetes.io/secret/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-ovn-node-metrics-cert" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550080 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ae25b031-7ac9-4041-bc3a-7a6679eab74d" volumeName="kubernetes.io/configmap/ae25b031-7ac9-4041-bc3a-7a6679eab74d-nginx-conf" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550088 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bea5c7b2-5ad1-43f5-8f43-07e3af665d6a" volumeName="kubernetes.io/empty-dir/bea5c7b2-5ad1-43f5-8f43-07e3af665d6a-tmp-dir" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550094 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d28c2db0-9b9a-4c34-a78f-cbf24f67ac45" volumeName="kubernetes.io/configmap/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-ovnkube-script-lib" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550103 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d4452f26-53ff-4b31-9417-f550aa50c38d" volumeName="kubernetes.io/projected/d4452f26-53ff-4b31-9417-f550aa50c38d-kube-api-access-qsppj" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550111 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee5e6319-c93c-4713-b99c-9e5660af5192" volumeName="kubernetes.io/configmap/ee5e6319-c93c-4713-b99c-9e5660af5192-config" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550118 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8c5839e-f557-4e1d-a26f-17102c15ff8e" volumeName="kubernetes.io/projected/f8c5839e-f557-4e1d-a26f-17102c15ff8e-kube-api-access-7846l" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550126 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="14006e48-475b-4dbe-8994-1f908f897884" volumeName="kubernetes.io/projected/14006e48-475b-4dbe-8994-1f908f897884-kube-api-access-q6m8f" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550136 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1f847152-ec65-4b3c-bcb6-d8cac177e31d" volumeName="kubernetes.io/projected/1f847152-ec65-4b3c-bcb6-d8cac177e31d-kube-api-access-9px9m" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550149 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9dabf5d4-7787-40b3-b01e-fe430c316887" volumeName="kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550159 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7d2c4e7-accb-4388-97c7-62c0b40ebb4c" volumeName="kubernetes.io/projected/a7d2c4e7-accb-4388-97c7-62c0b40ebb4c-kube-api-access-r2cpl" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550167 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ff5da8ed-018c-4182-82f0-a8a3266aff52" volumeName="kubernetes.io/projected/ff5da8ed-018c-4182-82f0-a8a3266aff52-kube-api-access-sk9xw" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550174 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="28ba2930-e73c-4716-b061-d7cb2bbd0400" volumeName="kubernetes.io/projected/28ba2930-e73c-4716-b061-d7cb2bbd0400-kube-api-access-jncv5" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550186 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1f847152-ec65-4b3c-bcb6-d8cac177e31d" volumeName="kubernetes.io/configmap/1f847152-ec65-4b3c-bcb6-d8cac177e31d-trusted-ca-bundle" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550194 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="20ba9ea0-10d3-419c-a429-3a6dcf153171" volumeName="kubernetes.io/projected/20ba9ea0-10d3-419c-a429-3a6dcf153171-kube-api-access-jq82v" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550202 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="22e3da9c-5201-4bd9-b247-1caaa18f5d7d" volumeName="kubernetes.io/secret/22e3da9c-5201-4bd9-b247-1caaa18f5d7d-cert" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550210 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="27e4937d-367a-4ccc-9580-74a3982a49fe" volumeName="kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-kube-api-access-qzghk" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550218 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e5941e6-4fc9-4353-a518-8ad492e9ad61" volumeName="kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-stats-auth" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550225 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc" volumeName="kubernetes.io/projected/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-api-access-kgk5m" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550232 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24b57f65-bf27-4659-a922-83a241893696" volumeName="kubernetes.io/configmap/24b57f65-bf27-4659-a922-83a241893696-telemetry-config" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550246 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="adb774f6-0266-4c60-92e9-f0a5f8ac831e" volumeName="kubernetes.io/empty-dir/adb774f6-0266-4c60-92e9-f0a5f8ac831e-tmp" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550254 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e8af5bdb-cf19-4210-85c0-815d452cb701" volumeName="kubernetes.io/projected/e8af5bdb-cf19-4210-85c0-815d452cb701-kube-api-access-spmg8" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550262 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdac1f33-fb1f-4835-bbec-f34005f53979" volumeName="kubernetes.io/projected/fdac1f33-fb1f-4835-bbec-f34005f53979-kube-api-access-rvl5j" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550269 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4ac859bf-692b-4447-891a-32541e1e244d" volumeName="kubernetes.io/configmap/4ac859bf-692b-4447-891a-32541e1e244d-registry-certificates" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550277 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4ac859bf-692b-4447-891a-32541e1e244d" volumeName="kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-kube-api-access-fsbbs" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550293 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4ac859bf-692b-4447-891a-32541e1e244d" volumeName="kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-bound-sa-token" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550301 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6ce6c965-80be-4c82-826c-a9dc4dd19592" volumeName="kubernetes.io/projected/6ce6c965-80be-4c82-826c-a9dc4dd19592-kube-api-access-ssghm" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550308 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="adb774f6-0266-4c60-92e9-f0a5f8ac831e" volumeName="kubernetes.io/configmap/adb774f6-0266-4c60-92e9-f0a5f8ac831e-trusted-ca-bundle" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550318 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="22e3da9c-5201-4bd9-b247-1caaa18f5d7d" volumeName="kubernetes.io/projected/22e3da9c-5201-4bd9-b247-1caaa18f5d7d-kube-api-access-rvqn4" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550351 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="27e4937d-367a-4ccc-9580-74a3982a49fe" volumeName="kubernetes.io/secret/27e4937d-367a-4ccc-9580-74a3982a49fe-installation-pull-secrets" seLinuxMountContext="" Oct 30 20:03:45.550316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550363 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a8ee251-819c-4ea5-8d6a-6211fdf7e00a" volumeName="kubernetes.io/projected/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-kube-api-access-8s8zr" seLinuxMountContext="" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550377 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="adb774f6-0266-4c60-92e9-f0a5f8ac831e" volumeName="kubernetes.io/configmap/adb774f6-0266-4c60-92e9-f0a5f8ac831e-service-ca-bundle" seLinuxMountContext="" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550397 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f5dddacb-f3d8-43cc-9191-c9f63e56db20" volumeName="kubernetes.io/projected/f5dddacb-f3d8-43cc-9191-c9f63e56db20-kube-api-access-44fgw" seLinuxMountContext="" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550405 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1f847152-ec65-4b3c-bcb6-d8cac177e31d" volumeName="kubernetes.io/empty-dir/1f847152-ec65-4b3c-bcb6-d8cac177e31d-archives-path" seLinuxMountContext="" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550413 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="285be4c1-3c4f-4972-b8fa-7f37f92d72bb" volumeName="kubernetes.io/configmap/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-daemon-config" seLinuxMountContext="" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550421 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="93a3069b-7891-4146-a085-7b218eeff695" volumeName="kubernetes.io/projected/93a3069b-7891-4146-a085-7b218eeff695-kube-api-access-2nkhw" seLinuxMountContext="" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550428 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="adb774f6-0266-4c60-92e9-f0a5f8ac831e" volumeName="kubernetes.io/empty-dir/adb774f6-0266-4c60-92e9-f0a5f8ac831e-snapshots" seLinuxMountContext="" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550435 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="caeeb8a7-4283-4c38-b3be-c036eeeceb65" volumeName="kubernetes.io/configmap/caeeb8a7-4283-4c38-b3be-c036eeeceb65-konnectivity-ca" seLinuxMountContext="" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550443 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8c5839e-f557-4e1d-a26f-17102c15ff8e" volumeName="kubernetes.io/empty-dir/f8c5839e-f557-4e1d-a26f-17102c15ff8e-tmp" seLinuxMountContext="" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550450 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="285be4c1-3c4f-4972-b8fa-7f37f92d72bb" volumeName="kubernetes.io/configmap/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-cni-binary-copy" seLinuxMountContext="" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550459 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="20ba9ea0-10d3-419c-a429-3a6dcf153171" volumeName="kubernetes.io/configmap/20ba9ea0-10d3-419c-a429-3a6dcf153171-config" seLinuxMountContext="" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550471 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e5941e6-4fc9-4353-a518-8ad492e9ad61" volumeName="kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-default-certificate" seLinuxMountContext="" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550482 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="364408a3-5d56-4e76-9c96-a2a08841b50f" volumeName="kubernetes.io/projected/364408a3-5d56-4e76-9c96-a2a08841b50f-kube-api-access-nfdr6" seLinuxMountContext="" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550494 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4ac859bf-692b-4447-891a-32541e1e244d" volumeName="kubernetes.io/secret/4ac859bf-692b-4447-891a-32541e1e244d-image-registry-private-configuration" seLinuxMountContext="" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550506 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e" volumeName="kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q" seLinuxMountContext="" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550517 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bea5c7b2-5ad1-43f5-8f43-07e3af665d6a" volumeName="kubernetes.io/projected/bea5c7b2-5ad1-43f5-8f43-07e3af665d6a-kube-api-access-hl424" seLinuxMountContext="" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550528 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d28c2db0-9b9a-4c34-a78f-cbf24f67ac45" volumeName="kubernetes.io/configmap/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-ovnkube-config" seLinuxMountContext="" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550540 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7f941d6e-cd94-47d5-a641-fb608c05a903" volumeName="kubernetes.io/empty-dir/7f941d6e-cd94-47d5-a641-fb608c05a903-tmp-dir" seLinuxMountContext="" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550551 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee5e6319-c93c-4713-b99c-9e5660af5192" volumeName="kubernetes.io/projected/ee5e6319-c93c-4713-b99c-9e5660af5192-kube-api-access-tjzcw" seLinuxMountContext="" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550563 5078 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee5e6319-c93c-4713-b99c-9e5660af5192" volumeName="kubernetes.io/secret/ee5e6319-c93c-4713-b99c-9e5660af5192-serving-cert" seLinuxMountContext="" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550574 5078 reconstruct.go:97] "Volume reconstruction finished" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550582 5078 reconciler.go:29] "Reconciler: start to sync state" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550562 5078 factory.go:153] Registering CRI-O factory Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550715 5078 factory.go:223] Registration of the crio container factory successfully Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550810 5078 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550821 5078 factory.go:55] Registering systemd factory Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550827 5078 factory.go:223] Registration of the systemd container factory successfully Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550850 5078 factory.go:103] Registering Raw factory Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.550872 5078 manager.go:1199] Started watching for new ooms in manager Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.551259 5078 manager.go:319] Starting recovery of all containers Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.552076 5078 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 20:03:45.552894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.552646 5078 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 20:03:45.554449 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.554405 5078 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 20:03:45.556109 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.556089 5078 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Oct 30 20:03:45.571088 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.571061 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/1.log" Oct 30 20:03:45.571202 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.571061 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/1.log" Oct 30 20:03:45.575663 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.575627 5078 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 20:03:45.577053 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.577028 5078 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 20:03:45.577053 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.577053 5078 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 20:03:45.577194 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.577076 5078 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 20:03:45.577194 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:45.577144 5078 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 30 20:03:45.584829 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.584800 5078 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 20:03:45.591171 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.591144 5078 generic.go:356] "Generic (PLEG): container finished" podID="14006e48-475b-4dbe-8994-1f908f897884" containerID="2ff4678a572fea63cf2e82bd3b5eec075bb4c35b62962d77fa38e8384ab1bc1f" exitCode=0 Oct 30 20:03:45.591171 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.591171 5078 generic.go:356] "Generic (PLEG): container finished" podID="14006e48-475b-4dbe-8994-1f908f897884" containerID="722e7159ae375207cc2f29048cb20051193e9d60789e2e929329065ce3e20720" exitCode=0 Oct 30 20:03:45.591285 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.591179 5078 generic.go:356] "Generic (PLEG): container finished" podID="14006e48-475b-4dbe-8994-1f908f897884" containerID="2351d85c0cd40d8ce8a9309987ec834e8a94792a536ce0cea346bc6f19ee7654" exitCode=0 Oct 30 20:03:45.591285 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.591185 5078 generic.go:356] "Generic (PLEG): container finished" podID="14006e48-475b-4dbe-8994-1f908f897884" containerID="49d62a8b013c5b9424e97111beeb23f74cdeeeebdd47d647647b16b2526a5db0" exitCode=0 Oct 30 20:03:45.591285 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.591191 5078 generic.go:356] "Generic (PLEG): container finished" podID="14006e48-475b-4dbe-8994-1f908f897884" containerID="2f8db9778d8ee7664159b7c426fcf79d92b6bfd315f8ea4b067d7cd1a7957e13" exitCode=0 Oct 30 20:03:45.591285 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.591196 5078 generic.go:356] "Generic (PLEG): container finished" podID="14006e48-475b-4dbe-8994-1f908f897884" containerID="cabf06fdc7032099828ff0f1519f6d08aaf7da6d0fab8105014de3598707b276" exitCode=0 Oct 30 20:03:45.593008 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.592985 5078 generic.go:356] "Generic (PLEG): container finished" podID="0b98aff2d2ebc77273590dcdeafea2f9" containerID="2fad94b32fb7522361bffae0038aa76f4be645b4599df1f38214edc9ea6d7482" exitCode=0 Oct 30 20:03:45.624741 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.624713 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/1.log" Oct 30 20:03:45.624901 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.624748 5078 generic.go:356] "Generic (PLEG): container finished" podID="ee5e6319-c93c-4713-b99c-9e5660af5192" containerID="347addf553f8c84e3334f4a707bf8f84da8f3d56f4e94ea30c7f293c0fbf0b2e" exitCode=255 Oct 30 20:03:45.655383 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.655323 5078 manager.go:324] Recovery completed Oct 30 20:03:45.676230 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.676158 5078 cpu_manager.go:226] "Starting" policy="none" Oct 30 20:03:45.676230 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.676177 5078 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 20:03:45.676230 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.676200 5078 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 20:03:45.676450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.676322 5078 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Oct 30 20:03:45.676450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.676354 5078 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Oct 30 20:03:45.676450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.676374 5078 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Oct 30 20:03:45.676450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.676380 5078 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Oct 30 20:03:45.676450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.676385 5078 policy_none.go:50] "Start" Oct 30 20:03:45.676450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.676393 5078 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 20:03:45.676450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.676402 5078 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 20:03:45.676627 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.676538 5078 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Oct 30 20:03:45.676627 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.676545 5078 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Oct 30 20:03:45.676627 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.676552 5078 policy_none.go:44] "Start" Oct 30 20:03:45.677760 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:45.677741 5078 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Oct 30 20:03:45.681050 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.681009 5078 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 20:03:45.685650 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.685631 5078 manager.go:341] "Starting Device Plugin manager" Oct 30 20:03:45.686316 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:45.685667 5078 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 20:03:45.686455 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.686359 5078 server.go:87] "Starting device plugin registration server" Oct 30 20:03:45.686797 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.686780 5078 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 20:03:45.686894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.686802 5078 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 20:03:45.687026 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.687006 5078 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 20:03:45.687160 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.687121 5078 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 20:03:45.687160 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.687166 5078 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 20:03:45.687307 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.687173 5078 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 20:03:45.687388 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.687258 5078 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T20:03:45.687155358Z","UUID":"5dc969aa-e532-4436-92b3-d057d99b4053","Handler":null,"Name":"","Endpoint":""} Oct 30 20:03:45.689011 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:45.688981 5078 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 20:03:45.689277 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.689259 5078 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 20:03:45.689420 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.689303 5078 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 20:03:45.787267 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.787234 5078 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 20:03:45.788525 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.788506 5078 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 20:03:45.788654 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.788541 5078 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 20:03:45.788654 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.788554 5078 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-217.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 20:03:45.788654 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.788609 5078 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:45.802102 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.802078 5078 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:45.802207 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.802147 5078 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:45.878552 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.878487 5078 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal"] Oct 30 20:03:45.879191 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.879145 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" event={"ID":"0b98aff2d2ebc77273590dcdeafea2f9","Type":"ContainerStarted","Data":"0b5a798cc6a05b96856c81313dc3527665e0187c0df063f52a04363696fd0560"} Oct 30 20:03:45.879191 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.879186 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" event={"ID":"0b98aff2d2ebc77273590dcdeafea2f9","Type":"ContainerDied","Data":"2fad94b32fb7522361bffae0038aa76f4be645b4599df1f38214edc9ea6d7482"} Oct 30 20:03:45.879349 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.879201 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" event={"ID":"0b98aff2d2ebc77273590dcdeafea2f9","Type":"ContainerStarted","Data":"e2aa29bcb30843d9c098e8ef496822e709e2f1874bd80a4c5d1baf020427aaee"} Oct 30 20:03:45.879349 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.879270 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal" event={"ID":"49a9f3fd327006d80eb3bde05ad64dae","Type":"ContainerStarted","Data":"1d1a222fc133fcb53134203dce7f64d8990b66a53f44ab326121ca5903c9f292"} Oct 30 20:03:45.879349 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.879287 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal" event={"ID":"49a9f3fd327006d80eb3bde05ad64dae","Type":"ContainerStarted","Data":"83569e0f3f3c833e2b4533d25bc58421c22c2ea556096f2ef757f6d4903df1c9"} Oct 30 20:03:45.879349 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.879314 5078 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:45.879472 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.879423 5078 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:45.897200 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.897170 5078 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 20:03:45.897308 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:45.897229 5078 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:45.898663 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.898645 5078 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 20:03:45.898764 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:45.898695 5078 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:45.958109 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.958021 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b98aff2d2ebc77273590dcdeafea2f9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal\" (UID: \"0b98aff2d2ebc77273590dcdeafea2f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:45.958109 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.958058 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b98aff2d2ebc77273590dcdeafea2f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal\" (UID: \"0b98aff2d2ebc77273590dcdeafea2f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:45.958109 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:45.958078 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49a9f3fd327006d80eb3bde05ad64dae-config\") pod \"kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal\" (UID: \"49a9f3fd327006d80eb3bde05ad64dae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:46.058656 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.058617 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b98aff2d2ebc77273590dcdeafea2f9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal\" (UID: \"0b98aff2d2ebc77273590dcdeafea2f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:46.058656 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.058653 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b98aff2d2ebc77273590dcdeafea2f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal\" (UID: \"0b98aff2d2ebc77273590dcdeafea2f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:46.058854 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.058673 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49a9f3fd327006d80eb3bde05ad64dae-config\") pod \"kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal\" (UID: \"49a9f3fd327006d80eb3bde05ad64dae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:46.058854 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.058734 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b98aff2d2ebc77273590dcdeafea2f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal\" (UID: \"0b98aff2d2ebc77273590dcdeafea2f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:46.058854 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.058765 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49a9f3fd327006d80eb3bde05ad64dae-config\") pod \"kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal\" (UID: \"49a9f3fd327006d80eb3bde05ad64dae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:46.058854 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.058734 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b98aff2d2ebc77273590dcdeafea2f9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal\" (UID: \"0b98aff2d2ebc77273590dcdeafea2f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:46.532779 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.532746 5078 apiserver.go:52] "Watching apiserver" Oct 30 20:03:46.546125 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.546095 5078 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 20:03:46.546794 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.546769 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-qspzv","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-s4s25","openshift-dns/node-resolver-sxszz","openshift-console-operator/console-operator-7cd56b8dbc-dr852","openshift-ovn-kubernetes/ovnkube-node-df4d8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal","openshift-image-registry/image-registry-75c856df5f-jdst9","openshift-network-console/networking-console-plugin-86c478bb88-gksz8","openshift-image-registry/node-ca-fc6gd","openshift-insights/periodic-gathering-qqhv7-c6vvh","openshift-kube-storage-version-migrator/migrator-66df5d496b-fx4v7","openshift-network-diagnostics/network-check-source-6f78d59f99-sb9tl","openshift-dns/dns-default-hd99r","openshift-image-registry/image-registry-8586cfd6bb-wzm9m","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6","openshift-ingress/router-default-7f94f8f65c-dqcj8","openshift-insights/insights-runtime-extractor-js96l","kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal","kube-system/global-pull-secret-syncer-dw59s","openshift-cluster-node-tuning-operator/tuned-2sftq","kube-system/kas-connection-checker-685895c7c9-xh8v8","kube-system/kas-connection-checker-685895c7c9-ffthk","openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j","openshift-kube-storage-version-migrator/migrator-66df5d496b-zkfjx","openshift-multus/network-metrics-daemon-698hj","openshift-network-diagnostics/network-check-target-l5w4q","openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj","kube-system/kas-connection-checker-685895c7c9-4zrr5","kube-system/konnectivity-agent-cvpxr","openshift-network-operator/iptables-alerter-5hfvr","openshift-ingress-canary/ingress-canary-t85sd","openshift-service-ca/service-ca-5fffc97bdf-wktp2","openshift-insights/insights-operator-7c4986d449-c262w","openshift-multus/multus-additional-cni-plugins-tvkf2"] Oct 30 20:03:46.549476 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.549454 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:46.549797 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.549783 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:46.550642 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.550622 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:46.551046 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.551025 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:46.551925 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.551897 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-gksz8" Oct 30 20:03:46.552441 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.552410 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Oct 30 20:03:46.552554 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.552424 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Oct 30 20:03:46.552613 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.552567 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Oct 30 20:03:46.552672 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.552659 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Oct 30 20:03:46.552776 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.552764 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Oct 30 20:03:46.554726 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.554700 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Oct 30 20:03:46.555032 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.555010 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 20:03:46.555151 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.555047 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 20:03:46.555212 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.555193 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 20:03:46.555254 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.555211 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Oct 30 20:03:46.555442 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.555424 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Oct 30 20:03:46.555603 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.555586 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Oct 30 20:03:46.555717 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.555703 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 20:03:46.555860 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.555846 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Oct 30 20:03:46.556015 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.556000 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Oct 30 20:03:46.556081 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.556050 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Oct 30 20:03:46.556081 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.556052 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Oct 30 20:03:46.556230 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.556204 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Oct 30 20:03:46.556303 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.556277 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7rvzz\"" Oct 30 20:03:46.556303 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.556285 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Oct 30 20:03:46.558118 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.558096 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Oct 30 20:03:46.558202 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.558123 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Oct 30 20:03:46.558355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.558322 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 20:03:46.558519 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.558499 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Oct 30 20:03:46.558694 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.558676 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-l7p25\"" Oct 30 20:03:46.558862 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.558844 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 20:03:46.559009 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.558995 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Oct 30 20:03:46.559189 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.559172 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Oct 30 20:03:46.559407 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.559391 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z4rcb\"" Oct 30 20:03:46.559504 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.559487 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Oct 30 20:03:46.559865 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.559843 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Oct 30 20:03:46.560064 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.560040 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Oct 30 20:03:46.560246 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.560225 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Oct 30 20:03:46.560360 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.560279 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Oct 30 20:03:46.560458 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.560442 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Oct 30 20:03:46.560632 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.560614 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-k8q4l\"" Oct 30 20:03:46.560805 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.560621 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Oct 30 20:03:46.560900 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.560637 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 20:03:46.561094 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.560804 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Oct 30 20:03:46.561199 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.561176 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 20:03:46.561320 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.561261 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-9mzsl\"" Oct 30 20:03:46.561320 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.561288 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Oct 30 20:03:46.561522 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.561500 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cm4f9\"" Oct 30 20:03:46.561610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.561562 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xh4ts\"" Oct 30 20:03:46.561795 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.561777 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 20:03:46.562353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.562318 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-kgzch\"" Oct 30 20:03:46.562459 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.562391 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 20:03:46.562550 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.562532 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-rjm4m\"" Oct 30 20:03:46.562800 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.562670 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Oct 30 20:03:46.562800 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.562763 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Oct 30 20:03:46.562934 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.562881 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-d99xr\"" Oct 30 20:03:46.563270 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.563248 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Oct 30 20:03:46.563487 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.563468 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Oct 30 20:03:46.563557 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.563513 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Oct 30 20:03:46.563557 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.563533 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-cfnmr\"" Oct 30 20:03:46.564120 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.564102 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7scj5\"" Oct 30 20:03:46.564294 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.564275 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Oct 30 20:03:46.564377 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.564275 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 20:03:46.564432 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.564415 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 20:03:46.564480 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.564452 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 20:03:46.564740 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.564719 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 20:03:46.564821 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.564744 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-84sqw\"" Oct 30 20:03:46.564821 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.564776 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 20:03:46.564889 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.564845 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:46.565407 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.565392 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:46.565812 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.565781 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 20:03:46.565920 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.565836 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hms2c\"" Oct 30 20:03:46.565981 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.565926 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 20:03:46.566164 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.566146 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 20:03:46.566264 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.566249 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 20:03:46.566685 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.566670 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 20:03:46.566996 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.566982 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:46.567639 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.567614 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 20:03:46.567755 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.567739 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 20:03:46.567830 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.567788 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 20:03:46.567830 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.567803 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 20:03:46.567955 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.567940 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 20:03:46.568005 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.567960 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 20:03:46.568106 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.568091 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rlckg\"" Oct 30 20:03:46.568174 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.568122 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Oct 30 20:03:46.568231 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.568200 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-qkmrx\"" Oct 30 20:03:46.568277 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.568251 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 20:03:46.568277 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.568261 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rx62b\"" Oct 30 20:03:46.568402 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.568363 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 20:03:46.568402 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.568394 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rnw2v\"" Oct 30 20:03:46.568494 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.568448 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hntbg\"" Oct 30 20:03:46.568594 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.568565 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Oct 30 20:03:46.568635 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.568620 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Oct 30 20:03:46.568785 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.568770 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:46.569422 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.569402 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 20:03:46.569512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.569464 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 20:03:46.569575 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.569540 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 20:03:46.569618 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.569581 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 20:03:46.569747 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.569729 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 20:03:46.569976 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.569962 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 20:03:46.570047 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.569965 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-phqsm\"" Oct 30 20:03:46.570047 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.570013 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-26gph\"" Oct 30 20:03:46.570141 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.570056 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 20:03:46.570141 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.570099 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 20:03:46.570227 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.570215 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pxq5r\"" Oct 30 20:03:46.570280 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.570228 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 20:03:46.570529 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.570515 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 20:03:46.570604 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.570586 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-nfbvj\"" Oct 30 20:03:46.570709 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.570696 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 20:03:46.570960 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.570945 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 20:03:46.571023 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.570945 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c2z8r\"" Oct 30 20:03:46.572425 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.572409 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j5tm5\"" Oct 30 20:03:46.572501 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.572427 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 20:03:46.572501 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.572485 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 20:03:46.573481 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.573463 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4qzg7\"" Oct 30 20:03:46.573933 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.573919 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 30 20:03:46.574178 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.574164 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 30 20:03:46.574504 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.574492 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Oct 30 20:03:46.574981 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.574967 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Oct 30 20:03:46.575263 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.575240 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Oct 30 20:03:46.575263 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.575261 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-cfkxt\"" Oct 30 20:03:46.575379 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.575275 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Oct 30 20:03:46.640781 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.640752 5078 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:46.640928 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.640862 5078 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:46.648957 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.648930 5078 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 20:03:46.651498 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.651480 5078 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 20:03:46.651578 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:46.651530 5078 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:46.652688 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.652666 5078 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 20:03:46.652732 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:46.652708 5078 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.us-east-2.compute.internal" Oct 30 20:03:46.661480 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.661455 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-jb98m\" (UID: \"28ba2930-e73c-4716-b061-d7cb2bbd0400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:46.661570 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.661492 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6ce6c965-80be-4c82-826c-a9dc4dd19592-signing-key\") pod \"service-ca-5fffc97bdf-wktp2\" (UID: \"6ce6c965-80be-4c82-826c-a9dc4dd19592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wktp2" Oct 30 20:03:46.661570 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.661519 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssghm\" (UniqueName: \"kubernetes.io/projected/6ce6c965-80be-4c82-826c-a9dc4dd19592-kube-api-access-ssghm\") pod \"service-ca-5fffc97bdf-wktp2\" (UID: \"6ce6c965-80be-4c82-826c-a9dc4dd19592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wktp2" Oct 30 20:03:46.661570 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.661549 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-var-lib-cni-multus\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.661740 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.661576 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4hpl\" (UniqueName: \"kubernetes.io/projected/f69d831c-d9e4-4060-a2bd-9d85265000f6-kube-api-access-l4hpl\") pod \"network-metrics-daemon-698hj\" (UID: \"f69d831c-d9e4-4060-a2bd-9d85265000f6\") " pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:46.661740 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.661602 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnfwb\" (UniqueName: \"kubernetes.io/projected/adb774f6-0266-4c60-92e9-f0a5f8ac831e-kube-api-access-qnfwb\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:46.661740 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.661627 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-run-ovn\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.661740 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.661653 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb7sg\" (UniqueName: \"kubernetes.io/projected/7f941d6e-cd94-47d5-a641-fb608c05a903-kube-api-access-bb7sg\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:46.661740 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.661678 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-device-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:46.661740 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.661704 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-host\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.662069 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.661799 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6ce6c965-80be-4c82-826c-a9dc4dd19592-signing-key\") pod \"service-ca-5fffc97bdf-wktp2\" (UID: \"6ce6c965-80be-4c82-826c-a9dc4dd19592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wktp2" Oct 30 20:03:46.662069 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.661814 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8c5839e-f557-4e1d-a26f-17102c15ff8e-tmp\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.662069 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.661837 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jncv5\" (UniqueName: \"kubernetes.io/projected/28ba2930-e73c-4716-b061-d7cb2bbd0400-kube-api-access-jncv5\") pod \"cluster-samples-operator-6ddb6c8b94-jb98m\" (UID: \"28ba2930-e73c-4716-b061-d7cb2bbd0400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:46.662069 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.661881 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nkhw\" (UniqueName: \"kubernetes.io/projected/93a3069b-7891-4146-a085-7b218eeff695-kube-api-access-2nkhw\") pod \"kas-connection-checker-685895c7c9-4zrr5\" (UID: \"93a3069b-7891-4146-a085-7b218eeff695\") " pod="kube-system/kas-connection-checker-685895c7c9-4zrr5" Oct 30 20:03:46.662069 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.661902 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8c5839e-f557-4e1d-a26f-17102c15ff8e-tmp\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.662069 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.661906 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s8zr\" (UniqueName: \"kubernetes.io/projected/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-kube-api-access-8s8zr\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:46.662069 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.661968 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-lib-modules\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.662069 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662001 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14006e48-475b-4dbe-8994-1f908f897884-cni-binary-copy\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:46.662069 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662030 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bea5c7b2-5ad1-43f5-8f43-07e3af665d6a-hosts-file\") pod \"node-resolver-sxszz\" (UID: \"bea5c7b2-5ad1-43f5-8f43-07e3af665d6a\") " pod="openshift-dns/node-resolver-sxszz" Oct 30 20:03:46.662497 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662159 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ac859bf-692b-4447-891a-32541e1e244d-trusted-ca\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:46.662497 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662170 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-jb98m\" (UID: \"28ba2930-e73c-4716-b061-d7cb2bbd0400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:46.662497 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662192 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.662497 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662361 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-tuned\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.662497 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662392 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4452f26-53ff-4b31-9417-f550aa50c38d-iptables-alerter-script\") pod \"iptables-alerter-5hfvr\" (UID: \"d4452f26-53ff-4b31-9417-f550aa50c38d\") " pod="openshift-network-operator/iptables-alerter-5hfvr" Oct 30 20:03:46.662497 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662393 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14006e48-475b-4dbe-8994-1f908f897884-cni-binary-copy\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:46.662497 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662425 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/14006e48-475b-4dbe-8994-1f908f897884-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:46.662497 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662454 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/adb774f6-0266-4c60-92e9-f0a5f8ac831e-serving-cert\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:46.662497 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662472 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-tuned\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.662497 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662489 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-run-systemd\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.662963 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662516 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-etc-selinux\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:46.662963 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662540 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsppj\" (UniqueName: \"kubernetes.io/projected/d4452f26-53ff-4b31-9417-f550aa50c38d-kube-api-access-qsppj\") pod \"iptables-alerter-5hfvr\" (UID: \"d4452f26-53ff-4b31-9417-f550aa50c38d\") " pod="openshift-network-operator/iptables-alerter-5hfvr" Oct 30 20:03:46.662963 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662564 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adb774f6-0266-4c60-92e9-f0a5f8ac831e-tmp\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:46.662963 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662572 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ac859bf-692b-4447-891a-32541e1e244d-trusted-ca\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:46.662963 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662626 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-sysctl-conf\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.662963 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662664 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7846l\" (UniqueName: \"kubernetes.io/projected/f8c5839e-f557-4e1d-a26f-17102c15ff8e-kube-api-access-7846l\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.662963 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662712 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adb774f6-0266-4c60-92e9-f0a5f8ac831e-tmp\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:46.662963 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662733 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee5e6319-c93c-4713-b99c-9e5660af5192-serving-cert\") pod \"console-operator-7cd56b8dbc-dr852\" (UID: \"ee5e6319-c93c-4713-b99c-9e5660af5192\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:46.662963 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662762 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4452f26-53ff-4b31-9417-f550aa50c38d-iptables-alerter-script\") pod \"iptables-alerter-5hfvr\" (UID: \"d4452f26-53ff-4b31-9417-f550aa50c38d\") " pod="openshift-network-operator/iptables-alerter-5hfvr" Oct 30 20:03:46.662963 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662778 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/14006e48-475b-4dbe-8994-1f908f897884-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:46.662963 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662890 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-var-lib-cni-bin\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.662963 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662949 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-run-multus-certs\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.663503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.662982 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/27e4937d-367a-4ccc-9580-74a3982a49fe-ca-trust-extracted\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:46.663503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663011 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/24b57f65-bf27-4659-a922-83a241893696-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-bbm2j\" (UID: \"24b57f65-bf27-4659-a922-83a241893696\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:46.663503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663076 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b644\" (UniqueName: \"kubernetes.io/projected/24b57f65-bf27-4659-a922-83a241893696-kube-api-access-4b644\") pod \"cluster-monitoring-operator-884576c57-bbm2j\" (UID: \"24b57f65-bf27-4659-a922-83a241893696\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:46.663503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663092 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee5e6319-c93c-4713-b99c-9e5660af5192-serving-cert\") pod \"console-operator-7cd56b8dbc-dr852\" (UID: \"ee5e6319-c93c-4713-b99c-9e5660af5192\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:46.663503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663120 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:46.663503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663183 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/27e4937d-367a-4ccc-9580-74a3982a49fe-ca-trust-extracted\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:46.663503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663190 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/adb774f6-0266-4c60-92e9-f0a5f8ac831e-serving-cert\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:46.663503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663211 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-var-lib-kubelet\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.663503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663262 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/14006e48-475b-4dbe-8994-1f908f897884-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:46.663503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663289 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-cni-binary-copy\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.663503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663316 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-metrics-certs\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:46.663503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663352 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-systemd-units\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.663503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663404 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee5e6319-c93c-4713-b99c-9e5660af5192-config\") pod \"console-operator-7cd56b8dbc-dr852\" (UID: \"ee5e6319-c93c-4713-b99c-9e5660af5192\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:46.663503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663434 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/24b57f65-bf27-4659-a922-83a241893696-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-bbm2j\" (UID: \"24b57f65-bf27-4659-a922-83a241893696\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:46.663503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663447 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/caeeb8a7-4283-4c38-b3be-c036eeeceb65-agent-certs\") pod \"konnectivity-agent-cvpxr\" (UID: \"caeeb8a7-4283-4c38-b3be-c036eeeceb65\") " pod="kube-system/konnectivity-agent-cvpxr" Oct 30 20:03:46.663503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663476 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk9xw\" (UniqueName: \"kubernetes.io/projected/ff5da8ed-018c-4182-82f0-a8a3266aff52-kube-api-access-sk9xw\") pod \"node-ca-fc6gd\" (UID: \"ff5da8ed-018c-4182-82f0-a8a3266aff52\") " pod="openshift-image-registry/node-ca-fc6gd" Oct 30 20:03:46.663503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663501 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/14006e48-475b-4dbe-8994-1f908f897884-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663503 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsbbs\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-kube-api-access-fsbbs\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663552 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnl5q\" (UniqueName: \"kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q\") pod \"network-check-target-l5w4q\" (UID: \"9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e\") " pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663577 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/1f847152-ec65-4b3c-bcb6-d8cac177e31d-archives-path\") pod \"periodic-gathering-qqhv7-c6vvh\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663601 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f847152-ec65-4b3c-bcb6-d8cac177e31d-service-ca-bundle\") pod \"periodic-gathering-qqhv7-c6vvh\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663611 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-cni-binary-copy\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663625 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvqn4\" (UniqueName: \"kubernetes.io/projected/22e3da9c-5201-4bd9-b247-1caaa18f5d7d-kube-api-access-rvqn4\") pod \"ingress-canary-t85sd\" (UID: \"22e3da9c-5201-4bd9-b247-1caaa18f5d7d\") " pod="openshift-ingress-canary/ingress-canary-t85sd" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663739 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14006e48-475b-4dbe-8994-1f908f897884-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663797 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20ba9ea0-10d3-419c-a429-3a6dcf153171-serving-cert\") pod \"service-ca-operator-544d749c8c-5hdqj\" (UID: \"20ba9ea0-10d3-419c-a429-3a6dcf153171\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663830 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-run-netns\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663857 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-cni-bin\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663857 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/caeeb8a7-4283-4c38-b3be-c036eeeceb65-agent-certs\") pod \"konnectivity-agent-cvpxr\" (UID: \"caeeb8a7-4283-4c38-b3be-c036eeeceb65\") " pod="kube-system/konnectivity-agent-cvpxr" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663916 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-ovnkube-config\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663907 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee5e6319-c93c-4713-b99c-9e5660af5192-config\") pod \"console-operator-7cd56b8dbc-dr852\" (UID: \"ee5e6319-c93c-4713-b99c-9e5660af5192\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663961 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/1f847152-ec65-4b3c-bcb6-d8cac177e31d-archives-path\") pod \"periodic-gathering-qqhv7-c6vvh\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.663970 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-ovn-node-metrics-cert\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664067 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-cni-dir\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664085 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-cnibin\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664106 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8af5bdb-cf19-4210-85c0-815d452cb701-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz\" (UID: \"e8af5bdb-cf19-4210-85c0-815d452cb701\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664172 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f847152-ec65-4b3c-bcb6-d8cac177e31d-service-ca-bundle\") pod \"periodic-gathering-qqhv7-c6vvh\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664172 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-ovnkube-config\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664206 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-modprobe-d\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664240 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-certificates\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664274 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-log-socket\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.664286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664282 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20ba9ea0-10d3-419c-a429-3a6dcf153171-serving-cert\") pod \"service-ca-operator-544d749c8c-5hdqj\" (UID: \"20ba9ea0-10d3-419c-a429-3a6dcf153171\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664316 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-run-netns\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664357 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8af5bdb-cf19-4210-85c0-815d452cb701-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz\" (UID: \"e8af5bdb-cf19-4210-85c0-815d452cb701\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664365 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr5cv\" (UniqueName: \"kubernetes.io/projected/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-kube-api-access-zr5cv\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664400 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-node-log\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664464 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-ovn-node-metrics-cert\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664476 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9px9m\" (UniqueName: \"kubernetes.io/projected/1f847152-ec65-4b3c-bcb6-d8cac177e31d-kube-api-access-9px9m\") pod \"periodic-gathering-qqhv7-c6vvh\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664643 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664681 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-run-k8s-cni-cncf-io\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664698 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-stats-auth\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664721 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bea5c7b2-5ad1-43f5-8f43-07e3af665d6a-tmp-dir\") pod \"node-resolver-sxszz\" (UID: \"bea5c7b2-5ad1-43f5-8f43-07e3af665d6a\") " pod="openshift-dns/node-resolver-sxszz" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664754 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22e3da9c-5201-4bd9-b247-1caaa18f5d7d-cert\") pod \"ingress-canary-t85sd\" (UID: \"22e3da9c-5201-4bd9-b247-1caaa18f5d7d\") " pod="openshift-ingress-canary/ingress-canary-t85sd" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664830 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-certificates\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664854 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bea5c7b2-5ad1-43f5-8f43-07e3af665d6a-tmp-dir\") pod \"node-resolver-sxszz\" (UID: \"bea5c7b2-5ad1-43f5-8f43-07e3af665d6a\") " pod="openshift-dns/node-resolver-sxszz" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664853 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f941d6e-cd94-47d5-a641-fb608c05a903-metrics-tls\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664912 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-sysconfig\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664946 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-stats-auth\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664959 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22e3da9c-5201-4bd9-b247-1caaa18f5d7d-cert\") pod \"ingress-canary-t85sd\" (UID: \"22e3da9c-5201-4bd9-b247-1caaa18f5d7d\") " pod="openshift-ingress-canary/ingress-canary-t85sd" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.664983 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mww9f\" (UniqueName: \"kubernetes.io/projected/1696437d-23f3-4078-afc4-69e3a94f5ec7-kube-api-access-mww9f\") pod \"migrator-66df5d496b-fx4v7\" (UID: \"1696437d-23f3-4078-afc4-69e3a94f5ec7\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fx4v7" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665016 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/caeeb8a7-4283-4c38-b3be-c036eeeceb65-konnectivity-ca\") pod \"konnectivity-agent-cvpxr\" (UID: \"caeeb8a7-4283-4c38-b3be-c036eeeceb65\") " pod="kube-system/konnectivity-agent-cvpxr" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665055 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jb98m\" (UID: \"28ba2930-e73c-4716-b061-d7cb2bbd0400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665076 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff5da8ed-018c-4182-82f0-a8a3266aff52-host\") pod \"node-ca-fc6gd\" (UID: \"ff5da8ed-018c-4182-82f0-a8a3266aff52\") " pod="openshift-image-registry/node-ca-fc6gd" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665102 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/20ba9ea0-10d3-419c-a429-3a6dcf153171-config\") pod \"service-ca-operator-544d749c8c-5hdqj\" (UID: \"20ba9ea0-10d3-419c-a429-3a6dcf153171\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" Oct 30 20:03:46.665248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665229 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq82v\" (UniqueName: \"kubernetes.io/projected/20ba9ea0-10d3-419c-a429-3a6dcf153171-kube-api-access-jq82v\") pod \"service-ca-operator-544d749c8c-5hdqj\" (UID: \"20ba9ea0-10d3-419c-a429-3a6dcf153171\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665266 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/20ba9ea0-10d3-419c-a429-3a6dcf153171-config\") pod \"service-ca-operator-544d749c8c-5hdqj\" (UID: \"20ba9ea0-10d3-419c-a429-3a6dcf153171\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665292 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f941d6e-cd94-47d5-a641-fb608c05a903-tmp-dir\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665318 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/caeeb8a7-4283-4c38-b3be-c036eeeceb65-konnectivity-ca\") pod \"konnectivity-agent-cvpxr\" (UID: \"caeeb8a7-4283-4c38-b3be-c036eeeceb65\") " pod="kube-system/konnectivity-agent-cvpxr" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665353 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665386 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-socket-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665388 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f941d6e-cd94-47d5-a641-fb608c05a903-tmp-dir\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665417 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-registration-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665452 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-system-cni-dir\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665503 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl424\" (UniqueName: \"kubernetes.io/projected/bea5c7b2-5ad1-43f5-8f43-07e3af665d6a-kube-api-access-hl424\") pod \"node-resolver-sxszz\" (UID: \"bea5c7b2-5ad1-43f5-8f43-07e3af665d6a\") " pod="openshift-dns/node-resolver-sxszz" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665524 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-env-overrides\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665544 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee5e6319-c93c-4713-b99c-9e5660af5192-trusted-ca\") pod \"console-operator-7cd56b8dbc-dr852\" (UID: \"ee5e6319-c93c-4713-b99c-9e5660af5192\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665560 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlxdg\" (UniqueName: \"kubernetes.io/projected/2e5941e6-4fc9-4353-a518-8ad492e9ad61-kube-api-access-jlxdg\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665581 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-kubernetes\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665604 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-default-certificate\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665621 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmj4v\" (UniqueName: \"kubernetes.io/projected/fbfa2cf8-ef21-4485-91f3-6ca0b0b0d55d-kube-api-access-tmj4v\") pod \"network-check-source-6f78d59f99-sb9tl\" (UID: \"fbfa2cf8-ef21-4485-91f3-6ca0b0b0d55d\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-sb9tl" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665640 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-kubelet\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665665 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7f941d6e-cd94-47d5-a641-fb608c05a903-config-volume\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665695 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9dabf5d4-7787-40b3-b01e-fe430c316887-dbus\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665720 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-env-overrides\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665779 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-sys-fs\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665879 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9dabf5d4-7787-40b3-b01e-fe430c316887-kubelet-config\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665886 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7f941d6e-cd94-47d5-a641-fb608c05a903-config-volume\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665887 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee5e6319-c93c-4713-b99c-9e5660af5192-trusted-ca\") pod \"console-operator-7cd56b8dbc-dr852\" (UID: \"ee5e6319-c93c-4713-b99c-9e5660af5192\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665897 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-default-certificate\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665928 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfdr6\" (UniqueName: \"kubernetes.io/projected/364408a3-5d56-4e76-9c96-a2a08841b50f-kube-api-access-nfdr6\") pod \"kas-connection-checker-685895c7c9-ffthk\" (UID: \"364408a3-5d56-4e76-9c96-a2a08841b50f\") " pod="kube-system/kas-connection-checker-685895c7c9-ffthk" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665972 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs\") pod \"network-metrics-daemon-698hj\" (UID: \"f69d831c-d9e4-4060-a2bd-9d85265000f6\") " pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.665988 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-cni-netd\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666009 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-systemd\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666042 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-run\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666070 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44fgw\" (UniqueName: \"kubernetes.io/projected/f5dddacb-f3d8-43cc-9191-c9f63e56db20-kube-api-access-44fgw\") pod \"volume-data-source-validator-58c9f5f46d-s4s25\" (UID: \"f5dddacb-f3d8-43cc-9191-c9f63e56db20\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-s4s25" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666089 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-bound-sa-token\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:46.666187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666136 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-slash\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666262 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-var-lib-openvswitch\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666299 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f847152-ec65-4b3c-bcb6-d8cac177e31d-trusted-ca-bundle\") pod \"periodic-gathering-qqhv7-c6vvh\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666348 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666376 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14006e48-475b-4dbe-8994-1f908f897884-cnibin\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666404 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/27e4937d-367a-4ccc-9580-74a3982a49fe-image-registry-private-configuration\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666444 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgk5m\" (UniqueName: \"kubernetes.io/projected/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-api-access-kgk5m\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666478 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-run-openvswitch\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666597 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/27e4937d-367a-4ccc-9580-74a3982a49fe-image-registry-private-configuration\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666601 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-run-ovn-kubernetes\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666601 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f847152-ec65-4b3c-bcb6-d8cac177e31d-trusted-ca-bundle\") pod \"periodic-gathering-qqhv7-c6vvh\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666643 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14006e48-475b-4dbe-8994-1f908f897884-system-cni-dir\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666676 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9dabf5d4-7787-40b3-b01e-fe430c316887-original-pull-secret\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666682 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae25b031-7ac9-4041-bc3a-7a6679eab74d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-gksz8\" (UID: \"ae25b031-7ac9-4041-bc3a-7a6679eab74d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-gksz8" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666710 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666763 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/adb774f6-0266-4c60-92e9-f0a5f8ac831e-snapshots\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666807 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvl5j\" (UniqueName: \"kubernetes.io/projected/fdac1f33-fb1f-4835-bbec-f34005f53979-kube-api-access-rvl5j\") pod \"migrator-66df5d496b-zkfjx\" (UID: \"fdac1f33-fb1f-4835-bbec-f34005f53979\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-zkfjx" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666846 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/adb774f6-0266-4c60-92e9-f0a5f8ac831e-snapshots\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666859 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6m8f\" (UniqueName: \"kubernetes.io/projected/14006e48-475b-4dbe-8994-1f908f897884-kube-api-access-q6m8f\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666878 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ff5da8ed-018c-4182-82f0-a8a3266aff52-serviceca\") pod \"node-ca-fc6gd\" (UID: \"ff5da8ed-018c-4182-82f0-a8a3266aff52\") " pod="openshift-image-registry/node-ca-fc6gd" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666902 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ae25b031-7ac9-4041-bc3a-7a6679eab74d-nginx-conf\") pod \"networking-console-plugin-86c478bb88-gksz8\" (UID: \"ae25b031-7ac9-4041-bc3a-7a6679eab74d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-gksz8" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666930 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ac859bf-692b-4447-891a-32541e1e244d-image-registry-private-configuration\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666956 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-ovnkube-script-lib\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.666987 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-sys\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667012 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/27e4937d-367a-4ccc-9580-74a3982a49fe-installation-pull-secrets\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667042 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8af5bdb-cf19-4210-85c0-815d452cb701-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz\" (UID: \"e8af5bdb-cf19-4210-85c0-815d452cb701\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667070 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6ce6c965-80be-4c82-826c-a9dc4dd19592-signing-cabundle\") pod \"service-ca-5fffc97bdf-wktp2\" (UID: \"6ce6c965-80be-4c82-826c-a9dc4dd19592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wktp2" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667095 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-data-volume\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667122 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzghk\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-kube-api-access-qzghk\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667152 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ae25b031-7ac9-4041-bc3a-7a6679eab74d-nginx-conf\") pod \"networking-console-plugin-86c478bb88-gksz8\" (UID: \"ae25b031-7ac9-4041-bc3a-7a6679eab74d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-gksz8" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667147 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ac859bf-692b-4447-891a-32541e1e244d-ca-trust-extracted\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667198 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-sysctl-d\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667218 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-ovnkube-script-lib\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667225 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-socket-dir-parent\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667227 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ac859bf-692b-4447-891a-32541e1e244d-ca-trust-extracted\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667255 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-daemon-config\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667285 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adb774f6-0266-4c60-92e9-f0a5f8ac831e-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667399 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjzcw\" (UniqueName: \"kubernetes.io/projected/ee5e6319-c93c-4713-b99c-9e5660af5192-kube-api-access-tjzcw\") pod \"console-operator-7cd56b8dbc-dr852\" (UID: \"ee5e6319-c93c-4713-b99c-9e5660af5192\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667426 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/27e4937d-367a-4ccc-9580-74a3982a49fe-installation-pull-secrets\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667434 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27e4937d-367a-4ccc-9580-74a3982a49fe-trusted-ca\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667441 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6ce6c965-80be-4c82-826c-a9dc4dd19592-signing-cabundle\") pod \"service-ca-5fffc97bdf-wktp2\" (UID: \"6ce6c965-80be-4c82-826c-a9dc4dd19592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wktp2" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667462 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-bbm2j\" (UID: \"24b57f65-bf27-4659-a922-83a241893696\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:46.667508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667491 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-crio-socket\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667537 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ff5da8ed-018c-4182-82f0-a8a3266aff52-serviceca\") pod \"node-ca-fc6gd\" (UID: \"ff5da8ed-018c-4182-82f0-a8a3266aff52\") " pod="openshift-image-registry/node-ca-fc6gd" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667585 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8af5bdb-cf19-4210-85c0-815d452cb701-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz\" (UID: \"e8af5bdb-cf19-4210-85c0-815d452cb701\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667606 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf4tm\" (UniqueName: \"kubernetes.io/projected/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-kube-api-access-mf4tm\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667673 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-data-volume\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667724 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-hostroot\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667745 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ac859bf-692b-4447-891a-32541e1e244d-image-registry-private-configuration\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667755 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-conf-dir\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667755 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-daemon-config\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667798 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ac859bf-692b-4447-891a-32541e1e244d-registry-certificates\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667854 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spmg8\" (UniqueName: \"kubernetes.io/projected/e8af5bdb-cf19-4210-85c0-815d452cb701-kube-api-access-spmg8\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz\" (UID: \"e8af5bdb-cf19-4210-85c0-815d452cb701\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667883 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4452f26-53ff-4b31-9417-f550aa50c38d-host-slash\") pod \"iptables-alerter-5hfvr\" (UID: \"d4452f26-53ff-4b31-9417-f550aa50c38d\") " pod="openshift-network-operator/iptables-alerter-5hfvr" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667933 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adb774f6-0266-4c60-92e9-f0a5f8ac831e-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.667987 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-etc-kubernetes\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.668035 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.668074 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ac859bf-692b-4447-891a-32541e1e244d-installation-pull-secrets\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.668169 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27e4937d-367a-4ccc-9580-74a3982a49fe-trusted-ca\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.668158 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-bound-sa-token\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.668213 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-etc-openvswitch\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.668258 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ac859bf-692b-4447-891a-32541e1e244d-installation-pull-secrets\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.668282 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-var-lib-kubelet\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.668315 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2cpl\" (UniqueName: \"kubernetes.io/projected/a7d2c4e7-accb-4388-97c7-62c0b40ebb4c-kube-api-access-r2cpl\") pod \"kas-connection-checker-685895c7c9-xh8v8\" (UID: \"a7d2c4e7-accb-4388-97c7-62c0b40ebb4c\") " pod="kube-system/kas-connection-checker-685895c7c9-xh8v8" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.668370 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.668462 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adb774f6-0266-4c60-92e9-f0a5f8ac831e-service-ca-bundle\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.668515 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ac859bf-692b-4447-891a-32541e1e244d-registry-certificates\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:46.668980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.668879 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adb774f6-0266-4c60-92e9-f0a5f8ac831e-service-ca-bundle\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:46.674678 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.674634 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4hpl\" (UniqueName: \"kubernetes.io/projected/f69d831c-d9e4-4060-a2bd-9d85265000f6-kube-api-access-l4hpl\") pod \"network-metrics-daemon-698hj\" (UID: \"f69d831c-d9e4-4060-a2bd-9d85265000f6\") " pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:46.674824 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.674747 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb7sg\" (UniqueName: \"kubernetes.io/projected/7f941d6e-cd94-47d5-a641-fb608c05a903-kube-api-access-bb7sg\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:46.675076 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.674935 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssghm\" (UniqueName: \"kubernetes.io/projected/6ce6c965-80be-4c82-826c-a9dc4dd19592-kube-api-access-ssghm\") pod \"service-ca-5fffc97bdf-wktp2\" (UID: \"6ce6c965-80be-4c82-826c-a9dc4dd19592\") " pod="openshift-service-ca/service-ca-5fffc97bdf-wktp2" Oct 30 20:03:46.675076 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.675013 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnfwb\" (UniqueName: \"kubernetes.io/projected/adb774f6-0266-4c60-92e9-f0a5f8ac831e-kube-api-access-qnfwb\") pod \"insights-operator-7c4986d449-c262w\" (UID: \"adb774f6-0266-4c60-92e9-f0a5f8ac831e\") " pod="openshift-insights/insights-operator-7c4986d449-c262w" Oct 30 20:03:46.675076 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.675020 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b644\" (UniqueName: \"kubernetes.io/projected/24b57f65-bf27-4659-a922-83a241893696-kube-api-access-4b644\") pod \"cluster-monitoring-operator-884576c57-bbm2j\" (UID: \"24b57f65-bf27-4659-a922-83a241893696\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:46.675272 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.675203 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jncv5\" (UniqueName: \"kubernetes.io/projected/28ba2930-e73c-4716-b061-d7cb2bbd0400-kube-api-access-jncv5\") pod \"cluster-samples-operator-6ddb6c8b94-jb98m\" (UID: \"28ba2930-e73c-4716-b061-d7cb2bbd0400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:46.675370 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.675289 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsppj\" (UniqueName: \"kubernetes.io/projected/d4452f26-53ff-4b31-9417-f550aa50c38d-kube-api-access-qsppj\") pod \"iptables-alerter-5hfvr\" (UID: \"d4452f26-53ff-4b31-9417-f550aa50c38d\") " pod="openshift-network-operator/iptables-alerter-5hfvr" Oct 30 20:03:46.675370 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.675291 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s8zr\" (UniqueName: \"kubernetes.io/projected/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-kube-api-access-8s8zr\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:46.675461 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.675367 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nkhw\" (UniqueName: \"kubernetes.io/projected/93a3069b-7891-4146-a085-7b218eeff695-kube-api-access-2nkhw\") pod \"kas-connection-checker-685895c7c9-4zrr5\" (UID: \"93a3069b-7891-4146-a085-7b218eeff695\") " pod="kube-system/kas-connection-checker-685895c7c9-4zrr5" Oct 30 20:03:46.675680 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.675660 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7846l\" (UniqueName: \"kubernetes.io/projected/f8c5839e-f557-4e1d-a26f-17102c15ff8e-kube-api-access-7846l\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.675781 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.675767 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mww9f\" (UniqueName: \"kubernetes.io/projected/1696437d-23f3-4078-afc4-69e3a94f5ec7-kube-api-access-mww9f\") pod \"migrator-66df5d496b-fx4v7\" (UID: \"1696437d-23f3-4078-afc4-69e3a94f5ec7\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fx4v7" Oct 30 20:03:46.675815 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.675797 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvqn4\" (UniqueName: \"kubernetes.io/projected/22e3da9c-5201-4bd9-b247-1caaa18f5d7d-kube-api-access-rvqn4\") pod \"ingress-canary-t85sd\" (UID: \"22e3da9c-5201-4bd9-b247-1caaa18f5d7d\") " pod="openshift-ingress-canary/ingress-canary-t85sd" Oct 30 20:03:46.675845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.675815 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9px9m\" (UniqueName: \"kubernetes.io/projected/1f847152-ec65-4b3c-bcb6-d8cac177e31d-kube-api-access-9px9m\") pod \"periodic-gathering-qqhv7-c6vvh\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:03:46.679080 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.679058 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk9xw\" (UniqueName: \"kubernetes.io/projected/ff5da8ed-018c-4182-82f0-a8a3266aff52-kube-api-access-sk9xw\") pod \"node-ca-fc6gd\" (UID: \"ff5da8ed-018c-4182-82f0-a8a3266aff52\") " pod="openshift-image-registry/node-ca-fc6gd" Oct 30 20:03:46.679149 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.679127 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr5cv\" (UniqueName: \"kubernetes.io/projected/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-kube-api-access-zr5cv\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.679229 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.679171 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnl5q\" (UniqueName: \"kubernetes.io/projected/9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e-kube-api-access-xnl5q\") pod \"network-check-target-l5w4q\" (UID: \"9062fd01-6aa0-4de9-ad7a-63e94ff4fa5e\") " pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:46.679229 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.679187 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsbbs\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-kube-api-access-fsbbs\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:46.680578 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.680560 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlxdg\" (UniqueName: \"kubernetes.io/projected/2e5941e6-4fc9-4353-a518-8ad492e9ad61-kube-api-access-jlxdg\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:46.680938 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.680920 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq82v\" (UniqueName: \"kubernetes.io/projected/20ba9ea0-10d3-419c-a429-3a6dcf153171-kube-api-access-jq82v\") pod \"service-ca-operator-544d749c8c-5hdqj\" (UID: \"20ba9ea0-10d3-419c-a429-3a6dcf153171\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" Oct 30 20:03:46.681154 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.681139 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl424\" (UniqueName: \"kubernetes.io/projected/bea5c7b2-5ad1-43f5-8f43-07e3af665d6a-kube-api-access-hl424\") pod \"node-resolver-sxszz\" (UID: \"bea5c7b2-5ad1-43f5-8f43-07e3af665d6a\") " pod="openshift-dns/node-resolver-sxszz" Oct 30 20:03:46.682724 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.682706 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfdr6\" (UniqueName: \"kubernetes.io/projected/364408a3-5d56-4e76-9c96-a2a08841b50f-kube-api-access-nfdr6\") pod \"kas-connection-checker-685895c7c9-ffthk\" (UID: \"364408a3-5d56-4e76-9c96-a2a08841b50f\") " pod="kube-system/kas-connection-checker-685895c7c9-ffthk" Oct 30 20:03:46.683180 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.683159 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44fgw\" (UniqueName: \"kubernetes.io/projected/f5dddacb-f3d8-43cc-9191-c9f63e56db20-kube-api-access-44fgw\") pod \"volume-data-source-validator-58c9f5f46d-s4s25\" (UID: \"f5dddacb-f3d8-43cc-9191-c9f63e56db20\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-s4s25" Oct 30 20:03:46.683448 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.683433 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmj4v\" (UniqueName: \"kubernetes.io/projected/fbfa2cf8-ef21-4485-91f3-6ca0b0b0d55d-kube-api-access-tmj4v\") pod \"network-check-source-6f78d59f99-sb9tl\" (UID: \"fbfa2cf8-ef21-4485-91f3-6ca0b0b0d55d\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-sb9tl" Oct 30 20:03:46.684967 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.684944 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvl5j\" (UniqueName: \"kubernetes.io/projected/fdac1f33-fb1f-4835-bbec-f34005f53979-kube-api-access-rvl5j\") pod \"migrator-66df5d496b-zkfjx\" (UID: \"fdac1f33-fb1f-4835-bbec-f34005f53979\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-zkfjx" Oct 30 20:03:46.685821 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.685797 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjzcw\" (UniqueName: \"kubernetes.io/projected/ee5e6319-c93c-4713-b99c-9e5660af5192-kube-api-access-tjzcw\") pod \"console-operator-7cd56b8dbc-dr852\" (UID: \"ee5e6319-c93c-4713-b99c-9e5660af5192\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:46.686086 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.686070 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2cpl\" (UniqueName: \"kubernetes.io/projected/a7d2c4e7-accb-4388-97c7-62c0b40ebb4c-kube-api-access-r2cpl\") pod \"kas-connection-checker-685895c7c9-xh8v8\" (UID: \"a7d2c4e7-accb-4388-97c7-62c0b40ebb4c\") " pod="kube-system/kas-connection-checker-685895c7c9-xh8v8" Oct 30 20:03:46.686195 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.686176 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-bound-sa-token\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:46.688025 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.688003 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spmg8\" (UniqueName: \"kubernetes.io/projected/e8af5bdb-cf19-4210-85c0-815d452cb701-kube-api-access-spmg8\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz\" (UID: \"e8af5bdb-cf19-4210-85c0-815d452cb701\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" Oct 30 20:03:46.688129 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.688108 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-bound-sa-token\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:46.688202 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.688182 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6m8f\" (UniqueName: \"kubernetes.io/projected/14006e48-475b-4dbe-8994-1f908f897884-kube-api-access-q6m8f\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:46.688377 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.688324 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgk5m\" (UniqueName: \"kubernetes.io/projected/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-api-access-kgk5m\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:46.691181 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.691161 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf4tm\" (UniqueName: \"kubernetes.io/projected/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-kube-api-access-mf4tm\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.691415 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.691398 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzghk\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-kube-api-access-qzghk\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:46.769843 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.769811 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-hostroot\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.769843 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.769844 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-conf-dir\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.770094 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.769865 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4452f26-53ff-4b31-9417-f550aa50c38d-host-slash\") pod \"iptables-alerter-5hfvr\" (UID: \"d4452f26-53ff-4b31-9417-f550aa50c38d\") " pod="openshift-network-operator/iptables-alerter-5hfvr" Oct 30 20:03:46.770094 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.769879 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-etc-kubernetes\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.770094 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.769894 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:46.770094 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.769955 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-conf-dir\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.770094 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.769974 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4452f26-53ff-4b31-9417-f550aa50c38d-host-slash\") pod \"iptables-alerter-5hfvr\" (UID: \"d4452f26-53ff-4b31-9417-f550aa50c38d\") " pod="openshift-network-operator/iptables-alerter-5hfvr" Oct 30 20:03:46.770094 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.769954 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-hostroot\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.770094 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.769980 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-etc-kubernetes\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.770094 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770013 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-etc-openvswitch\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.770094 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770039 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-etc-openvswitch\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.770094 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770053 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-var-lib-kubelet\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.770094 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770077 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770116 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-var-lib-cni-multus\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770114 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-var-lib-kubelet\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770143 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-run-ovn\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770166 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-device-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770209 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-host\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770216 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-var-lib-cni-multus\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:46.770213 5078 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770229 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-run-ovn\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770235 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-lib-modules\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770270 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-device-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770276 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-host\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770312 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bea5c7b2-5ad1-43f5-8f43-07e3af665d6a-hosts-file\") pod \"node-resolver-sxszz\" (UID: \"bea5c7b2-5ad1-43f5-8f43-07e3af665d6a\") " pod="openshift-dns/node-resolver-sxszz" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:46.770366 5078 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls podName:b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc nodeName:}" failed. No retries permitted until 2026-10-30 20:03:47.270320022 +0000 UTC m=+1.803592611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-js96l" (UID: "b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc") : secret "insights-runtime-extractor-tls" not found Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770388 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bea5c7b2-5ad1-43f5-8f43-07e3af665d6a-hosts-file\") pod \"node-resolver-sxszz\" (UID: \"bea5c7b2-5ad1-43f5-8f43-07e3af665d6a\") " pod="openshift-dns/node-resolver-sxszz" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770396 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-lib-modules\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770396 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770432 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770466 5078 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770495 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-run-systemd\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770520 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-etc-selinux\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770559 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-sysctl-conf\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770578 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-run-systemd\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770586 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-var-lib-cni-bin\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770591 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-etc-selinux\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770610 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-run-multus-certs\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.770610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770629 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770638 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-var-lib-cni-bin\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770694 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-run-multus-certs\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770670 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-var-lib-kubelet\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770719 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-sysctl-conf\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770750 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-metrics-certs\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770752 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-var-lib-kubelet\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770777 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-systemd-units\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770812 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14006e48-475b-4dbe-8994-1f908f897884-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770864 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-run-netns\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770865 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-systemd-units\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770887 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-cni-bin\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770927 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-run-netns\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770937 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-cni-bin\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770940 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14006e48-475b-4dbe-8994-1f908f897884-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770959 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-cni-dir\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.770986 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-cnibin\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771010 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-cni-dir\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771014 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-modprobe-d\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771047 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-log-socket\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771071 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-run-netns\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771096 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-node-log\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771120 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771142 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-modprobe-d\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771146 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-cnibin\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771146 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-run-k8s-cni-cncf-io\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771176 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-run-k8s-cni-cncf-io\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771187 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f941d6e-cd94-47d5-a641-fb608c05a903-metrics-tls\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771195 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-host-run-netns\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771204 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-sysconfig\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771214 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-node-log\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771232 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jb98m\" (UID: \"28ba2930-e73c-4716-b061-d7cb2bbd0400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771238 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-log-socket\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771239 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771288 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff5da8ed-018c-4182-82f0-a8a3266aff52-host\") pod \"node-ca-fc6gd\" (UID: \"ff5da8ed-018c-4182-82f0-a8a3266aff52\") " pod="openshift-image-registry/node-ca-fc6gd" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771289 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-sysconfig\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771359 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff5da8ed-018c-4182-82f0-a8a3266aff52-host\") pod \"node-ca-fc6gd\" (UID: \"ff5da8ed-018c-4182-82f0-a8a3266aff52\") " pod="openshift-image-registry/node-ca-fc6gd" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771349 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771381 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771416 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-socket-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771460 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-registration-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771488 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-system-cni-dir\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771486 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-socket-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771544 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-system-cni-dir\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771550 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-registration-dir\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771575 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-kubernetes\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:46.771620 5078 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle podName:2e5941e6-4fc9-4353-a518-8ad492e9ad61 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:47.271602943 +0000 UTC m=+1.804875529 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle") pod "router-default-7f94f8f65c-dqcj8" (UID: "2e5941e6-4fc9-4353-a518-8ad492e9ad61") : configmap references non-existent config key: service-ca.crt Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771675 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-kubernetes\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771685 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-kubelet\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771715 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9dabf5d4-7787-40b3-b01e-fe430c316887-dbus\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771735 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-kubelet\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771740 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-sys-fs\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771763 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9dabf5d4-7787-40b3-b01e-fe430c316887-kubelet-config\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771791 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs\") pod \"network-metrics-daemon-698hj\" (UID: \"f69d831c-d9e4-4060-a2bd-9d85265000f6\") " pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771807 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9dabf5d4-7787-40b3-b01e-fe430c316887-dbus\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:46.771810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771815 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-cni-netd\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771858 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9dabf5d4-7787-40b3-b01e-fe430c316887-kubelet-config\") pod \"global-pull-secret-syncer-dw59s\" (UID: \"9dabf5d4-7787-40b3-b01e-fe430c316887\") " pod="kube-system/global-pull-secret-syncer-dw59s" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771860 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a8ee251-819c-4ea5-8d6a-6211fdf7e00a-sys-fs\") pod \"aws-ebs-csi-driver-node-plmh6\" (UID: \"4a8ee251-819c-4ea5-8d6a-6211fdf7e00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plmh6" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771871 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-cni-netd\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771927 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-systemd\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771952 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-run\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771992 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-slash\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.771997 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-systemd\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772014 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-var-lib-openvswitch\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772048 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-run\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772054 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14006e48-475b-4dbe-8994-1f908f897884-cnibin\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772078 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-slash\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772096 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-var-lib-openvswitch\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772131 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-run-openvswitch\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772127 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14006e48-475b-4dbe-8994-1f908f897884-cnibin\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772162 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-run-ovn-kubernetes\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772181 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-run-openvswitch\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772209 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14006e48-475b-4dbe-8994-1f908f897884-system-cni-dir\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772228 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d28c2db0-9b9a-4c34-a78f-cbf24f67ac45-host-run-ovn-kubernetes\") pod \"ovnkube-node-df4d8\" (UID: \"d28c2db0-9b9a-4c34-a78f-cbf24f67ac45\") " pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772246 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae25b031-7ac9-4041-bc3a-7a6679eab74d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-gksz8\" (UID: \"ae25b031-7ac9-4041-bc3a-7a6679eab74d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-gksz8" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772284 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772317 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-sys\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772387 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-sysctl-d\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772412 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-socket-dir-parent\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772457 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-bbm2j\" (UID: \"24b57f65-bf27-4659-a922-83a241893696\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772481 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-crio-socket\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772614 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-crio-socket\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772706 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-etc-sysctl-d\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772284 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14006e48-475b-4dbe-8994-1f908f897884-system-cni-dir\") pod \"multus-additional-cni-plugins-tvkf2\" (UID: \"14006e48-475b-4dbe-8994-1f908f897884\") " pod="openshift-multus/multus-additional-cni-plugins-tvkf2" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772768 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8c5839e-f557-4e1d-a26f-17102c15ff8e-sys\") pod \"tuned-2sftq\" (UID: \"f8c5839e-f557-4e1d-a26f-17102c15ff8e\") " pod="openshift-cluster-node-tuning-operator/tuned-2sftq" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.772782 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/285be4c1-3c4f-4972-b8fa-7f37f92d72bb-multus-socket-dir-parent\") pod \"multus-qspzv\" (UID: \"285be4c1-3c4f-4972-b8fa-7f37f92d72bb\") " pod="openshift-multus/multus-qspzv" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:46.772900 5078 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:46.772953 5078 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls podName:24b57f65-bf27-4659-a922-83a241893696 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:47.272937609 +0000 UTC m=+1.806210195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-bbm2j" (UID: "24b57f65-bf27-4659-a922-83a241893696") : secret "cluster-monitoring-operator-tls" not found Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.773649 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e5941e6-4fc9-4353-a518-8ad492e9ad61-metrics-certs\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:46.774600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.773935 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f941d6e-cd94-47d5-a641-fb608c05a903-metrics-tls\") pod \"dns-default-hd99r\" (UID: \"7f941d6e-cd94-47d5-a641-fb608c05a903\") " pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:46.776259 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.774781 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f69d831c-d9e4-4060-a2bd-9d85265000f6-metrics-certs\") pod \"network-metrics-daemon-698hj\" (UID: \"f69d831c-d9e4-4060-a2bd-9d85265000f6\") " pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:46.776259 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.775396 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae25b031-7ac9-4041-bc3a-7a6679eab74d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-gksz8\" (UID: \"ae25b031-7ac9-4041-bc3a-7a6679eab74d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-gksz8" Oct 30 20:03:46.776259 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.775418 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls\") pod \"image-registry-8586cfd6bb-wzm9m\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:46.776259 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.775592 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls\") pod \"image-registry-75c856df5f-jdst9\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:46.776259 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.776136 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28ba2930-e73c-4716-b061-d7cb2bbd0400-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jb98m\" (UID: \"28ba2930-e73c-4716-b061-d7cb2bbd0400\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:46.849538 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.849503 5078 scope.go:122] "RemoveContainer" containerID="347addf553f8c84e3334f4a707bf8f84da8f3d56f4e94ea30c7f293c0fbf0b2e" Oct 30 20:03:46.849855 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.849827 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:46.851013 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.850953 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" Oct 30 20:03:46.852311 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.852293 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-gksz8" Oct 30 20:03:46.865222 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.865180 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-698hj" Oct 30 20:03:46.867357 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.866302 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:46.868517 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:46.868488 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:47.157183 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.157106 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m"] Oct 30 20:03:47.162627 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.162600 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75c856df5f-jdst9"] Oct 30 20:03:47.166446 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:47.166413 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ac859bf_692b_4447_891a_32541e1e244d.slice/crio-ba5bfb82363f997b0f5957c90d5d6d4d45f35cb7944e7b0744377eb4068830b0 WatchSource:0}: Error finding container ba5bfb82363f997b0f5957c90d5d6d4d45f35cb7944e7b0744377eb4068830b0: Status 404 returned error can't find the container with id ba5bfb82363f997b0f5957c90d5d6d4d45f35cb7944e7b0744377eb4068830b0 Oct 30 20:03:47.171318 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.171299 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-gksz8"] Oct 30 20:03:47.179592 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:47.178266 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae25b031_7ac9_4041_bc3a_7a6679eab74d.slice/crio-d5114f7f06477352bf20259f4ce66e4c124f317c928c2a6de037522bccc2cf78 WatchSource:0}: Error finding container d5114f7f06477352bf20259f4ce66e4c124f317c928c2a6de037522bccc2cf78: Status 404 returned error can't find the container with id d5114f7f06477352bf20259f4ce66e4c124f317c928c2a6de037522bccc2cf78 Oct 30 20:03:47.182152 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.181180 5078 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 20:03:47.213234 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.212825 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8586cfd6bb-wzm9m"] Oct 30 20:03:47.237929 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.237900 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hd99r"] Oct 30 20:03:47.239519 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:47.239491 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e4937d_367a_4ccc_9580_74a3982a49fe.slice/crio-6033e17f791253f8fe61a0cdac7d05b1fbff1712410dd8688bbd34c881715f3c WatchSource:0}: Error finding container 6033e17f791253f8fe61a0cdac7d05b1fbff1712410dd8688bbd34c881715f3c: Status 404 returned error can't find the container with id 6033e17f791253f8fe61a0cdac7d05b1fbff1712410dd8688bbd34c881715f3c Oct 30 20:03:47.241210 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:47.241178 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f941d6e_cd94_47d5_a641_fb608c05a903.slice/crio-06ee25da54b499c5643f730f91bf67681aa5e23224653d0c77aa88800e08ceb2 WatchSource:0}: Error finding container 06ee25da54b499c5643f730f91bf67681aa5e23224653d0c77aa88800e08ceb2: Status 404 returned error can't find the container with id 06ee25da54b499c5643f730f91bf67681aa5e23224653d0c77aa88800e08ceb2 Oct 30 20:03:47.245098 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.245076 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-698hj"] Oct 30 20:03:47.289444 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.288860 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-bbm2j\" (UID: \"24b57f65-bf27-4659-a922-83a241893696\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:47.289444 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.288908 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:47.289444 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.288973 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:47.289444 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:47.289156 5078 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 20:03:47.289444 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:47.289226 5078 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls podName:24b57f65-bf27-4659-a922-83a241893696 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:48.289199096 +0000 UTC m=+2.822471684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-bbm2j" (UID: "24b57f65-bf27-4659-a922-83a241893696") : secret "cluster-monitoring-operator-tls" not found Oct 30 20:03:47.289444 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:47.289289 5078 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 20:03:47.289444 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:47.289320 5078 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls podName:b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc nodeName:}" failed. No retries permitted until 2026-10-30 20:03:48.289310108 +0000 UTC m=+2.822582695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-js96l" (UID: "b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc") : secret "insights-runtime-extractor-tls" not found Oct 30 20:03:47.289444 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:47.289422 5078 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle podName:2e5941e6-4fc9-4353-a518-8ad492e9ad61 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:48.289412463 +0000 UTC m=+2.822685049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle") pod "router-default-7f94f8f65c-dqcj8" (UID: "2e5941e6-4fc9-4353-a518-8ad492e9ad61") : configmap references non-existent config key: service-ca.crt Oct 30 20:03:47.645502 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.645473 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/1.log" Oct 30 20:03:47.645930 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.645560 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" event={"ID":"ee5e6319-c93c-4713-b99c-9e5660af5192","Type":"ContainerStarted","Data":"95fbec0396b8c0c47ac9a8103a1f166c6609401210e987008bddc8241d18317b"} Oct 30 20:03:47.647578 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.647549 5078 generic.go:356] "Generic (PLEG): container finished" podID="adb774f6-0266-4c60-92e9-f0a5f8ac831e" containerID="356431446b400958ea088de978170341092781b326aab41598fd69f4a628ed08" exitCode=0 Oct 30 20:03:47.647725 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.647644 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-c262w" event={"ID":"adb774f6-0266-4c60-92e9-f0a5f8ac831e","Type":"ContainerDied","Data":"356431446b400958ea088de978170341092781b326aab41598fd69f4a628ed08"} Oct 30 20:03:47.647938 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.647920 5078 scope.go:122] "RemoveContainer" containerID="356431446b400958ea088de978170341092781b326aab41598fd69f4a628ed08" Oct 30 20:03:47.649696 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.649671 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-698hj" event={"ID":"f69d831c-d9e4-4060-a2bd-9d85265000f6","Type":"ContainerStarted","Data":"28c7d8b4affef2efe925771e1403d68bc8d1a3b017bb9678453f1e484044266b"} Oct 30 20:03:47.659648 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.659612 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hd99r" event={"ID":"7f941d6e-cd94-47d5-a641-fb608c05a903","Type":"ContainerStarted","Data":"06ee25da54b499c5643f730f91bf67681aa5e23224653d0c77aa88800e08ceb2"} Oct 30 20:03:47.660916 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.660893 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-gksz8" event={"ID":"ae25b031-7ac9-4041-bc3a-7a6679eab74d","Type":"ContainerStarted","Data":"d5114f7f06477352bf20259f4ce66e4c124f317c928c2a6de037522bccc2cf78"} Oct 30 20:03:47.662412 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.662387 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" event={"ID":"27e4937d-367a-4ccc-9580-74a3982a49fe","Type":"ContainerStarted","Data":"34c90b73947f943a023b0b57e7fa83fb110d82afb7c0450a735c52f804878835"} Oct 30 20:03:47.662514 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.662438 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" event={"ID":"27e4937d-367a-4ccc-9580-74a3982a49fe","Type":"ContainerStarted","Data":"6033e17f791253f8fe61a0cdac7d05b1fbff1712410dd8688bbd34c881715f3c"} Oct 30 20:03:47.663413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.663386 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" event={"ID":"28ba2930-e73c-4716-b061-d7cb2bbd0400","Type":"ContainerStarted","Data":"21a71b1b9a9a47c5621325f85446c4efd91acb358bae27b9a504ea757ce78ad9"} Oct 30 20:03:47.666834 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.666805 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c856df5f-jdst9" event={"ID":"4ac859bf-692b-4447-891a-32541e1e244d","Type":"ContainerStarted","Data":"fc1005743512a2f232b747e2c6fc756e181431d7e2159697d8101493b15576c3"} Oct 30 20:03:47.666922 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.666856 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c856df5f-jdst9" event={"ID":"4ac859bf-692b-4447-891a-32541e1e244d","Type":"ContainerStarted","Data":"ba5bfb82363f997b0f5957c90d5d6d4d45f35cb7944e7b0744377eb4068830b0"} Oct 30 20:03:47.826792 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.819468 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:47.831811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:47.827804 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-dr852" Oct 30 20:03:48.299521 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:48.298852 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:48.299521 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:48.298957 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:48.299521 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:48.299000 5078 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 20:03:48.299521 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:48.299024 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-bbm2j\" (UID: \"24b57f65-bf27-4659-a922-83a241893696\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:48.299521 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:48.299085 5078 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls podName:b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc nodeName:}" failed. No retries permitted until 2026-10-30 20:03:50.299068834 +0000 UTC m=+4.832341410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-js96l" (UID: "b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc") : secret "insights-runtime-extractor-tls" not found Oct 30 20:03:48.299521 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:48.299488 5078 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle podName:2e5941e6-4fc9-4353-a518-8ad492e9ad61 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:50.299472546 +0000 UTC m=+4.832745117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle") pod "router-default-7f94f8f65c-dqcj8" (UID: "2e5941e6-4fc9-4353-a518-8ad492e9ad61") : configmap references non-existent config key: service-ca.crt Oct 30 20:03:48.302209 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:48.302156 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24b57f65-bf27-4659-a922-83a241893696-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-bbm2j\" (UID: \"24b57f65-bf27-4659-a922-83a241893696\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:48.350464 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:48.350410 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" Oct 30 20:03:48.644714 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:48.644589 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j"] Oct 30 20:03:48.649092 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:48.649067 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b57f65_bf27_4659_a922_83a241893696.slice/crio-6bfca69c309331b886022ad01f548bfb599f78b2d06b89c0d0d942c09b2c4c3e WatchSource:0}: Error finding container 6bfca69c309331b886022ad01f548bfb599f78b2d06b89c0d0d942c09b2c4c3e: Status 404 returned error can't find the container with id 6bfca69c309331b886022ad01f548bfb599f78b2d06b89c0d0d942c09b2c4c3e Oct 30 20:03:48.677641 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:48.676634 5078 generic.go:356] "Generic (PLEG): container finished" podID="20ba9ea0-10d3-419c-a429-3a6dcf153171" containerID="f4e65a71f01c261674d30498663ff163fbd98e67f4596833685278e507843529" exitCode=0 Oct 30 20:03:48.677641 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:48.676702 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" event={"ID":"20ba9ea0-10d3-419c-a429-3a6dcf153171","Type":"ContainerDied","Data":"f4e65a71f01c261674d30498663ff163fbd98e67f4596833685278e507843529"} Oct 30 20:03:48.677641 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:48.677049 5078 scope.go:122] "RemoveContainer" containerID="f4e65a71f01c261674d30498663ff163fbd98e67f4596833685278e507843529" Oct 30 20:03:48.681426 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:48.680954 5078 generic.go:356] "Generic (PLEG): container finished" podID="e8af5bdb-cf19-4210-85c0-815d452cb701" containerID="517007075ca1aef58a909595ebf220c8db058ed82c0f3e8742db6b0553cce8ee" exitCode=0 Oct 30 20:03:48.681426 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:48.681032 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" event={"ID":"e8af5bdb-cf19-4210-85c0-815d452cb701","Type":"ContainerDied","Data":"517007075ca1aef58a909595ebf220c8db058ed82c0f3e8742db6b0553cce8ee"} Oct 30 20:03:48.683208 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:48.683184 5078 scope.go:122] "RemoveContainer" containerID="517007075ca1aef58a909595ebf220c8db058ed82c0f3e8742db6b0553cce8ee" Oct 30 20:03:48.700460 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:48.699861 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-c262w" event={"ID":"adb774f6-0266-4c60-92e9-f0a5f8ac831e","Type":"ContainerStarted","Data":"63146390c390b79467b8b6e12e4448fc3c24f86f7a492b4eb93220d5099c4921"} Oct 30 20:03:48.709358 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:48.707989 5078 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 20:03:48.709358 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:48.708012 5078 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 20:03:48.709358 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:48.708034 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" event={"ID":"24b57f65-bf27-4659-a922-83a241893696","Type":"ContainerStarted","Data":"6bfca69c309331b886022ad01f548bfb599f78b2d06b89c0d0d942c09b2c4c3e"} Oct 30 20:03:49.717998 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:49.717955 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-gksz8" event={"ID":"ae25b031-7ac9-4041-bc3a-7a6679eab74d","Type":"ContainerStarted","Data":"f5fc55a5552963d95f46657e2568736c993dde0d400342651ba3001fb3a72683"} Oct 30 20:03:49.721998 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:49.721964 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-5hdqj" event={"ID":"20ba9ea0-10d3-419c-a429-3a6dcf153171","Type":"ContainerStarted","Data":"5c06098b35a1ffb5887ddecc68e1ca913a1acd50a48038af85137c36978394a4"} Oct 30 20:03:49.724259 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:49.724229 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-6pfgz" event={"ID":"e8af5bdb-cf19-4210-85c0-815d452cb701","Type":"ContainerStarted","Data":"a88091d0fc7737dcdfedfc28da9d3a4d6d06f2aaae11babec81d0f791102179b"} Oct 30 20:03:49.726584 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:49.726545 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-698hj" event={"ID":"f69d831c-d9e4-4060-a2bd-9d85265000f6","Type":"ContainerStarted","Data":"82a146fd5b10d115e47ecec32526deadf80d0f10ddc3bb090bb9b0f266e19255"} Oct 30 20:03:49.726718 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:49.726594 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-698hj" event={"ID":"f69d831c-d9e4-4060-a2bd-9d85265000f6","Type":"ContainerStarted","Data":"0e4e7ec420d8bd6a7055698f897609cafd7cfac093d2f4fca9804b4935e7a8c3"} Oct 30 20:03:49.785453 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:49.785421 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:50.032259 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:50.031987 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:50.173375 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:50.173113 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:03:50.320604 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:50.320572 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:50.320835 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:50.320778 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:50.320919 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:50.320882 5078 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle podName:2e5941e6-4fc9-4353-a518-8ad492e9ad61 nodeName:}" failed. No retries permitted until 2026-10-30 20:03:54.320862522 +0000 UTC m=+8.854135114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle") pod "router-default-7f94f8f65c-dqcj8" (UID: "2e5941e6-4fc9-4353-a518-8ad492e9ad61") : configmap references non-existent config key: service-ca.crt Oct 30 20:03:50.328102 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:50.328048 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-js96l\" (UID: \"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc\") " pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:50.469810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:50.469777 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-js96l" Oct 30 20:03:50.733633 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:50.733590 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hd99r" event={"ID":"7f941d6e-cd94-47d5-a641-fb608c05a903","Type":"ContainerStarted","Data":"7ba1e3040955a26abf7dc84586bedd5983b052c6b99dafde64661a45365d935e"} Oct 30 20:03:50.734097 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:50.733674 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hd99r" event={"ID":"7f941d6e-cd94-47d5-a641-fb608c05a903","Type":"ContainerStarted","Data":"3e3332ce83c78b9f3890af05040124e45b69835349c236f36b9da7929a133229"} Oct 30 20:03:50.734097 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:50.733716 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hd99r" Oct 30 20:03:50.735861 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:50.735835 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" event={"ID":"28ba2930-e73c-4716-b061-d7cb2bbd0400","Type":"ContainerStarted","Data":"e618101875c5843a8bd8156001bc49a89a950796706fcc0c4decd1829dd2c543"} Oct 30 20:03:50.735982 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:50.735883 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jb98m" event={"ID":"28ba2930-e73c-4716-b061-d7cb2bbd0400","Type":"ContainerStarted","Data":"206fe0ad5079619234bc8532b37483e31b3c66c06fb1c9b46d1ed33b0d0d6c98"} Oct 30 20:03:50.735982 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:50.735901 5078 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 20:03:50.755617 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:50.755578 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-js96l"] Oct 30 20:03:50.760376 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:50.760345 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb91b3e76_8c7d_4b4f_9e35_1b18b1c772bc.slice/crio-5ba7361dfcf10deb9aa50ac6e3e419ecbb4b10c62308270864326e2ccccc48e4 WatchSource:0}: Error finding container 5ba7361dfcf10deb9aa50ac6e3e419ecbb4b10c62308270864326e2ccccc48e4: Status 404 returned error can't find the container with id 5ba7361dfcf10deb9aa50ac6e3e419ecbb4b10c62308270864326e2ccccc48e4 Oct 30 20:03:51.742711 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:51.742666 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-bbm2j" event={"ID":"24b57f65-bf27-4659-a922-83a241893696","Type":"ContainerStarted","Data":"2b5c097dc2a91285f011203ccc5f99431cd5ba988b6e2dac781ebf3d5c179ce8"} Oct 30 20:03:51.744556 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:51.744526 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-js96l" event={"ID":"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc","Type":"ContainerStarted","Data":"8a282ab0e0c2b55932851a16a5cd25c77bac2ef639b7d7557903cd1e02586d02"} Oct 30 20:03:51.744687 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:51.744598 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-js96l" event={"ID":"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc","Type":"ContainerStarted","Data":"5ba7361dfcf10deb9aa50ac6e3e419ecbb4b10c62308270864326e2ccccc48e4"} Oct 30 20:03:52.750887 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:52.750851 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-js96l" event={"ID":"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc","Type":"ContainerStarted","Data":"434714d50b6ca9f8d34e1219ce8b938f0ac7ca2ed4251d17b8de476e65a19eff"} Oct 30 20:03:54.360939 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:54.360897 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:54.361699 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:54.361668 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5941e6-4fc9-4353-a518-8ad492e9ad61-service-ca-bundle\") pod \"router-default-7f94f8f65c-dqcj8\" (UID: \"2e5941e6-4fc9-4353-a518-8ad492e9ad61\") " pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:54.421052 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:54.420990 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:03:54.651570 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:54.651542 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:54.761556 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:54.761518 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-js96l" event={"ID":"b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc","Type":"ContainerStarted","Data":"bfdf7fc74c2753054421a41057dcde69adcb5d0258af5df710cbf15b8b4ef991"} Oct 30 20:03:54.933935 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:54.933853 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f94f8f65c-dqcj8"] Oct 30 20:03:54.936681 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:03:54.936651 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e5941e6_4fc9_4353_a518_8ad492e9ad61.slice/crio-a74c84b4c85bd8a8a5b7af65ba119c60b09af94eb235b774fc86f53c35f14bcb WatchSource:0}: Error finding container a74c84b4c85bd8a8a5b7af65ba119c60b09af94eb235b774fc86f53c35f14bcb: Status 404 returned error can't find the container with id a74c84b4c85bd8a8a5b7af65ba119c60b09af94eb235b774fc86f53c35f14bcb Oct 30 20:03:55.540927 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:55.540896 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-df4d8" Oct 30 20:03:55.767133 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:55.767085 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" event={"ID":"2e5941e6-4fc9-4353-a518-8ad492e9ad61","Type":"ContainerStarted","Data":"1017e5afeffb052fb52e091de3faa50ff2bdf289a01b64b8496ec7489c07ee49"} Oct 30 20:03:55.767466 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:55.767143 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" event={"ID":"2e5941e6-4fc9-4353-a518-8ad492e9ad61","Type":"ContainerStarted","Data":"a74c84b4c85bd8a8a5b7af65ba119c60b09af94eb235b774fc86f53c35f14bcb"} Oct 30 20:03:56.102275 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:56.102235 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:03:56.652020 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:56.651982 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:56.654740 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:56.654716 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:03:56.697861 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:03:56.697827 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:03:57.777211 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:03:57.777173 5078 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 20:04:00.747205 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:00.747177 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hd99r" Oct 30 20:04:01.024424 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.024320 5078 patch_prober.go:29] interesting pod/image-registry-8586cfd6bb-wzm9m container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Oct 30 20:04:01.024424 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.024393 5078 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" podUID="27e4937d-367a-4ccc-9580-74a3982a49fe" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 20:04:01.194947 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.194916 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-sd6vl-68tbx"] Oct 30 20:04:01.200201 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.200168 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-sd6vl-68tbx" Oct 30 20:04:01.219858 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.219824 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-sd6vl-68tbx"] Oct 30 20:04:01.229435 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.229399 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75c856df5f-jdst9"] Oct 30 20:04:01.229623 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.229485 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4bsxb"] Oct 30 20:04:01.235497 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.233308 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4bsxb" Oct 30 20:04:01.254462 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.254179 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4bsxb"] Oct 30 20:04:01.261603 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.261573 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-44p2c\"" Oct 30 20:04:01.262037 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.261894 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Oct 30 20:04:01.317825 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.317784 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-78j5c"] Oct 30 20:04:01.321245 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.321211 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-78j5c" Oct 30 20:04:01.323974 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.323914 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5456677fd7-lz2n7"] Oct 30 20:04:01.327770 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.327748 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cbbcb9f56-h46cm"] Oct 30 20:04:01.327922 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.327900 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.331008 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.330991 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.333497 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.333480 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 30 20:04:01.333610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.333524 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 30 20:04:01.335108 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.335088 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-78j5c"] Oct 30 20:04:01.336253 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.336224 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e28012b0-8275-4d69-a15d-ff19bd255602-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-4bsxb\" (UID: \"e28012b0-8275-4d69-a15d-ff19bd255602\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4bsxb" Oct 30 20:04:01.336386 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.336277 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a0531af-9e1e-4496-b260-d8310fa93013-service-ca-bundle\") pod \"periodic-gathering-sd6vl-68tbx\" (UID: \"2a0531af-9e1e-4496-b260-d8310fa93013\") " pod="openshift-insights/periodic-gathering-sd6vl-68tbx" Oct 30 20:04:01.336467 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.336421 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2a0531af-9e1e-4496-b260-d8310fa93013-archives-path\") pod \"periodic-gathering-sd6vl-68tbx\" (UID: \"2a0531af-9e1e-4496-b260-d8310fa93013\") " pod="openshift-insights/periodic-gathering-sd6vl-68tbx" Oct 30 20:04:01.336530 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.336473 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a0531af-9e1e-4496-b260-d8310fa93013-trusted-ca-bundle\") pod \"periodic-gathering-sd6vl-68tbx\" (UID: \"2a0531af-9e1e-4496-b260-d8310fa93013\") " pod="openshift-insights/periodic-gathering-sd6vl-68tbx" Oct 30 20:04:01.336530 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.336500 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkspq\" (UniqueName: \"kubernetes.io/projected/2a0531af-9e1e-4496-b260-d8310fa93013-kube-api-access-jkspq\") pod \"periodic-gathering-sd6vl-68tbx\" (UID: \"2a0531af-9e1e-4496-b260-d8310fa93013\") " pod="openshift-insights/periodic-gathering-sd6vl-68tbx" Oct 30 20:04:01.336645 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.336607 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Oct 30 20:04:01.341444 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.341419 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Oct 30 20:04:01.342078 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.342060 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Oct 30 20:04:01.342934 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.342911 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5456677fd7-lz2n7"] Oct 30 20:04:01.344921 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.344900 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Oct 30 20:04:01.345158 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.345129 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fckx2\"" Oct 30 20:04:01.346809 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.345213 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-d8zvl\"" Oct 30 20:04:01.346809 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.345343 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Oct 30 20:04:01.348245 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.348219 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cbbcb9f56-h46cm"] Oct 30 20:04:01.436983 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.436948 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkspq\" (UniqueName: \"kubernetes.io/projected/2a0531af-9e1e-4496-b260-d8310fa93013-kube-api-access-jkspq\") pod \"periodic-gathering-sd6vl-68tbx\" (UID: \"2a0531af-9e1e-4496-b260-d8310fa93013\") " pod="openshift-insights/periodic-gathering-sd6vl-68tbx" Oct 30 20:04:01.436983 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.436985 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5642ce9e-9678-4b42-8f44-d774b149c7eb-tmp\") pod \"console-5456677fd7-lz2n7\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.437268 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.437011 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92xj9\" (UniqueName: \"kubernetes.io/projected/5642ce9e-9678-4b42-8f44-d774b149c7eb-kube-api-access-92xj9\") pod \"console-5456677fd7-lz2n7\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.437268 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.437036 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47zr2\" (UniqueName: \"kubernetes.io/projected/eb41a99a-d50e-4508-8f86-68e69baf8f9c-kube-api-access-47zr2\") pod \"downloads-6dd789c8b7-78j5c\" (UID: \"eb41a99a-d50e-4508-8f86-68e69baf8f9c\") " pod="openshift-console/downloads-6dd789c8b7-78j5c" Oct 30 20:04:01.437268 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.437197 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5642ce9e-9678-4b42-8f44-d774b149c7eb-service-ca\") pod \"console-5456677fd7-lz2n7\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.437268 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.437234 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae7e6701-f883-486b-ad49-2f7f65494862-registry-tls\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.437268 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.437256 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae7e6701-f883-486b-ad49-2f7f65494862-bound-sa-token\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.437551 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.437361 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqrq4\" (UniqueName: \"kubernetes.io/projected/ae7e6701-f883-486b-ad49-2f7f65494862-kube-api-access-mqrq4\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.437551 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.437431 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e28012b0-8275-4d69-a15d-ff19bd255602-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-4bsxb\" (UID: \"e28012b0-8275-4d69-a15d-ff19bd255602\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4bsxb" Oct 30 20:04:01.437551 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.437468 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5642ce9e-9678-4b42-8f44-d774b149c7eb-oauth-serving-cert\") pod \"console-5456677fd7-lz2n7\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.437551 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.437501 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae7e6701-f883-486b-ad49-2f7f65494862-trusted-ca\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.437551 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.437534 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5642ce9e-9678-4b42-8f44-d774b149c7eb-console-serving-cert\") pod \"console-5456677fd7-lz2n7\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.437743 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.437565 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae7e6701-f883-486b-ad49-2f7f65494862-ca-trust-extracted\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.437743 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.437618 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a0531af-9e1e-4496-b260-d8310fa93013-service-ca-bundle\") pod \"periodic-gathering-sd6vl-68tbx\" (UID: \"2a0531af-9e1e-4496-b260-d8310fa93013\") " pod="openshift-insights/periodic-gathering-sd6vl-68tbx" Oct 30 20:04:01.437743 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.437653 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae7e6701-f883-486b-ad49-2f7f65494862-registry-certificates\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.437743 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.437677 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2a0531af-9e1e-4496-b260-d8310fa93013-archives-path\") pod \"periodic-gathering-sd6vl-68tbx\" (UID: \"2a0531af-9e1e-4496-b260-d8310fa93013\") " pod="openshift-insights/periodic-gathering-sd6vl-68tbx" Oct 30 20:04:01.437743 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.437694 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae7e6701-f883-486b-ad49-2f7f65494862-image-registry-private-configuration\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.437743 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.437727 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae7e6701-f883-486b-ad49-2f7f65494862-installation-pull-secrets\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.438034 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.437747 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5642ce9e-9678-4b42-8f44-d774b149c7eb-console-oauth-config\") pod \"console-5456677fd7-lz2n7\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.438034 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.437777 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5642ce9e-9678-4b42-8f44-d774b149c7eb-console-config\") pod \"console-5456677fd7-lz2n7\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.438034 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.437837 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a0531af-9e1e-4496-b260-d8310fa93013-trusted-ca-bundle\") pod \"periodic-gathering-sd6vl-68tbx\" (UID: \"2a0531af-9e1e-4496-b260-d8310fa93013\") " pod="openshift-insights/periodic-gathering-sd6vl-68tbx" Oct 30 20:04:01.438034 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.437945 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb41a99a-d50e-4508-8f86-68e69baf8f9c-tmp\") pod \"downloads-6dd789c8b7-78j5c\" (UID: \"eb41a99a-d50e-4508-8f86-68e69baf8f9c\") " pod="openshift-console/downloads-6dd789c8b7-78j5c" Oct 30 20:04:01.438252 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.438095 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2a0531af-9e1e-4496-b260-d8310fa93013-archives-path\") pod \"periodic-gathering-sd6vl-68tbx\" (UID: \"2a0531af-9e1e-4496-b260-d8310fa93013\") " pod="openshift-insights/periodic-gathering-sd6vl-68tbx" Oct 30 20:04:01.438368 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.438325 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a0531af-9e1e-4496-b260-d8310fa93013-service-ca-bundle\") pod \"periodic-gathering-sd6vl-68tbx\" (UID: \"2a0531af-9e1e-4496-b260-d8310fa93013\") " pod="openshift-insights/periodic-gathering-sd6vl-68tbx" Oct 30 20:04:01.438646 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.438625 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a0531af-9e1e-4496-b260-d8310fa93013-trusted-ca-bundle\") pod \"periodic-gathering-sd6vl-68tbx\" (UID: \"2a0531af-9e1e-4496-b260-d8310fa93013\") " pod="openshift-insights/periodic-gathering-sd6vl-68tbx" Oct 30 20:04:01.439956 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.439935 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e28012b0-8275-4d69-a15d-ff19bd255602-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-4bsxb\" (UID: \"e28012b0-8275-4d69-a15d-ff19bd255602\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4bsxb" Oct 30 20:04:01.455121 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.455034 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkspq\" (UniqueName: \"kubernetes.io/projected/2a0531af-9e1e-4496-b260-d8310fa93013-kube-api-access-jkspq\") pod \"periodic-gathering-sd6vl-68tbx\" (UID: \"2a0531af-9e1e-4496-b260-d8310fa93013\") " pod="openshift-insights/periodic-gathering-sd6vl-68tbx" Oct 30 20:04:01.515147 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.515110 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-sd6vl-68tbx" Oct 30 20:04:01.539096 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.539062 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5642ce9e-9678-4b42-8f44-d774b149c7eb-console-config\") pod \"console-5456677fd7-lz2n7\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.539276 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.539110 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb41a99a-d50e-4508-8f86-68e69baf8f9c-tmp\") pod \"downloads-6dd789c8b7-78j5c\" (UID: \"eb41a99a-d50e-4508-8f86-68e69baf8f9c\") " pod="openshift-console/downloads-6dd789c8b7-78j5c" Oct 30 20:04:01.539276 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.539131 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5642ce9e-9678-4b42-8f44-d774b149c7eb-tmp\") pod \"console-5456677fd7-lz2n7\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.539276 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.539150 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92xj9\" (UniqueName: \"kubernetes.io/projected/5642ce9e-9678-4b42-8f44-d774b149c7eb-kube-api-access-92xj9\") pod \"console-5456677fd7-lz2n7\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.539276 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.539176 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47zr2\" (UniqueName: \"kubernetes.io/projected/eb41a99a-d50e-4508-8f86-68e69baf8f9c-kube-api-access-47zr2\") pod \"downloads-6dd789c8b7-78j5c\" (UID: \"eb41a99a-d50e-4508-8f86-68e69baf8f9c\") " pod="openshift-console/downloads-6dd789c8b7-78j5c" Oct 30 20:04:01.539276 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.539223 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5642ce9e-9678-4b42-8f44-d774b149c7eb-service-ca\") pod \"console-5456677fd7-lz2n7\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.539276 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.539252 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae7e6701-f883-486b-ad49-2f7f65494862-registry-tls\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.539276 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.539278 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae7e6701-f883-486b-ad49-2f7f65494862-bound-sa-token\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.539712 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.539303 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqrq4\" (UniqueName: \"kubernetes.io/projected/ae7e6701-f883-486b-ad49-2f7f65494862-kube-api-access-mqrq4\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.539712 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.539346 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5642ce9e-9678-4b42-8f44-d774b149c7eb-oauth-serving-cert\") pod \"console-5456677fd7-lz2n7\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.539712 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.539372 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae7e6701-f883-486b-ad49-2f7f65494862-trusted-ca\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.539712 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.539398 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5642ce9e-9678-4b42-8f44-d774b149c7eb-console-serving-cert\") pod \"console-5456677fd7-lz2n7\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.539712 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.539424 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae7e6701-f883-486b-ad49-2f7f65494862-ca-trust-extracted\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.539712 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.539488 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae7e6701-f883-486b-ad49-2f7f65494862-registry-certificates\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.539712 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.539522 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae7e6701-f883-486b-ad49-2f7f65494862-image-registry-private-configuration\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.539712 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.539537 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb41a99a-d50e-4508-8f86-68e69baf8f9c-tmp\") pod \"downloads-6dd789c8b7-78j5c\" (UID: \"eb41a99a-d50e-4508-8f86-68e69baf8f9c\") " pod="openshift-console/downloads-6dd789c8b7-78j5c" Oct 30 20:04:01.539712 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.539634 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5642ce9e-9678-4b42-8f44-d774b149c7eb-tmp\") pod \"console-5456677fd7-lz2n7\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.541742 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.539970 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5642ce9e-9678-4b42-8f44-d774b149c7eb-console-config\") pod \"console-5456677fd7-lz2n7\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.541742 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.540135 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5642ce9e-9678-4b42-8f44-d774b149c7eb-oauth-serving-cert\") pod \"console-5456677fd7-lz2n7\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.541742 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.539547 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae7e6701-f883-486b-ad49-2f7f65494862-installation-pull-secrets\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.541742 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.540627 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5642ce9e-9678-4b42-8f44-d774b149c7eb-console-oauth-config\") pod \"console-5456677fd7-lz2n7\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.541742 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.541080 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5642ce9e-9678-4b42-8f44-d774b149c7eb-service-ca\") pod \"console-5456677fd7-lz2n7\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.541742 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.541385 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae7e6701-f883-486b-ad49-2f7f65494862-trusted-ca\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.541742 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.541473 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae7e6701-f883-486b-ad49-2f7f65494862-ca-trust-extracted\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.541742 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.541595 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae7e6701-f883-486b-ad49-2f7f65494862-registry-certificates\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.543417 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.543390 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae7e6701-f883-486b-ad49-2f7f65494862-installation-pull-secrets\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.543529 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.543501 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae7e6701-f883-486b-ad49-2f7f65494862-registry-tls\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.543777 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.543755 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5642ce9e-9678-4b42-8f44-d774b149c7eb-console-serving-cert\") pod \"console-5456677fd7-lz2n7\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.544180 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.544160 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5642ce9e-9678-4b42-8f44-d774b149c7eb-console-oauth-config\") pod \"console-5456677fd7-lz2n7\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.544235 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.544158 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae7e6701-f883-486b-ad49-2f7f65494862-image-registry-private-configuration\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.554002 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.553971 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae7e6701-f883-486b-ad49-2f7f65494862-bound-sa-token\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.554154 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.554096 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47zr2\" (UniqueName: \"kubernetes.io/projected/eb41a99a-d50e-4508-8f86-68e69baf8f9c-kube-api-access-47zr2\") pod \"downloads-6dd789c8b7-78j5c\" (UID: \"eb41a99a-d50e-4508-8f86-68e69baf8f9c\") " pod="openshift-console/downloads-6dd789c8b7-78j5c" Oct 30 20:04:01.554701 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.554678 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqrq4\" (UniqueName: \"kubernetes.io/projected/ae7e6701-f883-486b-ad49-2f7f65494862-kube-api-access-mqrq4\") pod \"image-registry-5cbbcb9f56-h46cm\" (UID: \"ae7e6701-f883-486b-ad49-2f7f65494862\") " pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.554820 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.554806 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92xj9\" (UniqueName: \"kubernetes.io/projected/5642ce9e-9678-4b42-8f44-d774b149c7eb-kube-api-access-92xj9\") pod \"console-5456677fd7-lz2n7\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.569450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.569378 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4bsxb" Oct 30 20:04:01.635600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.635534 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-78j5c" Oct 30 20:04:01.649185 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.649162 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:01.657703 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.657677 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:01.800369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.800305 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-sd6vl-68tbx"] Oct 30 20:04:01.802385 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:04:01.802358 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a0531af_9e1e_4496_b260_d8310fa93013.slice/crio-8903aec8fc5e27ac6ca4026fb76d62b51eb0b5f3d7d740a458e6a514db3bcaaa WatchSource:0}: Error finding container 8903aec8fc5e27ac6ca4026fb76d62b51eb0b5f3d7d740a458e6a514db3bcaaa: Status 404 returned error can't find the container with id 8903aec8fc5e27ac6ca4026fb76d62b51eb0b5f3d7d740a458e6a514db3bcaaa Oct 30 20:04:01.856596 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.856465 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4bsxb"] Oct 30 20:04:01.858832 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:04:01.858798 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode28012b0_8275_4d69_a15d_ff19bd255602.slice/crio-1b4f634b0aea4ca599570081c4e5f6bc7966010c17f7678d6f3c2ade4bfea62f WatchSource:0}: Error finding container 1b4f634b0aea4ca599570081c4e5f6bc7966010c17f7678d6f3c2ade4bfea62f: Status 404 returned error can't find the container with id 1b4f634b0aea4ca599570081c4e5f6bc7966010c17f7678d6f3c2ade4bfea62f Oct 30 20:04:01.938161 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.938122 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5456677fd7-lz2n7"] Oct 30 20:04:01.942054 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:04:01.942020 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5642ce9e_9678_4b42_8f44_d774b149c7eb.slice/crio-e507c7722b6f79896171e9e17031d64746ac884f2105f11325d1cb6364321d10 WatchSource:0}: Error finding container e507c7722b6f79896171e9e17031d64746ac884f2105f11325d1cb6364321d10: Status 404 returned error can't find the container with id e507c7722b6f79896171e9e17031d64746ac884f2105f11325d1cb6364321d10 Oct 30 20:04:01.953446 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.953413 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-78j5c"] Oct 30 20:04:01.956352 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:04:01.956306 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb41a99a_d50e_4508_8f86_68e69baf8f9c.slice/crio-a2fe844921a30d8a0fbf3b0b970860dd8da6915e4e9dcdbf80440a8b2eafd68c WatchSource:0}: Error finding container a2fe844921a30d8a0fbf3b0b970860dd8da6915e4e9dcdbf80440a8b2eafd68c: Status 404 returned error can't find the container with id a2fe844921a30d8a0fbf3b0b970860dd8da6915e4e9dcdbf80440a8b2eafd68c Oct 30 20:04:01.994192 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:01.994155 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cbbcb9f56-h46cm"] Oct 30 20:04:01.997535 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:04:01.997232 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae7e6701_f883_486b_ad49_2f7f65494862.slice/crio-3f4ab9c47d97ec23452f3cc419d58a6a3bad50520465f77d7a49db7cdc28fec0 WatchSource:0}: Error finding container 3f4ab9c47d97ec23452f3cc419d58a6a3bad50520465f77d7a49db7cdc28fec0: Status 404 returned error can't find the container with id 3f4ab9c47d97ec23452f3cc419d58a6a3bad50520465f77d7a49db7cdc28fec0 Oct 30 20:04:02.742411 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:02.742177 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hd99r_7f941d6e-cd94-47d5-a641-fb608c05a903/dns/0.log" Oct 30 20:04:02.810400 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:02.810363 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-sd6vl-68tbx" event={"ID":"2a0531af-9e1e-4496-b260-d8310fa93013","Type":"ContainerStarted","Data":"25e29b0f2c7c380dce686c62eafb5f11346ece0c9be0d0de505cd52e4caed11e"} Oct 30 20:04:02.810938 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:02.810912 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-sd6vl-68tbx" event={"ID":"2a0531af-9e1e-4496-b260-d8310fa93013","Type":"ContainerStarted","Data":"8903aec8fc5e27ac6ca4026fb76d62b51eb0b5f3d7d740a458e6a514db3bcaaa"} Oct 30 20:04:02.812192 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:02.812166 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-78j5c" event={"ID":"eb41a99a-d50e-4508-8f86-68e69baf8f9c","Type":"ContainerStarted","Data":"a2fe844921a30d8a0fbf3b0b970860dd8da6915e4e9dcdbf80440a8b2eafd68c"} Oct 30 20:04:02.813597 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:02.813568 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4bsxb" event={"ID":"e28012b0-8275-4d69-a15d-ff19bd255602","Type":"ContainerStarted","Data":"1b4f634b0aea4ca599570081c4e5f6bc7966010c17f7678d6f3c2ade4bfea62f"} Oct 30 20:04:02.814958 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:02.814935 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5456677fd7-lz2n7" event={"ID":"5642ce9e-9678-4b42-8f44-d774b149c7eb","Type":"ContainerStarted","Data":"e507c7722b6f79896171e9e17031d64746ac884f2105f11325d1cb6364321d10"} Oct 30 20:04:02.816692 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:02.816631 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" event={"ID":"ae7e6701-f883-486b-ad49-2f7f65494862","Type":"ContainerStarted","Data":"37706ca7e15359cc17cc57190490c6f9927a727cf5e095cb8d39ad02391dcaae"} Oct 30 20:04:02.816692 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:02.816670 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" event={"ID":"ae7e6701-f883-486b-ad49-2f7f65494862","Type":"ContainerStarted","Data":"3f4ab9c47d97ec23452f3cc419d58a6a3bad50520465f77d7a49db7cdc28fec0"} Oct 30 20:04:02.816839 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:02.816782 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:02.830447 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:02.830399 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-sd6vl-68tbx" podStartSLOduration=1.830382194 podStartE2EDuration="1.830382194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:04:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:04:02.829863886 +0000 UTC m=+17.363136481" watchObservedRunningTime="2026-10-30 20:04:02.830382194 +0000 UTC m=+17.363654794" Oct 30 20:04:02.855321 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:02.855272 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" podStartSLOduration=1.8552578560000001 podStartE2EDuration="1.855257856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:04:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:04:02.853133279 +0000 UTC m=+17.386405874" watchObservedRunningTime="2026-10-30 20:04:02.855257856 +0000 UTC m=+17.388530492" Oct 30 20:04:02.912555 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:02.912522 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hd99r_7f941d6e-cd94-47d5-a641-fb608c05a903/kube-rbac-proxy/0.log" Oct 30 20:04:03.312461 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:03.312429 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sxszz_bea5c7b2-5ad1-43f5-8f43-07e3af665d6a/dns-node-resolver/0.log" Oct 30 20:04:03.713589 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:03.713500 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5cbbcb9f56-h46cm_ae7e6701-f883-486b-ad49-2f7f65494862/registry/0.log" Oct 30 20:04:03.912777 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:03.912756 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-75c856df5f-jdst9_4ac859bf-692b-4447-891a-32541e1e244d/registry/0.log" Oct 30 20:04:04.116474 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:04.116412 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8586cfd6bb-wzm9m_27e4937d-367a-4ccc-9580-74a3982a49fe/registry/0.log" Oct 30 20:04:04.313036 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:04.313006 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fc6gd_ff5da8ed-018c-4182-82f0-a8a3266aff52/node-ca/0.log" Oct 30 20:04:04.479996 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:04.479910 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:04:04.480178 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:04.480062 5078 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 20:04:04.481943 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:04.481921 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7f94f8f65c-dqcj8" Oct 30 20:04:04.829631 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:04.829590 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4bsxb" event={"ID":"e28012b0-8275-4d69-a15d-ff19bd255602","Type":"ContainerStarted","Data":"4704b31afb45ce41780610508dde4a9d1657b02d78b63e242a19525f48b6131a"} Oct 30 20:04:04.829911 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:04.829890 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4bsxb" Oct 30 20:04:04.834930 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:04.834892 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4bsxb" Oct 30 20:04:04.848608 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:04.848561 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-4bsxb" podStartSLOduration=1.849498835 podStartE2EDuration="3.848544807s" totalImagesPullingTime="1.999045972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:04:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:04:04.847229778 +0000 UTC m=+19.380502374" watchObservedRunningTime="2026-10-30 20:04:04.848544807 +0000 UTC m=+19.381817487" Oct 30 20:04:04.913513 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:04.913484 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f94f8f65c-dqcj8_2e5941e6-4fc9-4353-a518-8ad492e9ad61/router/0.log" Oct 30 20:04:05.114023 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:05.113935 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t85sd_22e3da9c-5201-4bd9-b247-1caaa18f5d7d/serve-healthcheck-canary/0.log" Oct 30 20:04:07.847560 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:07.847521 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5456677fd7-lz2n7" event={"ID":"5642ce9e-9678-4b42-8f44-d774b149c7eb","Type":"ContainerStarted","Data":"b4b9eabebce729b6f2bcfad349d9d618d2eb1a750175e2984dff6f98784295b2"} Oct 30 20:04:07.870660 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:07.870607 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5456677fd7-lz2n7" podStartSLOduration=1.63704194 podStartE2EDuration="6.870592804s" totalImagesPullingTime="5.233550864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:04:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:04:07.869965842 +0000 UTC m=+22.403238435" watchObservedRunningTime="2026-10-30 20:04:07.870592804 +0000 UTC m=+22.403865397" Oct 30 20:04:10.079704 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.079668 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-srz9p"] Oct 30 20:04:10.114709 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.114679 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.115830 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.115802 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b599af6c-32a0-45cf-98da-7eeb5c79c17d-node-exporter-tls\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.115961 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.115847 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b599af6c-32a0-45cf-98da-7eeb5c79c17d-sys\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.115961 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.115932 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b599af6c-32a0-45cf-98da-7eeb5c79c17d-node-exporter-accelerators-collector-config\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.116032 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.115970 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b599af6c-32a0-45cf-98da-7eeb5c79c17d-metrics-client-ca\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.116032 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.116019 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkhb9\" (UniqueName: \"kubernetes.io/projected/b599af6c-32a0-45cf-98da-7eeb5c79c17d-kube-api-access-hkhb9\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.116108 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.116077 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b599af6c-32a0-45cf-98da-7eeb5c79c17d-node-exporter-textfile\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.116160 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.116144 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b599af6c-32a0-45cf-98da-7eeb5c79c17d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.116207 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.116167 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b599af6c-32a0-45cf-98da-7eeb5c79c17d-node-exporter-wtmp\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.116207 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.116196 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b599af6c-32a0-45cf-98da-7eeb5c79c17d-root\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.141987 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.141956 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 30 20:04:10.143351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.142535 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 30 20:04:10.143469 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.143396 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bcdxj\"" Oct 30 20:04:10.173588 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.173557 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 30 20:04:10.173778 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.173702 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 30 20:04:10.178470 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.178443 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:04:10.217348 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.217000 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkhb9\" (UniqueName: \"kubernetes.io/projected/b599af6c-32a0-45cf-98da-7eeb5c79c17d-kube-api-access-hkhb9\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.217537 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.217419 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b599af6c-32a0-45cf-98da-7eeb5c79c17d-node-exporter-textfile\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.217537 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.217456 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b599af6c-32a0-45cf-98da-7eeb5c79c17d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.217537 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.217485 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b599af6c-32a0-45cf-98da-7eeb5c79c17d-node-exporter-wtmp\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.217537 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.217515 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b599af6c-32a0-45cf-98da-7eeb5c79c17d-root\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.217757 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.217623 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b599af6c-32a0-45cf-98da-7eeb5c79c17d-node-exporter-tls\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.217757 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.217691 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b599af6c-32a0-45cf-98da-7eeb5c79c17d-sys\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.217757 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.217721 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b599af6c-32a0-45cf-98da-7eeb5c79c17d-node-exporter-accelerators-collector-config\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.217757 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.217751 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b599af6c-32a0-45cf-98da-7eeb5c79c17d-metrics-client-ca\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.218288 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.218262 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b599af6c-32a0-45cf-98da-7eeb5c79c17d-metrics-client-ca\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.218681 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.218657 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b599af6c-32a0-45cf-98da-7eeb5c79c17d-node-exporter-textfile\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.219521 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.219148 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b599af6c-32a0-45cf-98da-7eeb5c79c17d-node-exporter-wtmp\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.219521 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.219226 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b599af6c-32a0-45cf-98da-7eeb5c79c17d-root\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.219521 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.219247 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b599af6c-32a0-45cf-98da-7eeb5c79c17d-sys\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.219934 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.219906 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b599af6c-32a0-45cf-98da-7eeb5c79c17d-node-exporter-accelerators-collector-config\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.221213 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.221188 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b599af6c-32a0-45cf-98da-7eeb5c79c17d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.222144 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.222124 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b599af6c-32a0-45cf-98da-7eeb5c79c17d-node-exporter-tls\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.238634 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.238593 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkhb9\" (UniqueName: \"kubernetes.io/projected/b599af6c-32a0-45cf-98da-7eeb5c79c17d-kube-api-access-hkhb9\") pod \"node-exporter-srz9p\" (UID: \"b599af6c-32a0-45cf-98da-7eeb5c79c17d\") " pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.490925 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.490841 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-srz9p" Oct 30 20:04:10.529148 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:04:10.529119 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb599af6c_32a0_45cf_98da_7eeb5c79c17d.slice/crio-9f949bc903ee544addf2577a7f0ec502e465f6461723bc16fb0fc0cb056bdbed WatchSource:0}: Error finding container 9f949bc903ee544addf2577a7f0ec502e465f6461723bc16fb0fc0cb056bdbed: Status 404 returned error can't find the container with id 9f949bc903ee544addf2577a7f0ec502e465f6461723bc16fb0fc0cb056bdbed Oct 30 20:04:10.863394 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:10.863353 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-srz9p" event={"ID":"b599af6c-32a0-45cf-98da-7eeb5c79c17d","Type":"ContainerStarted","Data":"9f949bc903ee544addf2577a7f0ec502e465f6461723bc16fb0fc0cb056bdbed"} Oct 30 20:04:11.237007 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:11.236924 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:04:11.649719 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:11.649682 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:11.649962 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:11.649745 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:11.655098 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:11.655070 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:11.873564 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:11.873535 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:12.875851 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:12.875819 5078 generic.go:356] "Generic (PLEG): container finished" podID="b599af6c-32a0-45cf-98da-7eeb5c79c17d" containerID="fdf3d56865f57b3ad8c21ce0878a2702d77627da3ef8b0d28a01aec7ac960bcc" exitCode=0 Oct 30 20:04:12.876265 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:12.875908 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-srz9p" event={"ID":"b599af6c-32a0-45cf-98da-7eeb5c79c17d","Type":"ContainerDied","Data":"fdf3d56865f57b3ad8c21ce0878a2702d77627da3ef8b0d28a01aec7ac960bcc"} Oct 30 20:04:13.886962 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:13.886925 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-srz9p" event={"ID":"b599af6c-32a0-45cf-98da-7eeb5c79c17d","Type":"ContainerStarted","Data":"b5b438e1873a61af8f07cbe4591cfd68e4a466e10ff4446f24bcedc7db3bc9c0"} Oct 30 20:04:13.887495 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:13.886996 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-srz9p" event={"ID":"b599af6c-32a0-45cf-98da-7eeb5c79c17d","Type":"ContainerStarted","Data":"cc572ca9b64dd4f79e766a8444d25dd66539a951a10dc8f178db5894783888c4"} Oct 30 20:04:13.912106 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:13.912050 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-srz9p" podStartSLOduration=2.3201495420000002 podStartE2EDuration="3.912036007s" totalImagesPullingTime="1.507063027s" totalInitContainerRuntime="84.823438ms" isStatefulPod=true podCreationTimestamp="2026-10-30 20:04:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:04:13.910227546 +0000 UTC m=+28.443500154" watchObservedRunningTime="2026-10-30 20:04:13.912036007 +0000 UTC m=+28.445308600" Oct 30 20:04:14.324514 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:14.324485 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cvpxr" Oct 30 20:04:16.105512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:16.105477 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-l5w4q" Oct 30 20:04:22.147553 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.147495 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-55cf658bc9-xwtrb"] Oct 30 20:04:22.153147 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.152491 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.164604 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.164576 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Oct 30 20:04:22.165240 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.165217 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55cf658bc9-xwtrb"] Oct 30 20:04:22.229565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.229531 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-trusted-ca-bundle\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.229745 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.229576 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/798bd658-6564-41af-a7d6-3087695ac132-console-serving-cert\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.229745 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.229616 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/798bd658-6564-41af-a7d6-3087695ac132-tmp\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.229745 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.229653 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-service-ca\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.229745 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.229689 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-console-config\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.229745 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.229717 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/798bd658-6564-41af-a7d6-3087695ac132-console-oauth-config\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.229994 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.229755 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-oauth-serving-cert\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.229994 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.229780 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhlbs\" (UniqueName: \"kubernetes.io/projected/798bd658-6564-41af-a7d6-3087695ac132-kube-api-access-dhlbs\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.330592 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.330552 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-service-ca\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.330775 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.330618 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-console-config\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.330775 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.330648 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/798bd658-6564-41af-a7d6-3087695ac132-console-oauth-config\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.330775 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.330679 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-oauth-serving-cert\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.330775 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.330703 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhlbs\" (UniqueName: \"kubernetes.io/projected/798bd658-6564-41af-a7d6-3087695ac132-kube-api-access-dhlbs\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.330946 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.330791 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-trusted-ca-bundle\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.330946 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.330819 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/798bd658-6564-41af-a7d6-3087695ac132-console-serving-cert\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.330946 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.330846 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/798bd658-6564-41af-a7d6-3087695ac132-tmp\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.331264 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.331242 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/798bd658-6564-41af-a7d6-3087695ac132-tmp\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.331802 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.331447 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-service-ca\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.331978 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.331955 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-oauth-serving-cert\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.332462 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.332432 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-console-config\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.332565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.332476 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-trusted-ca-bundle\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.334944 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.334740 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/798bd658-6564-41af-a7d6-3087695ac132-console-oauth-config\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.334944 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.334897 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/798bd658-6564-41af-a7d6-3087695ac132-console-serving-cert\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.346422 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.346393 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhlbs\" (UniqueName: \"kubernetes.io/projected/798bd658-6564-41af-a7d6-3087695ac132-kube-api-access-dhlbs\") pod \"console-55cf658bc9-xwtrb\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.467970 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.467880 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:22.788810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.788776 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55cf658bc9-xwtrb"] Oct 30 20:04:22.934055 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.934011 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cf658bc9-xwtrb" event={"ID":"798bd658-6564-41af-a7d6-3087695ac132","Type":"ContainerStarted","Data":"029d4de37632195c33f42bb6655f2340715f4c3ce0434df0a338e4004679f53f"} Oct 30 20:04:22.934242 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:22.934076 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cf658bc9-xwtrb" event={"ID":"798bd658-6564-41af-a7d6-3087695ac132","Type":"ContainerStarted","Data":"c780e8db45067a2e9be8353aa448dd1ef0b1fc52d5c41a7ad00b2bca64e66ab8"} Oct 30 20:04:23.827827 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:23.827796 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5cbbcb9f56-h46cm" Oct 30 20:04:23.891247 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:23.891157 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8586cfd6bb-wzm9m"] Oct 30 20:04:26.257635 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.257557 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-75c856df5f-jdst9" podUID="4ac859bf-692b-4447-891a-32541e1e244d" containerName="registry" containerID="cri-o://fc1005743512a2f232b747e2c6fc756e181431d7e2159697d8101493b15576c3" gracePeriod=30 Oct 30 20:04:26.508252 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.508167 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:04:26.543976 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.543916 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-55cf658bc9-xwtrb" podStartSLOduration=4.543895455 podStartE2EDuration="4.543895455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:04:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:04:23.980136448 +0000 UTC m=+38.513409042" watchObservedRunningTime="2026-10-30 20:04:26.543895455 +0000 UTC m=+41.077168050" Oct 30 20:04:26.591780 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.591745 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4ac859bf-692b-4447-891a-32541e1e244d-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ac859bf-692b-4447-891a-32541e1e244d-installation-pull-secrets\") pod \"4ac859bf-692b-4447-891a-32541e1e244d\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " Oct 30 20:04:26.591976 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.591793 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4ac859bf-692b-4447-891a-32541e1e244d-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ac859bf-692b-4447-891a-32541e1e244d-ca-trust-extracted\") pod \"4ac859bf-692b-4447-891a-32541e1e244d\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " Oct 30 20:04:26.591976 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.591854 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4ac859bf-692b-4447-891a-32541e1e244d-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ac859bf-692b-4447-891a-32541e1e244d-registry-certificates\") pod \"4ac859bf-692b-4447-891a-32541e1e244d\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " Oct 30 20:04:26.591976 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.591901 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-kube-api-access-fsbbs\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-kube-api-access-fsbbs\") pod \"4ac859bf-692b-4447-891a-32541e1e244d\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " Oct 30 20:04:26.591976 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.591935 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls\") pod \"4ac859bf-692b-4447-891a-32541e1e244d\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " Oct 30 20:04:26.591976 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.591973 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4ac859bf-692b-4447-891a-32541e1e244d-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ac859bf-692b-4447-891a-32541e1e244d-trusted-ca\") pod \"4ac859bf-692b-4447-891a-32541e1e244d\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " Oct 30 20:04:26.592166 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.592002 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4ac859bf-692b-4447-891a-32541e1e244d-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ac859bf-692b-4447-891a-32541e1e244d-image-registry-private-configuration\") pod \"4ac859bf-692b-4447-891a-32541e1e244d\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " Oct 30 20:04:26.592166 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.592076 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-bound-sa-token\") pod \"4ac859bf-692b-4447-891a-32541e1e244d\" (UID: \"4ac859bf-692b-4447-891a-32541e1e244d\") " Oct 30 20:04:26.592888 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.592847 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ac859bf-692b-4447-891a-32541e1e244d-registry-certificates" pod "4ac859bf-692b-4447-891a-32541e1e244d" (UID: "4ac859bf-692b-4447-891a-32541e1e244d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:04:26.594421 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.593113 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ac859bf-692b-4447-891a-32541e1e244d-trusted-ca" pod "4ac859bf-692b-4447-891a-32541e1e244d" (UID: "4ac859bf-692b-4447-891a-32541e1e244d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:04:26.595769 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.595709 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls" pod "4ac859bf-692b-4447-891a-32541e1e244d" (UID: "4ac859bf-692b-4447-891a-32541e1e244d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:04:26.595989 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.595966 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ac859bf-692b-4447-891a-32541e1e244d-installation-pull-secrets" pod "4ac859bf-692b-4447-891a-32541e1e244d" (UID: "4ac859bf-692b-4447-891a-32541e1e244d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:04:26.596562 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.596540 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-bound-sa-token" pod "4ac859bf-692b-4447-891a-32541e1e244d" (UID: "4ac859bf-692b-4447-891a-32541e1e244d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:04:26.596688 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.596672 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-kube-api-access-fsbbs" pod "4ac859bf-692b-4447-891a-32541e1e244d" (UID: "4ac859bf-692b-4447-891a-32541e1e244d"). InnerVolumeSpecName "kube-api-access-fsbbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:04:26.597707 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.597667 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ac859bf-692b-4447-891a-32541e1e244d-image-registry-private-configuration" pod "4ac859bf-692b-4447-891a-32541e1e244d" (UID: "4ac859bf-692b-4447-891a-32541e1e244d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:04:26.603360 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.603292 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ac859bf-692b-4447-891a-32541e1e244d-ca-trust-extracted" pod "4ac859bf-692b-4447-891a-32541e1e244d" (UID: "4ac859bf-692b-4447-891a-32541e1e244d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:04:26.694616 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.694580 5078 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ac859bf-692b-4447-891a-32541e1e244d-trusted-ca\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:26.694865 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.694845 5078 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ac859bf-692b-4447-891a-32541e1e244d-image-registry-private-configuration\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:26.694972 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.694960 5078 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-bound-sa-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:26.695062 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.695051 5078 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ac859bf-692b-4447-891a-32541e1e244d-installation-pull-secrets\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:26.695142 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.695132 5078 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ac859bf-692b-4447-891a-32541e1e244d-ca-trust-extracted\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:26.695215 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.695205 5078 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ac859bf-692b-4447-891a-32541e1e244d-registry-certificates\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:26.695285 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.695275 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsbbs\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-kube-api-access-fsbbs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:26.695378 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.695365 5078 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ac859bf-692b-4447-891a-32541e1e244d-registry-tls\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:26.703876 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:04:26.703785 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:04:26.977685 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.977637 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-78j5c" event={"ID":"eb41a99a-d50e-4508-8f86-68e69baf8f9c","Type":"ContainerStarted","Data":"3b2e807e7b182411cceab96019b61a30801d93346d8c1d1cf4b50777ac360e28"} Oct 30 20:04:26.978053 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.978024 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-78j5c" Oct 30 20:04:26.979515 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.979483 5078 generic.go:356] "Generic (PLEG): container finished" podID="4ac859bf-692b-4447-891a-32541e1e244d" containerID="fc1005743512a2f232b747e2c6fc756e181431d7e2159697d8101493b15576c3" exitCode=0 Oct 30 20:04:26.979701 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.979545 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c856df5f-jdst9" Oct 30 20:04:26.979831 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.979803 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c856df5f-jdst9" event={"ID":"4ac859bf-692b-4447-891a-32541e1e244d","Type":"ContainerDied","Data":"fc1005743512a2f232b747e2c6fc756e181431d7e2159697d8101493b15576c3"} Oct 30 20:04:26.980624 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.980599 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c856df5f-jdst9" event={"ID":"4ac859bf-692b-4447-891a-32541e1e244d","Type":"ContainerDied","Data":"ba5bfb82363f997b0f5957c90d5d6d4d45f35cb7944e7b0744377eb4068830b0"} Oct 30 20:04:26.980739 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.980641 5078 scope.go:122] "RemoveContainer" containerID="fc1005743512a2f232b747e2c6fc756e181431d7e2159697d8101493b15576c3" Oct 30 20:04:26.992098 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.992070 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-78j5c" Oct 30 20:04:26.992186 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.992113 5078 scope.go:122] "RemoveContainer" containerID="fc1005743512a2f232b747e2c6fc756e181431d7e2159697d8101493b15576c3" Oct 30 20:04:26.992514 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:04:26.992483 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc1005743512a2f232b747e2c6fc756e181431d7e2159697d8101493b15576c3\": container with ID starting with fc1005743512a2f232b747e2c6fc756e181431d7e2159697d8101493b15576c3 not found: ID does not exist" containerID="fc1005743512a2f232b747e2c6fc756e181431d7e2159697d8101493b15576c3" Oct 30 20:04:26.992598 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:26.992528 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc1005743512a2f232b747e2c6fc756e181431d7e2159697d8101493b15576c3"} err="failed to get container status \"fc1005743512a2f232b747e2c6fc756e181431d7e2159697d8101493b15576c3\": rpc error: code = NotFound desc = could not find container \"fc1005743512a2f232b747e2c6fc756e181431d7e2159697d8101493b15576c3\": container with ID starting with fc1005743512a2f232b747e2c6fc756e181431d7e2159697d8101493b15576c3 not found: ID does not exist" Oct 30 20:04:27.000289 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:27.000208 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-78j5c" podStartSLOduration=1.6642024979999999 podStartE2EDuration="26.000191632s" totalImagesPullingTime="24.335989134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:04:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:04:26.998913495 +0000 UTC m=+41.532186092" watchObservedRunningTime="2026-10-30 20:04:27.000191632 +0000 UTC m=+41.533464262" Oct 30 20:04:27.014428 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:27.014389 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75c856df5f-jdst9"] Oct 30 20:04:27.019276 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:27.019239 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-75c856df5f-jdst9"] Oct 30 20:04:27.584753 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:27.584712 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4ac859bf-692b-4447-891a-32541e1e244d" path="/var/lib/kubelet/pods/4ac859bf-692b-4447-891a-32541e1e244d/volumes" Oct 30 20:04:32.468731 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:32.468697 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:32.469210 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:32.468761 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:32.474439 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:32.474415 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:33.016806 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:33.016770 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:04:33.094446 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:33.094406 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5456677fd7-lz2n7"] Oct 30 20:04:34.668715 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:34.668679 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-qqhv7-c6vvh"] Oct 30 20:04:34.669363 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:34.668910 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" podUID="1f847152-ec65-4b3c-bcb6-d8cac177e31d" containerName="insights-gathering" containerID="cri-o://1bb6423564c72af5315053685b4a970d5781a6cf40b473085f41bffdbd90913e" gracePeriod=30 Oct 30 20:04:35.013966 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.013939 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:04:35.024443 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.024408 5078 generic.go:356] "Generic (PLEG): container finished" podID="1f847152-ec65-4b3c-bcb6-d8cac177e31d" containerID="1bb6423564c72af5315053685b4a970d5781a6cf40b473085f41bffdbd90913e" exitCode=2 Oct 30 20:04:35.024614 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.024467 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" Oct 30 20:04:35.024614 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.024499 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" event={"ID":"1f847152-ec65-4b3c-bcb6-d8cac177e31d","Type":"ContainerDied","Data":"1bb6423564c72af5315053685b4a970d5781a6cf40b473085f41bffdbd90913e"} Oct 30 20:04:35.024614 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.024550 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-qqhv7-c6vvh" event={"ID":"1f847152-ec65-4b3c-bcb6-d8cac177e31d","Type":"ContainerDied","Data":"208d31340929213c2e8e7364a9a8d5cea18b913b39921a385a3c5b25f37953de"} Oct 30 20:04:35.024614 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.024572 5078 scope.go:122] "RemoveContainer" containerID="1bb6423564c72af5315053685b4a970d5781a6cf40b473085f41bffdbd90913e" Oct 30 20:04:35.034831 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.034812 5078 scope.go:122] "RemoveContainer" containerID="1bb6423564c72af5315053685b4a970d5781a6cf40b473085f41bffdbd90913e" Oct 30 20:04:35.035180 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:04:35.035138 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bb6423564c72af5315053685b4a970d5781a6cf40b473085f41bffdbd90913e\": container with ID starting with 1bb6423564c72af5315053685b4a970d5781a6cf40b473085f41bffdbd90913e not found: ID does not exist" containerID="1bb6423564c72af5315053685b4a970d5781a6cf40b473085f41bffdbd90913e" Oct 30 20:04:35.035301 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.035188 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bb6423564c72af5315053685b4a970d5781a6cf40b473085f41bffdbd90913e"} err="failed to get container status \"1bb6423564c72af5315053685b4a970d5781a6cf40b473085f41bffdbd90913e\": rpc error: code = NotFound desc = could not find container \"1bb6423564c72af5315053685b4a970d5781a6cf40b473085f41bffdbd90913e\": container with ID starting with 1bb6423564c72af5315053685b4a970d5781a6cf40b473085f41bffdbd90913e not found: ID does not exist" Oct 30 20:04:35.186175 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.186138 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1f847152-ec65-4b3c-bcb6-d8cac177e31d-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f847152-ec65-4b3c-bcb6-d8cac177e31d-service-ca-bundle\") pod \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " Oct 30 20:04:35.186175 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.186185 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1f847152-ec65-4b3c-bcb6-d8cac177e31d-kube-api-access-9px9m\" (UniqueName: \"kubernetes.io/projected/1f847152-ec65-4b3c-bcb6-d8cac177e31d-kube-api-access-9px9m\") pod \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " Oct 30 20:04:35.186464 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.186409 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f847152-ec65-4b3c-bcb6-d8cac177e31d-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/1f847152-ec65-4b3c-bcb6-d8cac177e31d-archives-path\") pod \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " Oct 30 20:04:35.186524 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.186505 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1f847152-ec65-4b3c-bcb6-d8cac177e31d-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f847152-ec65-4b3c-bcb6-d8cac177e31d-trusted-ca-bundle\") pod \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\" (UID: \"1f847152-ec65-4b3c-bcb6-d8cac177e31d\") " Oct 30 20:04:35.186638 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.186617 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f847152-ec65-4b3c-bcb6-d8cac177e31d-service-ca-bundle" pod "1f847152-ec65-4b3c-bcb6-d8cac177e31d" (UID: "1f847152-ec65-4b3c-bcb6-d8cac177e31d"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:04:35.186743 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.186721 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f847152-ec65-4b3c-bcb6-d8cac177e31d-archives-path" pod "1f847152-ec65-4b3c-bcb6-d8cac177e31d" (UID: "1f847152-ec65-4b3c-bcb6-d8cac177e31d"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:04:35.186816 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.186793 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f847152-ec65-4b3c-bcb6-d8cac177e31d-trusted-ca-bundle" pod "1f847152-ec65-4b3c-bcb6-d8cac177e31d" (UID: "1f847152-ec65-4b3c-bcb6-d8cac177e31d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:04:35.186854 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.186828 5078 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/1f847152-ec65-4b3c-bcb6-d8cac177e31d-archives-path\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:35.186854 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.186849 5078 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f847152-ec65-4b3c-bcb6-d8cac177e31d-service-ca-bundle\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:35.188581 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.188562 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f847152-ec65-4b3c-bcb6-d8cac177e31d-kube-api-access-9px9m" pod "1f847152-ec65-4b3c-bcb6-d8cac177e31d" (UID: "1f847152-ec65-4b3c-bcb6-d8cac177e31d"). InnerVolumeSpecName "kube-api-access-9px9m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:04:35.287769 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.287682 5078 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f847152-ec65-4b3c-bcb6-d8cac177e31d-trusted-ca-bundle\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:35.287769 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.287716 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9px9m\" (UniqueName: \"kubernetes.io/projected/1f847152-ec65-4b3c-bcb6-d8cac177e31d-kube-api-access-9px9m\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:35.349355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.349301 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-qqhv7-c6vvh"] Oct 30 20:04:35.356152 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.356124 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-qqhv7-c6vvh"] Oct 30 20:04:35.582871 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:35.582841 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1f847152-ec65-4b3c-bcb6-d8cac177e31d" path="/var/lib/kubelet/pods/1f847152-ec65-4b3c-bcb6-d8cac177e31d/volumes" Oct 30 20:04:48.918432 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:48.918361 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" podUID="27e4937d-367a-4ccc-9580-74a3982a49fe" containerName="registry" containerID="cri-o://34c90b73947f943a023b0b57e7fa83fb110d82afb7c0450a735c52f804878835" gracePeriod=30 Oct 30 20:04:49.092820 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.092783 5078 generic.go:356] "Generic (PLEG): container finished" podID="27e4937d-367a-4ccc-9580-74a3982a49fe" containerID="34c90b73947f943a023b0b57e7fa83fb110d82afb7c0450a735c52f804878835" exitCode=0 Oct 30 20:04:49.092977 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.092828 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" event={"ID":"27e4937d-367a-4ccc-9580-74a3982a49fe","Type":"ContainerDied","Data":"34c90b73947f943a023b0b57e7fa83fb110d82afb7c0450a735c52f804878835"} Oct 30 20:04:49.167621 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.167592 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:04:49.203511 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.203435 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-kube-api-access-qzghk\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-kube-api-access-qzghk\") pod \"27e4937d-367a-4ccc-9580-74a3982a49fe\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " Oct 30 20:04:49.203511 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.203486 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-certificates\") pod \"27e4937d-367a-4ccc-9580-74a3982a49fe\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " Oct 30 20:04:49.203744 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.203637 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/27e4937d-367a-4ccc-9580-74a3982a49fe-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/27e4937d-367a-4ccc-9580-74a3982a49fe-installation-pull-secrets\") pod \"27e4937d-367a-4ccc-9580-74a3982a49fe\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " Oct 30 20:04:49.203744 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.203691 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-bound-sa-token\") pod \"27e4937d-367a-4ccc-9580-74a3982a49fe\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " Oct 30 20:04:49.203865 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.203802 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/27e4937d-367a-4ccc-9580-74a3982a49fe-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/27e4937d-367a-4ccc-9580-74a3982a49fe-image-registry-private-configuration\") pod \"27e4937d-367a-4ccc-9580-74a3982a49fe\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " Oct 30 20:04:49.203865 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.203844 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/27e4937d-367a-4ccc-9580-74a3982a49fe-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/27e4937d-367a-4ccc-9580-74a3982a49fe-ca-trust-extracted\") pod \"27e4937d-367a-4ccc-9580-74a3982a49fe\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " Oct 30 20:04:49.203970 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.203894 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls\") pod \"27e4937d-367a-4ccc-9580-74a3982a49fe\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " Oct 30 20:04:49.203970 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.203901 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-certificates" pod "27e4937d-367a-4ccc-9580-74a3982a49fe" (UID: "27e4937d-367a-4ccc-9580-74a3982a49fe"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:04:49.204073 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.203989 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/27e4937d-367a-4ccc-9580-74a3982a49fe-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27e4937d-367a-4ccc-9580-74a3982a49fe-trusted-ca\") pod \"27e4937d-367a-4ccc-9580-74a3982a49fe\" (UID: \"27e4937d-367a-4ccc-9580-74a3982a49fe\") " Oct 30 20:04:49.204430 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.204402 5078 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-certificates\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:49.204784 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.204760 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27e4937d-367a-4ccc-9580-74a3982a49fe-trusted-ca" pod "27e4937d-367a-4ccc-9580-74a3982a49fe" (UID: "27e4937d-367a-4ccc-9580-74a3982a49fe"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:04:49.206029 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.206002 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls" pod "27e4937d-367a-4ccc-9580-74a3982a49fe" (UID: "27e4937d-367a-4ccc-9580-74a3982a49fe"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:04:49.206481 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.206425 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-bound-sa-token" pod "27e4937d-367a-4ccc-9580-74a3982a49fe" (UID: "27e4937d-367a-4ccc-9580-74a3982a49fe"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:04:49.206609 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.206524 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-kube-api-access-qzghk" pod "27e4937d-367a-4ccc-9580-74a3982a49fe" (UID: "27e4937d-367a-4ccc-9580-74a3982a49fe"). InnerVolumeSpecName "kube-api-access-qzghk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:04:49.206609 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.206547 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27e4937d-367a-4ccc-9580-74a3982a49fe-installation-pull-secrets" pod "27e4937d-367a-4ccc-9580-74a3982a49fe" (UID: "27e4937d-367a-4ccc-9580-74a3982a49fe"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:04:49.207778 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.207748 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27e4937d-367a-4ccc-9580-74a3982a49fe-image-registry-private-configuration" pod "27e4937d-367a-4ccc-9580-74a3982a49fe" (UID: "27e4937d-367a-4ccc-9580-74a3982a49fe"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:04:49.212809 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.212780 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27e4937d-367a-4ccc-9580-74a3982a49fe-ca-trust-extracted" pod "27e4937d-367a-4ccc-9580-74a3982a49fe" (UID: "27e4937d-367a-4ccc-9580-74a3982a49fe"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:04:49.305260 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.305221 5078 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27e4937d-367a-4ccc-9580-74a3982a49fe-trusted-ca\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:49.305260 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.305254 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzghk\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-kube-api-access-qzghk\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:49.305260 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.305267 5078 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/27e4937d-367a-4ccc-9580-74a3982a49fe-installation-pull-secrets\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:49.305527 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.305276 5078 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-bound-sa-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:49.305527 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.305287 5078 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/27e4937d-367a-4ccc-9580-74a3982a49fe-image-registry-private-configuration\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:49.305527 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.305296 5078 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/27e4937d-367a-4ccc-9580-74a3982a49fe-ca-trust-extracted\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:49.305527 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:49.305305 5078 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27e4937d-367a-4ccc-9580-74a3982a49fe-registry-tls\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:50.099045 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:50.099006 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" event={"ID":"27e4937d-367a-4ccc-9580-74a3982a49fe","Type":"ContainerDied","Data":"6033e17f791253f8fe61a0cdac7d05b1fbff1712410dd8688bbd34c881715f3c"} Oct 30 20:04:50.099045 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:50.099026 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8586cfd6bb-wzm9m" Oct 30 20:04:50.099529 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:50.099066 5078 scope.go:122] "RemoveContainer" containerID="34c90b73947f943a023b0b57e7fa83fb110d82afb7c0450a735c52f804878835" Oct 30 20:04:50.119201 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:50.119173 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8586cfd6bb-wzm9m"] Oct 30 20:04:50.124251 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:50.124229 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8586cfd6bb-wzm9m"] Oct 30 20:04:51.582715 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:51.582683 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="27e4937d-367a-4ccc-9580-74a3982a49fe" path="/var/lib/kubelet/pods/27e4937d-367a-4ccc-9580-74a3982a49fe/volumes" Oct 30 20:04:56.696738 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:04:56.696696 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:04:58.118218 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.118178 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-5456677fd7-lz2n7" podUID="5642ce9e-9678-4b42-8f44-d774b149c7eb" containerName="console" containerID="cri-o://b4b9eabebce729b6f2bcfad349d9d618d2eb1a750175e2984dff6f98784295b2" gracePeriod=15 Oct 30 20:04:58.414590 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.414560 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:58.484445 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.484409 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5642ce9e-9678-4b42-8f44-d774b149c7eb-kube-api-access-92xj9\" (UniqueName: \"kubernetes.io/projected/5642ce9e-9678-4b42-8f44-d774b149c7eb-kube-api-access-92xj9\") pod \"5642ce9e-9678-4b42-8f44-d774b149c7eb\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " Oct 30 20:04:58.484445 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.484454 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5642ce9e-9678-4b42-8f44-d774b149c7eb-service-ca\" (UniqueName: \"kubernetes.io/configmap/5642ce9e-9678-4b42-8f44-d774b149c7eb-service-ca\") pod \"5642ce9e-9678-4b42-8f44-d774b149c7eb\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " Oct 30 20:04:58.484721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.484548 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5642ce9e-9678-4b42-8f44-d774b149c7eb-tmp\" (UniqueName: \"kubernetes.io/empty-dir/5642ce9e-9678-4b42-8f44-d774b149c7eb-tmp\") pod \"5642ce9e-9678-4b42-8f44-d774b149c7eb\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " Oct 30 20:04:58.484721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.484569 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5642ce9e-9678-4b42-8f44-d774b149c7eb-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5642ce9e-9678-4b42-8f44-d774b149c7eb-console-serving-cert\") pod \"5642ce9e-9678-4b42-8f44-d774b149c7eb\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " Oct 30 20:04:58.484721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.484617 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5642ce9e-9678-4b42-8f44-d774b149c7eb-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5642ce9e-9678-4b42-8f44-d774b149c7eb-oauth-serving-cert\") pod \"5642ce9e-9678-4b42-8f44-d774b149c7eb\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " Oct 30 20:04:58.484721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.484645 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5642ce9e-9678-4b42-8f44-d774b149c7eb-console-config\" (UniqueName: \"kubernetes.io/configmap/5642ce9e-9678-4b42-8f44-d774b149c7eb-console-config\") pod \"5642ce9e-9678-4b42-8f44-d774b149c7eb\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " Oct 30 20:04:58.484721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.484694 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5642ce9e-9678-4b42-8f44-d774b149c7eb-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5642ce9e-9678-4b42-8f44-d774b149c7eb-console-oauth-config\") pod \"5642ce9e-9678-4b42-8f44-d774b149c7eb\" (UID: \"5642ce9e-9678-4b42-8f44-d774b149c7eb\") " Oct 30 20:04:58.484974 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.484940 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5642ce9e-9678-4b42-8f44-d774b149c7eb-tmp" pod "5642ce9e-9678-4b42-8f44-d774b149c7eb" (UID: "5642ce9e-9678-4b42-8f44-d774b149c7eb"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:04:58.484974 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.484952 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5642ce9e-9678-4b42-8f44-d774b149c7eb-service-ca" pod "5642ce9e-9678-4b42-8f44-d774b149c7eb" (UID: "5642ce9e-9678-4b42-8f44-d774b149c7eb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:04:58.485092 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.485054 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5642ce9e-9678-4b42-8f44-d774b149c7eb-oauth-serving-cert" pod "5642ce9e-9678-4b42-8f44-d774b149c7eb" (UID: "5642ce9e-9678-4b42-8f44-d774b149c7eb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:04:58.485092 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.485050 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5642ce9e-9678-4b42-8f44-d774b149c7eb-console-config" pod "5642ce9e-9678-4b42-8f44-d774b149c7eb" (UID: "5642ce9e-9678-4b42-8f44-d774b149c7eb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:04:58.486938 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.486912 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5642ce9e-9678-4b42-8f44-d774b149c7eb-console-serving-cert" pod "5642ce9e-9678-4b42-8f44-d774b149c7eb" (UID: "5642ce9e-9678-4b42-8f44-d774b149c7eb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:04:58.487076 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.486949 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5642ce9e-9678-4b42-8f44-d774b149c7eb-console-oauth-config" pod "5642ce9e-9678-4b42-8f44-d774b149c7eb" (UID: "5642ce9e-9678-4b42-8f44-d774b149c7eb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:04:58.487076 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.486996 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5642ce9e-9678-4b42-8f44-d774b149c7eb-kube-api-access-92xj9" pod "5642ce9e-9678-4b42-8f44-d774b149c7eb" (UID: "5642ce9e-9678-4b42-8f44-d774b149c7eb"). InnerVolumeSpecName "kube-api-access-92xj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:04:58.585749 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.585712 5078 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5642ce9e-9678-4b42-8f44-d774b149c7eb-tmp\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:58.585749 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.585745 5078 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5642ce9e-9678-4b42-8f44-d774b149c7eb-console-serving-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:58.585749 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.585755 5078 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5642ce9e-9678-4b42-8f44-d774b149c7eb-oauth-serving-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:58.586001 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.585766 5078 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5642ce9e-9678-4b42-8f44-d774b149c7eb-console-config\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:58.586001 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.585776 5078 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5642ce9e-9678-4b42-8f44-d774b149c7eb-console-oauth-config\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:58.586001 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.585784 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92xj9\" (UniqueName: \"kubernetes.io/projected/5642ce9e-9678-4b42-8f44-d774b149c7eb-kube-api-access-92xj9\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:58.586001 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:58.585793 5078 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5642ce9e-9678-4b42-8f44-d774b149c7eb-service-ca\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:04:59.143001 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:59.142968 5078 generic.go:356] "Generic (PLEG): container finished" podID="5642ce9e-9678-4b42-8f44-d774b149c7eb" containerID="b4b9eabebce729b6f2bcfad349d9d618d2eb1a750175e2984dff6f98784295b2" exitCode=0 Oct 30 20:04:59.143452 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:59.143016 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5456677fd7-lz2n7" Oct 30 20:04:59.143452 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:59.143057 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5456677fd7-lz2n7" event={"ID":"5642ce9e-9678-4b42-8f44-d774b149c7eb","Type":"ContainerDied","Data":"b4b9eabebce729b6f2bcfad349d9d618d2eb1a750175e2984dff6f98784295b2"} Oct 30 20:04:59.143452 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:59.143122 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5456677fd7-lz2n7" event={"ID":"5642ce9e-9678-4b42-8f44-d774b149c7eb","Type":"ContainerDied","Data":"e507c7722b6f79896171e9e17031d64746ac884f2105f11325d1cb6364321d10"} Oct 30 20:04:59.143452 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:59.143143 5078 scope.go:122] "RemoveContainer" containerID="b4b9eabebce729b6f2bcfad349d9d618d2eb1a750175e2984dff6f98784295b2" Oct 30 20:04:59.151994 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:59.151974 5078 scope.go:122] "RemoveContainer" containerID="b4b9eabebce729b6f2bcfad349d9d618d2eb1a750175e2984dff6f98784295b2" Oct 30 20:04:59.152310 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:04:59.152292 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4b9eabebce729b6f2bcfad349d9d618d2eb1a750175e2984dff6f98784295b2\": container with ID starting with b4b9eabebce729b6f2bcfad349d9d618d2eb1a750175e2984dff6f98784295b2 not found: ID does not exist" containerID="b4b9eabebce729b6f2bcfad349d9d618d2eb1a750175e2984dff6f98784295b2" Oct 30 20:04:59.152399 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:59.152323 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4b9eabebce729b6f2bcfad349d9d618d2eb1a750175e2984dff6f98784295b2"} err="failed to get container status \"b4b9eabebce729b6f2bcfad349d9d618d2eb1a750175e2984dff6f98784295b2\": rpc error: code = NotFound desc = could not find container \"b4b9eabebce729b6f2bcfad349d9d618d2eb1a750175e2984dff6f98784295b2\": container with ID starting with b4b9eabebce729b6f2bcfad349d9d618d2eb1a750175e2984dff6f98784295b2 not found: ID does not exist" Oct 30 20:04:59.165805 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:59.165773 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5456677fd7-lz2n7"] Oct 30 20:04:59.170820 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:59.170792 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5456677fd7-lz2n7"] Oct 30 20:04:59.583251 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:04:59.583221 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5642ce9e-9678-4b42-8f44-d774b149c7eb" path="/var/lib/kubelet/pods/5642ce9e-9678-4b42-8f44-d774b149c7eb/volumes" Oct 30 20:05:26.699000 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:05:26.698955 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:05:27.259208 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:05:27.259172 5078 generic.go:356] "Generic (PLEG): container finished" podID="2a0531af-9e1e-4496-b260-d8310fa93013" containerID="25e29b0f2c7c380dce686c62eafb5f11346ece0c9be0d0de505cd52e4caed11e" exitCode=0 Oct 30 20:05:27.259412 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:05:27.259229 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-sd6vl-68tbx" event={"ID":"2a0531af-9e1e-4496-b260-d8310fa93013","Type":"ContainerDied","Data":"25e29b0f2c7c380dce686c62eafb5f11346ece0c9be0d0de505cd52e4caed11e"} Oct 30 20:05:28.393853 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:05:28.393818 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-sd6vl-68tbx" Oct 30 20:05:28.554735 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:05:28.554617 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2a0531af-9e1e-4496-b260-d8310fa93013-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a0531af-9e1e-4496-b260-d8310fa93013-trusted-ca-bundle\") pod \"2a0531af-9e1e-4496-b260-d8310fa93013\" (UID: \"2a0531af-9e1e-4496-b260-d8310fa93013\") " Oct 30 20:05:28.554735 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:05:28.554718 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2a0531af-9e1e-4496-b260-d8310fa93013-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a0531af-9e1e-4496-b260-d8310fa93013-service-ca-bundle\") pod \"2a0531af-9e1e-4496-b260-d8310fa93013\" (UID: \"2a0531af-9e1e-4496-b260-d8310fa93013\") " Oct 30 20:05:28.554979 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:05:28.554811 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2a0531af-9e1e-4496-b260-d8310fa93013-kube-api-access-jkspq\" (UniqueName: \"kubernetes.io/projected/2a0531af-9e1e-4496-b260-d8310fa93013-kube-api-access-jkspq\") pod \"2a0531af-9e1e-4496-b260-d8310fa93013\" (UID: \"2a0531af-9e1e-4496-b260-d8310fa93013\") " Oct 30 20:05:28.554979 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:05:28.554847 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2a0531af-9e1e-4496-b260-d8310fa93013-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2a0531af-9e1e-4496-b260-d8310fa93013-archives-path\") pod \"2a0531af-9e1e-4496-b260-d8310fa93013\" (UID: \"2a0531af-9e1e-4496-b260-d8310fa93013\") " Oct 30 20:05:28.555081 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:05:28.555059 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a0531af-9e1e-4496-b260-d8310fa93013-trusted-ca-bundle" pod "2a0531af-9e1e-4496-b260-d8310fa93013" (UID: "2a0531af-9e1e-4496-b260-d8310fa93013"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:05:28.555248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:05:28.555216 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a0531af-9e1e-4496-b260-d8310fa93013-service-ca-bundle" pod "2a0531af-9e1e-4496-b260-d8310fa93013" (UID: "2a0531af-9e1e-4496-b260-d8310fa93013"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:05:28.555386 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:05:28.555227 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a0531af-9e1e-4496-b260-d8310fa93013-archives-path" pod "2a0531af-9e1e-4496-b260-d8310fa93013" (UID: "2a0531af-9e1e-4496-b260-d8310fa93013"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:05:28.556964 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:05:28.556930 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a0531af-9e1e-4496-b260-d8310fa93013-kube-api-access-jkspq" pod "2a0531af-9e1e-4496-b260-d8310fa93013" (UID: "2a0531af-9e1e-4496-b260-d8310fa93013"). InnerVolumeSpecName "kube-api-access-jkspq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:05:28.655880 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:05:28.655822 5078 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a0531af-9e1e-4496-b260-d8310fa93013-service-ca-bundle\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:05:28.655880 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:05:28.655873 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkspq\" (UniqueName: \"kubernetes.io/projected/2a0531af-9e1e-4496-b260-d8310fa93013-kube-api-access-jkspq\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:05:28.655880 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:05:28.655888 5078 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2a0531af-9e1e-4496-b260-d8310fa93013-archives-path\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:05:28.656139 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:05:28.655902 5078 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a0531af-9e1e-4496-b260-d8310fa93013-trusted-ca-bundle\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:05:29.269019 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:05:29.268973 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-sd6vl-68tbx" event={"ID":"2a0531af-9e1e-4496-b260-d8310fa93013","Type":"ContainerDied","Data":"8903aec8fc5e27ac6ca4026fb76d62b51eb0b5f3d7d740a458e6a514db3bcaaa"} Oct 30 20:05:29.269019 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:05:29.268996 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-sd6vl-68tbx" Oct 30 20:05:29.269019 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:05:29.269024 5078 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8903aec8fc5e27ac6ca4026fb76d62b51eb0b5f3d7d740a458e6a514db3bcaaa" Oct 30 20:05:52.290582 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:05:52.290541 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55cf658bc9-xwtrb"] Oct 30 20:05:56.698532 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:05:56.698447 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:06:17.311986 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.311947 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-55cf658bc9-xwtrb" podUID="798bd658-6564-41af-a7d6-3087695ac132" containerName="console" containerID="cri-o://029d4de37632195c33f42bb6655f2340715f4c3ce0434df0a338e4004679f53f" gracePeriod=15 Oct 30 20:06:17.483044 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.483013 5078 generic.go:356] "Generic (PLEG): container finished" podID="798bd658-6564-41af-a7d6-3087695ac132" containerID="029d4de37632195c33f42bb6655f2340715f4c3ce0434df0a338e4004679f53f" exitCode=0 Oct 30 20:06:17.483185 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.483091 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cf658bc9-xwtrb" event={"ID":"798bd658-6564-41af-a7d6-3087695ac132","Type":"ContainerDied","Data":"029d4de37632195c33f42bb6655f2340715f4c3ce0434df0a338e4004679f53f"} Oct 30 20:06:17.564514 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.564444 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:06:17.665450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.665407 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-service-ca\" (UniqueName: \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-service-ca\") pod \"798bd658-6564-41af-a7d6-3087695ac132\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " Oct 30 20:06:17.665450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.665453 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-trusted-ca-bundle\") pod \"798bd658-6564-41af-a7d6-3087695ac132\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " Oct 30 20:06:17.665720 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.665471 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-console-config\" (UniqueName: \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-console-config\") pod \"798bd658-6564-41af-a7d6-3087695ac132\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " Oct 30 20:06:17.665720 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.665497 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/798bd658-6564-41af-a7d6-3087695ac132-tmp\" (UniqueName: \"kubernetes.io/empty-dir/798bd658-6564-41af-a7d6-3087695ac132-tmp\") pod \"798bd658-6564-41af-a7d6-3087695ac132\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " Oct 30 20:06:17.665720 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.665515 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/798bd658-6564-41af-a7d6-3087695ac132-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/798bd658-6564-41af-a7d6-3087695ac132-console-oauth-config\") pod \"798bd658-6564-41af-a7d6-3087695ac132\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " Oct 30 20:06:17.665720 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.665544 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/798bd658-6564-41af-a7d6-3087695ac132-kube-api-access-dhlbs\" (UniqueName: \"kubernetes.io/projected/798bd658-6564-41af-a7d6-3087695ac132-kube-api-access-dhlbs\") pod \"798bd658-6564-41af-a7d6-3087695ac132\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " Oct 30 20:06:17.665720 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.665614 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/798bd658-6564-41af-a7d6-3087695ac132-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/798bd658-6564-41af-a7d6-3087695ac132-console-serving-cert\") pod \"798bd658-6564-41af-a7d6-3087695ac132\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " Oct 30 20:06:17.665720 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.665642 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-oauth-serving-cert\") pod \"798bd658-6564-41af-a7d6-3087695ac132\" (UID: \"798bd658-6564-41af-a7d6-3087695ac132\") " Oct 30 20:06:17.666023 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.665883 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/798bd658-6564-41af-a7d6-3087695ac132-tmp" pod "798bd658-6564-41af-a7d6-3087695ac132" (UID: "798bd658-6564-41af-a7d6-3087695ac132"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:06:17.666127 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.666098 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-trusted-ca-bundle" pod "798bd658-6564-41af-a7d6-3087695ac132" (UID: "798bd658-6564-41af-a7d6-3087695ac132"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:06:17.666260 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.666231 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-oauth-serving-cert" pod "798bd658-6564-41af-a7d6-3087695ac132" (UID: "798bd658-6564-41af-a7d6-3087695ac132"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:06:17.666260 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.666108 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-service-ca" pod "798bd658-6564-41af-a7d6-3087695ac132" (UID: "798bd658-6564-41af-a7d6-3087695ac132"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:06:17.666381 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.666121 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-console-config" pod "798bd658-6564-41af-a7d6-3087695ac132" (UID: "798bd658-6564-41af-a7d6-3087695ac132"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:06:17.667979 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.667955 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/798bd658-6564-41af-a7d6-3087695ac132-kube-api-access-dhlbs" pod "798bd658-6564-41af-a7d6-3087695ac132" (UID: "798bd658-6564-41af-a7d6-3087695ac132"). InnerVolumeSpecName "kube-api-access-dhlbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:06:17.668052 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.667972 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/798bd658-6564-41af-a7d6-3087695ac132-console-serving-cert" pod "798bd658-6564-41af-a7d6-3087695ac132" (UID: "798bd658-6564-41af-a7d6-3087695ac132"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:06:17.668052 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.668013 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/798bd658-6564-41af-a7d6-3087695ac132-console-oauth-config" pod "798bd658-6564-41af-a7d6-3087695ac132" (UID: "798bd658-6564-41af-a7d6-3087695ac132"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:06:17.766777 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.766741 5078 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-service-ca\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:06:17.766777 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.766771 5078 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-trusted-ca-bundle\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:06:17.766777 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.766782 5078 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-console-config\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:06:17.767017 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.766792 5078 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/798bd658-6564-41af-a7d6-3087695ac132-tmp\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:06:17.767017 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.766802 5078 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/798bd658-6564-41af-a7d6-3087695ac132-console-oauth-config\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:06:17.767017 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.766811 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhlbs\" (UniqueName: \"kubernetes.io/projected/798bd658-6564-41af-a7d6-3087695ac132-kube-api-access-dhlbs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:06:17.767017 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.766820 5078 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/798bd658-6564-41af-a7d6-3087695ac132-console-serving-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:06:17.767017 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:17.766829 5078 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/798bd658-6564-41af-a7d6-3087695ac132-oauth-serving-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:06:18.488938 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:18.488895 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cf658bc9-xwtrb" event={"ID":"798bd658-6564-41af-a7d6-3087695ac132","Type":"ContainerDied","Data":"c780e8db45067a2e9be8353aa448dd1ef0b1fc52d5c41a7ad00b2bca64e66ab8"} Oct 30 20:06:18.489478 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:18.488955 5078 scope.go:122] "RemoveContainer" containerID="029d4de37632195c33f42bb6655f2340715f4c3ce0434df0a338e4004679f53f" Oct 30 20:06:18.489478 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:18.488910 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cf658bc9-xwtrb" Oct 30 20:06:18.512084 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:18.512037 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55cf658bc9-xwtrb"] Oct 30 20:06:18.516271 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:18.516244 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55cf658bc9-xwtrb"] Oct 30 20:06:19.583594 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:06:19.583559 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="798bd658-6564-41af-a7d6-3087695ac132" path="/var/lib/kubelet/pods/798bd658-6564-41af-a7d6-3087695ac132/volumes" Oct 30 20:06:26.697968 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:06:26.697925 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:06:56.697403 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:06:56.697360 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:07:26.697643 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:07:26.697558 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:07:56.698737 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:07:56.698698 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:08:26.698653 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:08:26.698608 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:08:45.601490 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:45.601455 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/1.log" Oct 30 20:08:45.602256 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:45.602236 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/1.log" Oct 30 20:08:55.502583 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.502494 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft"] Oct 30 20:08:55.503016 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.502852 5078 cpu_manager.go:414] "containerMap: removing container" podUID="4ac859bf-692b-4447-891a-32541e1e244d" containerName="registry" Oct 30 20:08:55.503016 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.502865 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4ac859bf-692b-4447-891a-32541e1e244d" containerName="registry" Oct 30 20:08:55.503016 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.502884 5078 cpu_manager.go:414] "containerMap: removing container" podUID="1f847152-ec65-4b3c-bcb6-d8cac177e31d" containerName="insights-gathering" Oct 30 20:08:55.503016 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.502892 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f847152-ec65-4b3c-bcb6-d8cac177e31d" containerName="insights-gathering" Oct 30 20:08:55.503016 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.502905 5078 cpu_manager.go:414] "containerMap: removing container" podUID="5642ce9e-9678-4b42-8f44-d774b149c7eb" containerName="console" Oct 30 20:08:55.503016 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.502911 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5642ce9e-9678-4b42-8f44-d774b149c7eb" containerName="console" Oct 30 20:08:55.503016 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.502918 5078 cpu_manager.go:414] "containerMap: removing container" podUID="27e4937d-367a-4ccc-9580-74a3982a49fe" containerName="registry" Oct 30 20:08:55.503016 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.502923 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="27e4937d-367a-4ccc-9580-74a3982a49fe" containerName="registry" Oct 30 20:08:55.503016 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.502936 5078 cpu_manager.go:414] "containerMap: removing container" podUID="2a0531af-9e1e-4496-b260-d8310fa93013" containerName="insights-gathering" Oct 30 20:08:55.503016 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.502940 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2a0531af-9e1e-4496-b260-d8310fa93013" containerName="insights-gathering" Oct 30 20:08:55.503016 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.502948 5078 cpu_manager.go:414] "containerMap: removing container" podUID="798bd658-6564-41af-a7d6-3087695ac132" containerName="console" Oct 30 20:08:55.503016 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.502955 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="798bd658-6564-41af-a7d6-3087695ac132" containerName="console" Oct 30 20:08:55.503515 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.503034 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="5642ce9e-9678-4b42-8f44-d774b149c7eb" containerName="console" Oct 30 20:08:55.503515 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.503042 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="27e4937d-367a-4ccc-9580-74a3982a49fe" containerName="registry" Oct 30 20:08:55.503515 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.503049 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="2a0531af-9e1e-4496-b260-d8310fa93013" containerName="insights-gathering" Oct 30 20:08:55.503515 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.503054 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="798bd658-6564-41af-a7d6-3087695ac132" containerName="console" Oct 30 20:08:55.503515 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.503062 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="4ac859bf-692b-4447-891a-32541e1e244d" containerName="registry" Oct 30 20:08:55.503515 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.503068 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="1f847152-ec65-4b3c-bcb6-d8cac177e31d" containerName="insights-gathering" Oct 30 20:08:55.506924 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.506902 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:08:55.542002 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.541966 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft"] Oct 30 20:08:55.568299 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.568268 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Oct 30 20:08:55.568474 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.568348 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Oct 30 20:08:55.580149 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.580092 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/905da0b8-b345-447a-960f-7f3ddaa544ff-metrics-cert\") pod \"opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft\" (UID: \"905da0b8-b345-447a-960f-7f3ddaa544ff\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:08:55.580318 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.580193 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/905da0b8-b345-447a-960f-7f3ddaa544ff-tmp\") pod \"opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft\" (UID: \"905da0b8-b345-447a-960f-7f3ddaa544ff\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:08:55.580318 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.580253 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m882k\" (UniqueName: \"kubernetes.io/projected/905da0b8-b345-447a-960f-7f3ddaa544ff-kube-api-access-m882k\") pod \"opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft\" (UID: \"905da0b8-b345-447a-960f-7f3ddaa544ff\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:08:55.580431 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.580413 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/905da0b8-b345-447a-960f-7f3ddaa544ff-manifests\") pod \"opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft\" (UID: \"905da0b8-b345-447a-960f-7f3ddaa544ff\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:08:55.580472 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.580444 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/905da0b8-b345-447a-960f-7f3ddaa544ff-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft\" (UID: \"905da0b8-b345-447a-960f-7f3ddaa544ff\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:08:55.580516 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.580498 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/905da0b8-b345-447a-960f-7f3ddaa544ff-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft\" (UID: \"905da0b8-b345-447a-960f-7f3ddaa544ff\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:08:55.587309 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.587280 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Oct 30 20:08:55.587853 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.587835 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-metrics-tls\"" Oct 30 20:08:55.587938 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.587857 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Oct 30 20:08:55.587978 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.587934 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d9p54\"" Oct 30 20:08:55.681094 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.681051 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m882k\" (UniqueName: \"kubernetes.io/projected/905da0b8-b345-447a-960f-7f3ddaa544ff-kube-api-access-m882k\") pod \"opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft\" (UID: \"905da0b8-b345-447a-960f-7f3ddaa544ff\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:08:55.681310 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.681121 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/905da0b8-b345-447a-960f-7f3ddaa544ff-manifests\") pod \"opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft\" (UID: \"905da0b8-b345-447a-960f-7f3ddaa544ff\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:08:55.681310 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.681141 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/905da0b8-b345-447a-960f-7f3ddaa544ff-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft\" (UID: \"905da0b8-b345-447a-960f-7f3ddaa544ff\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:08:55.681310 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.681173 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/905da0b8-b345-447a-960f-7f3ddaa544ff-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft\" (UID: \"905da0b8-b345-447a-960f-7f3ddaa544ff\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:08:55.681310 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.681193 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/905da0b8-b345-447a-960f-7f3ddaa544ff-metrics-cert\") pod \"opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft\" (UID: \"905da0b8-b345-447a-960f-7f3ddaa544ff\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:08:55.681310 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.681210 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/905da0b8-b345-447a-960f-7f3ddaa544ff-tmp\") pod \"opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft\" (UID: \"905da0b8-b345-447a-960f-7f3ddaa544ff\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:08:55.681647 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.681612 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/905da0b8-b345-447a-960f-7f3ddaa544ff-manifests\") pod \"opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft\" (UID: \"905da0b8-b345-447a-960f-7f3ddaa544ff\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:08:55.683729 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.683700 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/905da0b8-b345-447a-960f-7f3ddaa544ff-tmp\") pod \"opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft\" (UID: \"905da0b8-b345-447a-960f-7f3ddaa544ff\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:08:55.683968 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.683947 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/905da0b8-b345-447a-960f-7f3ddaa544ff-metrics-cert\") pod \"opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft\" (UID: \"905da0b8-b345-447a-960f-7f3ddaa544ff\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:08:55.684110 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.684091 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/905da0b8-b345-447a-960f-7f3ddaa544ff-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft\" (UID: \"905da0b8-b345-447a-960f-7f3ddaa544ff\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:08:55.684171 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.684091 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/905da0b8-b345-447a-960f-7f3ddaa544ff-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft\" (UID: \"905da0b8-b345-447a-960f-7f3ddaa544ff\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:08:55.696939 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.696908 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m882k\" (UniqueName: \"kubernetes.io/projected/905da0b8-b345-447a-960f-7f3ddaa544ff-kube-api-access-m882k\") pod \"opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft\" (UID: \"905da0b8-b345-447a-960f-7f3ddaa544ff\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:08:55.831090 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:55.831059 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:08:56.156855 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:08:56.156815 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod905da0b8_b345_447a_960f_7f3ddaa544ff.slice/crio-a380f54b2a4d0f5e572c26d3b5f0815c15ce20e6e6c31e9a5bb7c39cb588c79a WatchSource:0}: Error finding container a380f54b2a4d0f5e572c26d3b5f0815c15ce20e6e6c31e9a5bb7c39cb588c79a: Status 404 returned error can't find the container with id a380f54b2a4d0f5e572c26d3b5f0815c15ce20e6e6c31e9a5bb7c39cb588c79a Oct 30 20:08:56.157101 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:56.157079 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft"] Oct 30 20:08:56.158483 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:56.158466 5078 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 20:08:56.700881 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:08:56.700845 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:08:57.144799 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:57.144709 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" event={"ID":"905da0b8-b345-447a-960f-7f3ddaa544ff","Type":"ContainerStarted","Data":"a380f54b2a4d0f5e572c26d3b5f0815c15ce20e6e6c31e9a5bb7c39cb588c79a"} Oct 30 20:08:59.159188 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:08:59.159151 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" event={"ID":"905da0b8-b345-447a-960f-7f3ddaa544ff","Type":"ContainerStarted","Data":"b3e31db19de7df848d76973fc54a4de98578fe43683eb851cabd5e6cd4169274"} Oct 30 20:09:00.164552 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:00.164507 5078 generic.go:356] "Generic (PLEG): container finished" podID="905da0b8-b345-447a-960f-7f3ddaa544ff" containerID="b3e31db19de7df848d76973fc54a4de98578fe43683eb851cabd5e6cd4169274" exitCode=0 Oct 30 20:09:00.164985 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:00.164568 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" event={"ID":"905da0b8-b345-447a-960f-7f3ddaa544ff","Type":"ContainerDied","Data":"b3e31db19de7df848d76973fc54a4de98578fe43683eb851cabd5e6cd4169274"} Oct 30 20:09:01.170421 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:01.170382 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" event={"ID":"905da0b8-b345-447a-960f-7f3ddaa544ff","Type":"ContainerStarted","Data":"5efc76868f628c16ab0ece8dfd2f2834b29f41e9d51c892275c4fecb3989a127"} Oct 30 20:09:01.170934 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:01.170499 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:09:01.219977 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:01.219907 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" podStartSLOduration=2.437911271 podStartE2EDuration="6.219891874s" totalImagesPullingTime="3.323321056s" totalInitContainerRuntime="458.659547ms" isStatefulPod=false podCreationTimestamp="2026-10-30 20:08:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:09:01.217909831 +0000 UTC m=+315.751182435" watchObservedRunningTime="2026-10-30 20:09:01.219891874 +0000 UTC m=+315.753164467" Oct 30 20:09:12.178100 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:12.178067 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft" Oct 30 20:09:25.158997 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:25.158962 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-d477969dd-cchjb"] Oct 30 20:09:25.161407 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:25.161389 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d477969dd-cchjb" Oct 30 20:09:25.170432 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:25.170401 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Oct 30 20:09:25.170432 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:25.170410 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9dr5w\"" Oct 30 20:09:25.170615 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:25.170410 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Oct 30 20:09:25.178488 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:25.177921 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d477969dd-cchjb"] Oct 30 20:09:25.341765 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:25.341719 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d85401f-0ca6-4d63-a134-1c1a40bd1754-tls-certs\") pod \"kube-auth-proxy-d477969dd-cchjb\" (UID: \"7d85401f-0ca6-4d63-a134-1c1a40bd1754\") " pod="openshift-ingress/kube-auth-proxy-d477969dd-cchjb" Oct 30 20:09:25.341967 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:25.341785 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn49v\" (UniqueName: \"kubernetes.io/projected/7d85401f-0ca6-4d63-a134-1c1a40bd1754-kube-api-access-cn49v\") pod \"kube-auth-proxy-d477969dd-cchjb\" (UID: \"7d85401f-0ca6-4d63-a134-1c1a40bd1754\") " pod="openshift-ingress/kube-auth-proxy-d477969dd-cchjb" Oct 30 20:09:25.341967 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:25.341883 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d85401f-0ca6-4d63-a134-1c1a40bd1754-tmp\") pod \"kube-auth-proxy-d477969dd-cchjb\" (UID: \"7d85401f-0ca6-4d63-a134-1c1a40bd1754\") " pod="openshift-ingress/kube-auth-proxy-d477969dd-cchjb" Oct 30 20:09:25.443200 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:25.443081 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn49v\" (UniqueName: \"kubernetes.io/projected/7d85401f-0ca6-4d63-a134-1c1a40bd1754-kube-api-access-cn49v\") pod \"kube-auth-proxy-d477969dd-cchjb\" (UID: \"7d85401f-0ca6-4d63-a134-1c1a40bd1754\") " pod="openshift-ingress/kube-auth-proxy-d477969dd-cchjb" Oct 30 20:09:25.443200 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:25.443149 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d85401f-0ca6-4d63-a134-1c1a40bd1754-tmp\") pod \"kube-auth-proxy-d477969dd-cchjb\" (UID: \"7d85401f-0ca6-4d63-a134-1c1a40bd1754\") " pod="openshift-ingress/kube-auth-proxy-d477969dd-cchjb" Oct 30 20:09:25.443200 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:25.443197 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d85401f-0ca6-4d63-a134-1c1a40bd1754-tls-certs\") pod \"kube-auth-proxy-d477969dd-cchjb\" (UID: \"7d85401f-0ca6-4d63-a134-1c1a40bd1754\") " pod="openshift-ingress/kube-auth-proxy-d477969dd-cchjb" Oct 30 20:09:25.445675 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:25.445647 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d85401f-0ca6-4d63-a134-1c1a40bd1754-tmp\") pod \"kube-auth-proxy-d477969dd-cchjb\" (UID: \"7d85401f-0ca6-4d63-a134-1c1a40bd1754\") " pod="openshift-ingress/kube-auth-proxy-d477969dd-cchjb" Oct 30 20:09:25.445827 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:25.445808 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d85401f-0ca6-4d63-a134-1c1a40bd1754-tls-certs\") pod \"kube-auth-proxy-d477969dd-cchjb\" (UID: \"7d85401f-0ca6-4d63-a134-1c1a40bd1754\") " pod="openshift-ingress/kube-auth-proxy-d477969dd-cchjb" Oct 30 20:09:25.456346 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:25.456309 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn49v\" (UniqueName: \"kubernetes.io/projected/7d85401f-0ca6-4d63-a134-1c1a40bd1754-kube-api-access-cn49v\") pod \"kube-auth-proxy-d477969dd-cchjb\" (UID: \"7d85401f-0ca6-4d63-a134-1c1a40bd1754\") " pod="openshift-ingress/kube-auth-proxy-d477969dd-cchjb" Oct 30 20:09:25.483306 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:25.483273 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d477969dd-cchjb" Oct 30 20:09:25.765015 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:25.764984 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d477969dd-cchjb"] Oct 30 20:09:25.768142 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:09:25.768117 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d85401f_0ca6_4d63_a134_1c1a40bd1754.slice/crio-7076afba7eabb6c53f2d5f663c17a71957650f2ef4d84cdb5e42121fb49077a1 WatchSource:0}: Error finding container 7076afba7eabb6c53f2d5f663c17a71957650f2ef4d84cdb5e42121fb49077a1: Status 404 returned error can't find the container with id 7076afba7eabb6c53f2d5f663c17a71957650f2ef4d84cdb5e42121fb49077a1 Oct 30 20:09:26.275351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:26.275298 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d477969dd-cchjb" event={"ID":"7d85401f-0ca6-4d63-a134-1c1a40bd1754","Type":"ContainerStarted","Data":"7076afba7eabb6c53f2d5f663c17a71957650f2ef4d84cdb5e42121fb49077a1"} Oct 30 20:09:26.704195 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:09:26.704153 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:09:26.835783 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:26.835750 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8"] Oct 30 20:09:26.839553 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:26.839530 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:26.844444 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:26.844409 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Oct 30 20:09:26.844581 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:26.844524 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zcb7t\"" Oct 30 20:09:26.844581 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:26.844556 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Oct 30 20:09:26.844702 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:26.844578 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Oct 30 20:09:26.846191 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:26.846174 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Oct 30 20:09:26.853853 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:26.853830 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8"] Oct 30 20:09:26.955799 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:26.955701 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/15c572a7-5647-49de-831b-7039591e241a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-dtrk8\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:26.955799 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:26.955749 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncg7m\" (UniqueName: \"kubernetes.io/projected/15c572a7-5647-49de-831b-7039591e241a-kube-api-access-ncg7m\") pod \"istiod-openshift-gateway-7876bfcb74-dtrk8\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:26.956011 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:26.955861 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15c572a7-5647-49de-831b-7039591e241a-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-dtrk8\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:26.956011 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:26.955910 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/15c572a7-5647-49de-831b-7039591e241a-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-dtrk8\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:26.956011 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:26.955930 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/15c572a7-5647-49de-831b-7039591e241a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-dtrk8\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:26.956011 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:26.955996 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/15c572a7-5647-49de-831b-7039591e241a-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-dtrk8\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:26.956173 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:26.956026 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/15c572a7-5647-49de-831b-7039591e241a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-dtrk8\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:27.056764 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:27.056728 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/15c572a7-5647-49de-831b-7039591e241a-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-dtrk8\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:27.056764 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:27.056771 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/15c572a7-5647-49de-831b-7039591e241a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-dtrk8\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:27.057025 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:27.056795 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/15c572a7-5647-49de-831b-7039591e241a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-dtrk8\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:27.057025 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:27.056815 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncg7m\" (UniqueName: \"kubernetes.io/projected/15c572a7-5647-49de-831b-7039591e241a-kube-api-access-ncg7m\") pod \"istiod-openshift-gateway-7876bfcb74-dtrk8\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:27.057025 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:27.056963 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15c572a7-5647-49de-831b-7039591e241a-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-dtrk8\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:27.057025 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:27.057000 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/15c572a7-5647-49de-831b-7039591e241a-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-dtrk8\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:27.057025 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:27.057024 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/15c572a7-5647-49de-831b-7039591e241a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-dtrk8\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:27.058021 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:27.057990 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/15c572a7-5647-49de-831b-7039591e241a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-dtrk8\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:27.059725 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:27.059360 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/15c572a7-5647-49de-831b-7039591e241a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-dtrk8\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:27.059725 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:27.059712 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/15c572a7-5647-49de-831b-7039591e241a-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-dtrk8\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:27.060405 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:27.059797 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/15c572a7-5647-49de-831b-7039591e241a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-dtrk8\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:27.060405 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:27.060044 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/15c572a7-5647-49de-831b-7039591e241a-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-dtrk8\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:27.079708 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:27.079677 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15c572a7-5647-49de-831b-7039591e241a-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-dtrk8\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:27.079855 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:27.079837 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncg7m\" (UniqueName: \"kubernetes.io/projected/15c572a7-5647-49de-831b-7039591e241a-kube-api-access-ncg7m\") pod \"istiod-openshift-gateway-7876bfcb74-dtrk8\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:27.154602 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:27.154566 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:27.449068 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:27.449039 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8"] Oct 30 20:09:27.451828 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:09:27.451798 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c572a7_5647_49de_831b_7039591e241a.slice/crio-98ee0836418af158a42dca39fb5a5270a0087385ed1d83067d6778c307d8d4cc WatchSource:0}: Error finding container 98ee0836418af158a42dca39fb5a5270a0087385ed1d83067d6778c307d8d4cc: Status 404 returned error can't find the container with id 98ee0836418af158a42dca39fb5a5270a0087385ed1d83067d6778c307d8d4cc Oct 30 20:09:28.285415 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:28.285377 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" event={"ID":"15c572a7-5647-49de-831b-7039591e241a","Type":"ContainerStarted","Data":"98ee0836418af158a42dca39fb5a5270a0087385ed1d83067d6778c307d8d4cc"} Oct 30 20:09:28.286801 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:28.286768 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d477969dd-cchjb" event={"ID":"7d85401f-0ca6-4d63-a134-1c1a40bd1754","Type":"ContainerStarted","Data":"10aa1b220f09e4d90af8c9fe97243402630e3891d84717b6d816f2743ae16f5a"} Oct 30 20:09:28.306247 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:28.306183 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-d477969dd-cchjb" podStartSLOduration=0.948585804 podStartE2EDuration="3.306163537s" totalImagesPullingTime="2.357577733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:09:28.305678528 +0000 UTC m=+342.838951126" watchObservedRunningTime="2026-10-30 20:09:28.306163537 +0000 UTC m=+342.839436132" Oct 30 20:09:30.107600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:30.107565 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:09:30.108013 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:30.107640 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:09:30.297853 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:30.297818 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" event={"ID":"15c572a7-5647-49de-831b-7039591e241a","Type":"ContainerStarted","Data":"f8b7273e3abaa8af12999686eed8650e78c8f690c9fb4bdf462e0793dcdca2a7"} Oct 30 20:09:30.298010 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:30.297950 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:30.323879 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:30.323829 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" podStartSLOduration=1.671305526 podStartE2EDuration="4.323816243s" totalImagesPullingTime="2.652510717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:09:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:09:30.322441943 +0000 UTC m=+344.855714538" watchObservedRunningTime="2026-10-30 20:09:30.323816243 +0000 UTC m=+344.857088837" Oct 30 20:09:31.304779 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:31.304740 5078 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-dtrk8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 20:09:31.305169 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:31.304807 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" podUID="15c572a7-5647-49de-831b-7039591e241a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 20:09:31.817888 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:31.817850 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7"] Oct 30 20:09:31.822133 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:31.822106 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:31.828078 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:31.828058 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wfph8\"" Oct 30 20:09:31.844047 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:31.844016 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7"] Oct 30 20:09:32.002959 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.002923 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f5345fa-631a-402f-9cca-7e7cc832283f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.002959 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.002963 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f5345fa-631a-402f-9cca-7e7cc832283f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.003201 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.003002 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phq5c\" (UniqueName: \"kubernetes.io/projected/7f5345fa-631a-402f-9cca-7e7cc832283f-kube-api-access-phq5c\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.003201 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.003141 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f5345fa-631a-402f-9cca-7e7cc832283f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.003201 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.003185 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f5345fa-631a-402f-9cca-7e7cc832283f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.003322 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.003214 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f5345fa-631a-402f-9cca-7e7cc832283f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.003322 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.003245 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5345fa-631a-402f-9cca-7e7cc832283f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.003322 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.003278 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f5345fa-631a-402f-9cca-7e7cc832283f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.003439 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.003359 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5345fa-631a-402f-9cca-7e7cc832283f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.104473 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.104358 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f5345fa-631a-402f-9cca-7e7cc832283f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.104473 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.104450 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5345fa-631a-402f-9cca-7e7cc832283f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.104721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.104483 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f5345fa-631a-402f-9cca-7e7cc832283f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.104721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.104517 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5345fa-631a-402f-9cca-7e7cc832283f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.104721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.104546 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f5345fa-631a-402f-9cca-7e7cc832283f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.104721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.104586 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f5345fa-631a-402f-9cca-7e7cc832283f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.104721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.104648 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phq5c\" (UniqueName: \"kubernetes.io/projected/7f5345fa-631a-402f-9cca-7e7cc832283f-kube-api-access-phq5c\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.104967 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.104731 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f5345fa-631a-402f-9cca-7e7cc832283f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.104967 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.104763 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f5345fa-631a-402f-9cca-7e7cc832283f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.104967 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.104796 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f5345fa-631a-402f-9cca-7e7cc832283f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.104967 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.104868 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5345fa-631a-402f-9cca-7e7cc832283f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.105251 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.105224 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f5345fa-631a-402f-9cca-7e7cc832283f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.105405 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.105304 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f5345fa-631a-402f-9cca-7e7cc832283f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.105405 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.105314 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5345fa-631a-402f-9cca-7e7cc832283f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.107079 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.107054 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f5345fa-631a-402f-9cca-7e7cc832283f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.107206 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.107186 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f5345fa-631a-402f-9cca-7e7cc832283f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.118035 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.117978 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f5345fa-631a-402f-9cca-7e7cc832283f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.118188 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.118150 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phq5c\" (UniqueName: \"kubernetes.io/projected/7f5345fa-631a-402f-9cca-7e7cc832283f-kube-api-access-phq5c\") pod \"data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7\" (UID: \"7f5345fa-631a-402f-9cca-7e7cc832283f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.134918 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.134879 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:32.420543 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:32.420514 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7"] Oct 30 20:09:32.422884 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:09:32.422856 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5345fa_631a_402f_9cca_7e7cc832283f.slice/crio-1d5403605b10927c92fee7c48fb5fa946e9e554a07edc1da7499bcff7dac214e WatchSource:0}: Error finding container 1d5403605b10927c92fee7c48fb5fa946e9e554a07edc1da7499bcff7dac214e: Status 404 returned error can't find the container with id 1d5403605b10927c92fee7c48fb5fa946e9e554a07edc1da7499bcff7dac214e Oct 30 20:09:33.313373 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:33.313319 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" event={"ID":"7f5345fa-631a-402f-9cca-7e7cc832283f","Type":"ContainerStarted","Data":"1d5403605b10927c92fee7c48fb5fa946e9e554a07edc1da7499bcff7dac214e"} Oct 30 20:09:34.304607 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:34.304563 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:09:35.757239 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:35.757208 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:09:35.757525 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:35.757277 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:09:35.757525 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:35.757307 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:09:36.329879 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:36.329841 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" event={"ID":"7f5345fa-631a-402f-9cca-7e7cc832283f","Type":"ContainerStarted","Data":"f9fbf90d41539f974439735ca03b27c8ce53857baccd7d345bb8bd43786422d9"} Oct 30 20:09:36.357091 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:36.357036 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" podStartSLOduration=2.025564499 podStartE2EDuration="5.357020019s" totalImagesPullingTime="3.33145552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:09:36.35528722 +0000 UTC m=+350.888559814" watchObservedRunningTime="2026-10-30 20:09:36.357020019 +0000 UTC m=+350.890292612" Oct 30 20:09:37.135165 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:37.135121 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:37.140096 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:37.140067 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:37.333970 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:37.333931 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:37.334953 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:09:37.334931 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7" Oct 30 20:09:56.698808 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:09:56.698768 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:10:13.231243 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.231198 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-64vpw"] Oct 30 20:10:13.235152 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.235125 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-64vpw" Oct 30 20:10:13.248347 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.248264 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-64vpw"] Oct 30 20:10:13.273568 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.273537 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-vgl8x"] Oct 30 20:10:13.277141 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.277117 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-vgl8x" Oct 30 20:10:13.277572 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.277549 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-jjsl7\"" Oct 30 20:10:13.277689 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.277654 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Oct 30 20:10:13.288099 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.288067 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-vgl8x"] Oct 30 20:10:13.293083 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.293052 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Oct 30 20:10:13.293269 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.293169 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-hgzg2\"" Oct 30 20:10:13.296678 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.296649 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-f87fcf56c-kdkbm"] Oct 30 20:10:13.300087 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.300063 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-f87fcf56c-kdkbm" Oct 30 20:10:13.315441 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.315408 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-f87fcf56c-kdkbm"] Oct 30 20:10:13.338045 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.338013 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc8kn\" (UniqueName: \"kubernetes.io/projected/8fa2c3f1-8034-452b-9d06-fa6e84573c05-kube-api-access-fc8kn\") pod \"kserve-controller-manager-776cc66d47-64vpw\" (UID: \"8fa2c3f1-8034-452b-9d06-fa6e84573c05\") " pod="opendatahub/kserve-controller-manager-776cc66d47-64vpw" Oct 30 20:10:13.338045 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.338056 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl5fz\" (UniqueName: \"kubernetes.io/projected/0539e8ae-dc5f-4ed9-8f34-0c0a928b7409-kube-api-access-dl5fz\") pod \"model-serving-api-75bd89fdfc-vgl8x\" (UID: \"0539e8ae-dc5f-4ed9-8f34-0c0a928b7409\") " pod="opendatahub/model-serving-api-75bd89fdfc-vgl8x" Oct 30 20:10:13.338296 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.338178 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8fa2c3f1-8034-452b-9d06-fa6e84573c05-cert\") pod \"kserve-controller-manager-776cc66d47-64vpw\" (UID: \"8fa2c3f1-8034-452b-9d06-fa6e84573c05\") " pod="opendatahub/kserve-controller-manager-776cc66d47-64vpw" Oct 30 20:10:13.338381 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.338291 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ae3de76-2d1f-413a-a07a-46f367221dcf-metrics-certs\") pod \"odh-model-controller-f87fcf56c-kdkbm\" (UID: \"3ae3de76-2d1f-413a-a07a-46f367221dcf\") " pod="opendatahub/odh-model-controller-f87fcf56c-kdkbm" Oct 30 20:10:13.338381 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.338367 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0539e8ae-dc5f-4ed9-8f34-0c0a928b7409-tls-certs\") pod \"model-serving-api-75bd89fdfc-vgl8x\" (UID: \"0539e8ae-dc5f-4ed9-8f34-0c0a928b7409\") " pod="opendatahub/model-serving-api-75bd89fdfc-vgl8x" Oct 30 20:10:13.338491 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.338409 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nbgw\" (UniqueName: \"kubernetes.io/projected/3ae3de76-2d1f-413a-a07a-46f367221dcf-kube-api-access-2nbgw\") pod \"odh-model-controller-f87fcf56c-kdkbm\" (UID: \"3ae3de76-2d1f-413a-a07a-46f367221dcf\") " pod="opendatahub/odh-model-controller-f87fcf56c-kdkbm" Oct 30 20:10:13.338491 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.338440 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ae3de76-2d1f-413a-a07a-46f367221dcf-cert\") pod \"odh-model-controller-f87fcf56c-kdkbm\" (UID: \"3ae3de76-2d1f-413a-a07a-46f367221dcf\") " pod="opendatahub/odh-model-controller-f87fcf56c-kdkbm" Oct 30 20:10:13.376070 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.376040 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Oct 30 20:10:13.376070 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.376049 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lbkx4\"" Oct 30 20:10:13.376288 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.376049 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\"" Oct 30 20:10:13.439893 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.439854 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl5fz\" (UniqueName: \"kubernetes.io/projected/0539e8ae-dc5f-4ed9-8f34-0c0a928b7409-kube-api-access-dl5fz\") pod \"model-serving-api-75bd89fdfc-vgl8x\" (UID: \"0539e8ae-dc5f-4ed9-8f34-0c0a928b7409\") " pod="opendatahub/model-serving-api-75bd89fdfc-vgl8x" Oct 30 20:10:13.440115 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.439913 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8fa2c3f1-8034-452b-9d06-fa6e84573c05-cert\") pod \"kserve-controller-manager-776cc66d47-64vpw\" (UID: \"8fa2c3f1-8034-452b-9d06-fa6e84573c05\") " pod="opendatahub/kserve-controller-manager-776cc66d47-64vpw" Oct 30 20:10:13.440115 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.439960 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ae3de76-2d1f-413a-a07a-46f367221dcf-metrics-certs\") pod \"odh-model-controller-f87fcf56c-kdkbm\" (UID: \"3ae3de76-2d1f-413a-a07a-46f367221dcf\") " pod="opendatahub/odh-model-controller-f87fcf56c-kdkbm" Oct 30 20:10:13.440115 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.440005 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0539e8ae-dc5f-4ed9-8f34-0c0a928b7409-tls-certs\") pod \"model-serving-api-75bd89fdfc-vgl8x\" (UID: \"0539e8ae-dc5f-4ed9-8f34-0c0a928b7409\") " pod="opendatahub/model-serving-api-75bd89fdfc-vgl8x" Oct 30 20:10:13.440115 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.440036 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nbgw\" (UniqueName: \"kubernetes.io/projected/3ae3de76-2d1f-413a-a07a-46f367221dcf-kube-api-access-2nbgw\") pod \"odh-model-controller-f87fcf56c-kdkbm\" (UID: \"3ae3de76-2d1f-413a-a07a-46f367221dcf\") " pod="opendatahub/odh-model-controller-f87fcf56c-kdkbm" Oct 30 20:10:13.440115 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.440063 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ae3de76-2d1f-413a-a07a-46f367221dcf-cert\") pod \"odh-model-controller-f87fcf56c-kdkbm\" (UID: \"3ae3de76-2d1f-413a-a07a-46f367221dcf\") " pod="opendatahub/odh-model-controller-f87fcf56c-kdkbm" Oct 30 20:10:13.440399 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.440121 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc8kn\" (UniqueName: \"kubernetes.io/projected/8fa2c3f1-8034-452b-9d06-fa6e84573c05-kube-api-access-fc8kn\") pod \"kserve-controller-manager-776cc66d47-64vpw\" (UID: \"8fa2c3f1-8034-452b-9d06-fa6e84573c05\") " pod="opendatahub/kserve-controller-manager-776cc66d47-64vpw" Oct 30 20:10:13.442683 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.442652 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8fa2c3f1-8034-452b-9d06-fa6e84573c05-cert\") pod \"kserve-controller-manager-776cc66d47-64vpw\" (UID: \"8fa2c3f1-8034-452b-9d06-fa6e84573c05\") " pod="opendatahub/kserve-controller-manager-776cc66d47-64vpw" Oct 30 20:10:13.442829 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.442780 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ae3de76-2d1f-413a-a07a-46f367221dcf-cert\") pod \"odh-model-controller-f87fcf56c-kdkbm\" (UID: \"3ae3de76-2d1f-413a-a07a-46f367221dcf\") " pod="opendatahub/odh-model-controller-f87fcf56c-kdkbm" Oct 30 20:10:13.442897 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.442869 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0539e8ae-dc5f-4ed9-8f34-0c0a928b7409-tls-certs\") pod \"model-serving-api-75bd89fdfc-vgl8x\" (UID: \"0539e8ae-dc5f-4ed9-8f34-0c0a928b7409\") " pod="opendatahub/model-serving-api-75bd89fdfc-vgl8x" Oct 30 20:10:13.442958 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.442874 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ae3de76-2d1f-413a-a07a-46f367221dcf-metrics-certs\") pod \"odh-model-controller-f87fcf56c-kdkbm\" (UID: \"3ae3de76-2d1f-413a-a07a-46f367221dcf\") " pod="opendatahub/odh-model-controller-f87fcf56c-kdkbm" Oct 30 20:10:13.454198 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.454162 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc8kn\" (UniqueName: \"kubernetes.io/projected/8fa2c3f1-8034-452b-9d06-fa6e84573c05-kube-api-access-fc8kn\") pod \"kserve-controller-manager-776cc66d47-64vpw\" (UID: \"8fa2c3f1-8034-452b-9d06-fa6e84573c05\") " pod="opendatahub/kserve-controller-manager-776cc66d47-64vpw" Oct 30 20:10:13.454415 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.454258 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl5fz\" (UniqueName: \"kubernetes.io/projected/0539e8ae-dc5f-4ed9-8f34-0c0a928b7409-kube-api-access-dl5fz\") pod \"model-serving-api-75bd89fdfc-vgl8x\" (UID: \"0539e8ae-dc5f-4ed9-8f34-0c0a928b7409\") " pod="opendatahub/model-serving-api-75bd89fdfc-vgl8x" Oct 30 20:10:13.454565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.454547 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nbgw\" (UniqueName: \"kubernetes.io/projected/3ae3de76-2d1f-413a-a07a-46f367221dcf-kube-api-access-2nbgw\") pod \"odh-model-controller-f87fcf56c-kdkbm\" (UID: \"3ae3de76-2d1f-413a-a07a-46f367221dcf\") " pod="opendatahub/odh-model-controller-f87fcf56c-kdkbm" Oct 30 20:10:13.550513 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.550418 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-64vpw" Oct 30 20:10:13.592260 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.592226 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-vgl8x" Oct 30 20:10:13.616132 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.615827 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-f87fcf56c-kdkbm" Oct 30 20:10:13.782431 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.782394 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p"] Oct 30 20:10:13.786033 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.786011 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:13.801390 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.801310 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p"] Oct 30 20:10:13.830865 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.830835 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-64vpw"] Oct 30 20:10:13.833986 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:10:13.833945 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa2c3f1_8034_452b_9d06_fa6e84573c05.slice/crio-e31361c45a53feb2a0d4350b9a59c5dfdb6902b32a2b89736577a2a66b502a85 WatchSource:0}: Error finding container e31361c45a53feb2a0d4350b9a59c5dfdb6902b32a2b89736577a2a66b502a85: Status 404 returned error can't find the container with id e31361c45a53feb2a0d4350b9a59c5dfdb6902b32a2b89736577a2a66b502a85 Oct 30 20:10:13.844694 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.844663 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/465367da-f578-4099-9ce5-0fb854fb2482-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-rzs4p\" (UID: \"465367da-f578-4099-9ce5-0fb854fb2482\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:13.844833 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.844700 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/465367da-f578-4099-9ce5-0fb854fb2482-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-rzs4p\" (UID: \"465367da-f578-4099-9ce5-0fb854fb2482\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:13.844833 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.844726 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/465367da-f578-4099-9ce5-0fb854fb2482-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-rzs4p\" (UID: \"465367da-f578-4099-9ce5-0fb854fb2482\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:13.844833 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.844802 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkm8r\" (UniqueName: \"kubernetes.io/projected/465367da-f578-4099-9ce5-0fb854fb2482-kube-api-access-xkm8r\") pod \"istiod-openshift-gateway-7ddd9cfdc8-rzs4p\" (UID: \"465367da-f578-4099-9ce5-0fb854fb2482\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:13.844951 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.844853 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/465367da-f578-4099-9ce5-0fb854fb2482-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-rzs4p\" (UID: \"465367da-f578-4099-9ce5-0fb854fb2482\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:13.844951 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.844883 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/465367da-f578-4099-9ce5-0fb854fb2482-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-rzs4p\" (UID: \"465367da-f578-4099-9ce5-0fb854fb2482\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:13.844951 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.844934 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/465367da-f578-4099-9ce5-0fb854fb2482-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-rzs4p\" (UID: \"465367da-f578-4099-9ce5-0fb854fb2482\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:13.881854 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.881818 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-vgl8x"] Oct 30 20:10:13.884861 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:10:13.884834 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0539e8ae_dc5f_4ed9_8f34_0c0a928b7409.slice/crio-293d4a6fc99ff535d9c0c16d445bd28ec1e673b1897064544491544e46f753b4 WatchSource:0}: Error finding container 293d4a6fc99ff535d9c0c16d445bd28ec1e673b1897064544491544e46f753b4: Status 404 returned error can't find the container with id 293d4a6fc99ff535d9c0c16d445bd28ec1e673b1897064544491544e46f753b4 Oct 30 20:10:13.904230 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.904194 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-f87fcf56c-kdkbm"] Oct 30 20:10:13.908060 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:10:13.908028 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae3de76_2d1f_413a_a07a_46f367221dcf.slice/crio-c4e6928fabb8b73a8072feff2ce8ddc54a42abe1e4baa6f8b643b516a5f6a3c7 WatchSource:0}: Error finding container c4e6928fabb8b73a8072feff2ce8ddc54a42abe1e4baa6f8b643b516a5f6a3c7: Status 404 returned error can't find the container with id c4e6928fabb8b73a8072feff2ce8ddc54a42abe1e4baa6f8b643b516a5f6a3c7 Oct 30 20:10:13.945789 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.945752 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/465367da-f578-4099-9ce5-0fb854fb2482-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-rzs4p\" (UID: \"465367da-f578-4099-9ce5-0fb854fb2482\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:13.945789 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.945791 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/465367da-f578-4099-9ce5-0fb854fb2482-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-rzs4p\" (UID: \"465367da-f578-4099-9ce5-0fb854fb2482\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:13.946049 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.945818 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/465367da-f578-4099-9ce5-0fb854fb2482-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-rzs4p\" (UID: \"465367da-f578-4099-9ce5-0fb854fb2482\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:13.946049 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.945838 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkm8r\" (UniqueName: \"kubernetes.io/projected/465367da-f578-4099-9ce5-0fb854fb2482-kube-api-access-xkm8r\") pod \"istiod-openshift-gateway-7ddd9cfdc8-rzs4p\" (UID: \"465367da-f578-4099-9ce5-0fb854fb2482\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:13.946049 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.945877 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/465367da-f578-4099-9ce5-0fb854fb2482-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-rzs4p\" (UID: \"465367da-f578-4099-9ce5-0fb854fb2482\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:13.946049 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.945901 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/465367da-f578-4099-9ce5-0fb854fb2482-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-rzs4p\" (UID: \"465367da-f578-4099-9ce5-0fb854fb2482\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:13.946049 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.945926 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/465367da-f578-4099-9ce5-0fb854fb2482-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-rzs4p\" (UID: \"465367da-f578-4099-9ce5-0fb854fb2482\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:13.946698 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.946666 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/465367da-f578-4099-9ce5-0fb854fb2482-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-rzs4p\" (UID: \"465367da-f578-4099-9ce5-0fb854fb2482\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:13.948353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.948312 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/465367da-f578-4099-9ce5-0fb854fb2482-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-rzs4p\" (UID: \"465367da-f578-4099-9ce5-0fb854fb2482\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:13.948475 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.948365 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/465367da-f578-4099-9ce5-0fb854fb2482-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-rzs4p\" (UID: \"465367da-f578-4099-9ce5-0fb854fb2482\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:13.948582 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.948562 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/465367da-f578-4099-9ce5-0fb854fb2482-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-rzs4p\" (UID: \"465367da-f578-4099-9ce5-0fb854fb2482\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:13.948685 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.948667 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/465367da-f578-4099-9ce5-0fb854fb2482-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-rzs4p\" (UID: \"465367da-f578-4099-9ce5-0fb854fb2482\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:13.961948 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.961911 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkm8r\" (UniqueName: \"kubernetes.io/projected/465367da-f578-4099-9ce5-0fb854fb2482-kube-api-access-xkm8r\") pod \"istiod-openshift-gateway-7ddd9cfdc8-rzs4p\" (UID: \"465367da-f578-4099-9ce5-0fb854fb2482\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:13.962798 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:13.962777 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/465367da-f578-4099-9ce5-0fb854fb2482-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-rzs4p\" (UID: \"465367da-f578-4099-9ce5-0fb854fb2482\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:14.098614 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:14.098578 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:14.381258 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:14.381166 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p"] Oct 30 20:10:14.384584 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:10:14.384543 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod465367da_f578_4099_9ce5_0fb854fb2482.slice/crio-97550afc0410162f044b829011d9a781cbc76632ea65172e736461a6cf4d1a8b WatchSource:0}: Error finding container 97550afc0410162f044b829011d9a781cbc76632ea65172e736461a6cf4d1a8b: Status 404 returned error can't find the container with id 97550afc0410162f044b829011d9a781cbc76632ea65172e736461a6cf4d1a8b Oct 30 20:10:14.386895 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:14.386856 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:10:14.387013 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:14.386936 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:10:14.508581 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:14.508546 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-64vpw" event={"ID":"8fa2c3f1-8034-452b-9d06-fa6e84573c05","Type":"ContainerStarted","Data":"e31361c45a53feb2a0d4350b9a59c5dfdb6902b32a2b89736577a2a66b502a85"} Oct 30 20:10:14.510440 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:14.510406 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" event={"ID":"465367da-f578-4099-9ce5-0fb854fb2482","Type":"ContainerStarted","Data":"aa34aca725afca854539c2035fa4fb481afb579be07034ca6dd3c413247016b0"} Oct 30 20:10:14.510573 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:14.510459 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" event={"ID":"465367da-f578-4099-9ce5-0fb854fb2482","Type":"ContainerStarted","Data":"97550afc0410162f044b829011d9a781cbc76632ea65172e736461a6cf4d1a8b"} Oct 30 20:10:14.511159 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:14.511143 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:14.513080 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:14.513051 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-vgl8x" event={"ID":"0539e8ae-dc5f-4ed9-8f34-0c0a928b7409","Type":"ContainerStarted","Data":"293d4a6fc99ff535d9c0c16d445bd28ec1e673b1897064544491544e46f753b4"} Oct 30 20:10:14.515210 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:14.515139 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-f87fcf56c-kdkbm" event={"ID":"3ae3de76-2d1f-413a-a07a-46f367221dcf","Type":"ContainerStarted","Data":"c4e6928fabb8b73a8072feff2ce8ddc54a42abe1e4baa6f8b643b516a5f6a3c7"} Oct 30 20:10:15.528006 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:15.527692 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" Oct 30 20:10:15.556796 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:15.555472 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rzs4p" podStartSLOduration=2.555451358 podStartE2EDuration="2.555451358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:10:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:10:14.552103491 +0000 UTC m=+389.085376085" watchObservedRunningTime="2026-10-30 20:10:15.555451358 +0000 UTC m=+390.088723955" Oct 30 20:10:15.593360 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:15.593298 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8"] Oct 30 20:10:15.593569 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:15.593536 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" podUID="15c572a7-5647-49de-831b-7039591e241a" containerName="discovery" containerID="cri-o://f8b7273e3abaa8af12999686eed8650e78c8f690c9fb4bdf462e0793dcdca2a7" gracePeriod=30 Oct 30 20:10:15.911199 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:15.910899 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:10:15.975730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:15.975692 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/15c572a7-5647-49de-831b-7039591e241a-kube-api-access-ncg7m\" (UniqueName: \"kubernetes.io/projected/15c572a7-5647-49de-831b-7039591e241a-kube-api-access-ncg7m\") pod \"15c572a7-5647-49de-831b-7039591e241a\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " Oct 30 20:10:15.975921 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:15.975748 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/15c572a7-5647-49de-831b-7039591e241a-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/15c572a7-5647-49de-831b-7039591e241a-istio-kubeconfig\") pod \"15c572a7-5647-49de-831b-7039591e241a\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " Oct 30 20:10:15.975921 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:15.975851 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15c572a7-5647-49de-831b-7039591e241a-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/15c572a7-5647-49de-831b-7039591e241a-local-certs\") pod \"15c572a7-5647-49de-831b-7039591e241a\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " Oct 30 20:10:15.975921 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:15.975907 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/15c572a7-5647-49de-831b-7039591e241a-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/15c572a7-5647-49de-831b-7039591e241a-istio-csr-dns-cert\") pod \"15c572a7-5647-49de-831b-7039591e241a\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " Oct 30 20:10:15.976094 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:15.975943 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/15c572a7-5647-49de-831b-7039591e241a-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/15c572a7-5647-49de-831b-7039591e241a-istio-csr-ca-configmap\") pod \"15c572a7-5647-49de-831b-7039591e241a\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " Oct 30 20:10:15.976094 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:15.975973 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/15c572a7-5647-49de-831b-7039591e241a-cacerts\" (UniqueName: \"kubernetes.io/secret/15c572a7-5647-49de-831b-7039591e241a-cacerts\") pod \"15c572a7-5647-49de-831b-7039591e241a\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " Oct 30 20:10:15.976094 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:15.976039 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/15c572a7-5647-49de-831b-7039591e241a-istio-token\" (UniqueName: \"kubernetes.io/projected/15c572a7-5647-49de-831b-7039591e241a-istio-token\") pod \"15c572a7-5647-49de-831b-7039591e241a\" (UID: \"15c572a7-5647-49de-831b-7039591e241a\") " Oct 30 20:10:15.977692 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:15.977637 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15c572a7-5647-49de-831b-7039591e241a-istio-csr-ca-configmap" pod "15c572a7-5647-49de-831b-7039591e241a" (UID: "15c572a7-5647-49de-831b-7039591e241a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:10:15.982840 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:15.982805 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15c572a7-5647-49de-831b-7039591e241a-kube-api-access-ncg7m" pod "15c572a7-5647-49de-831b-7039591e241a" (UID: "15c572a7-5647-49de-831b-7039591e241a"). InnerVolumeSpecName "kube-api-access-ncg7m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:10:15.987428 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:15.987387 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15c572a7-5647-49de-831b-7039591e241a-istio-csr-dns-cert" pod "15c572a7-5647-49de-831b-7039591e241a" (UID: "15c572a7-5647-49de-831b-7039591e241a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:10:15.987544 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:15.987468 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15c572a7-5647-49de-831b-7039591e241a-local-certs" pod "15c572a7-5647-49de-831b-7039591e241a" (UID: "15c572a7-5647-49de-831b-7039591e241a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:10:15.987714 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:15.987699 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15c572a7-5647-49de-831b-7039591e241a-istio-token" pod "15c572a7-5647-49de-831b-7039591e241a" (UID: "15c572a7-5647-49de-831b-7039591e241a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:10:15.988743 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:15.988713 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15c572a7-5647-49de-831b-7039591e241a-istio-kubeconfig" pod "15c572a7-5647-49de-831b-7039591e241a" (UID: "15c572a7-5647-49de-831b-7039591e241a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:10:15.991319 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:15.991291 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15c572a7-5647-49de-831b-7039591e241a-cacerts" pod "15c572a7-5647-49de-831b-7039591e241a" (UID: "15c572a7-5647-49de-831b-7039591e241a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:10:16.077800 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:16.077762 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15c572a7-5647-49de-831b-7039591e241a-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:10:16.077800 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:16.077800 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncg7m\" (UniqueName: \"kubernetes.io/projected/15c572a7-5647-49de-831b-7039591e241a-kube-api-access-ncg7m\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:10:16.078074 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:16.077814 5078 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/15c572a7-5647-49de-831b-7039591e241a-istio-kubeconfig\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:10:16.078074 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:16.077829 5078 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/15c572a7-5647-49de-831b-7039591e241a-local-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:10:16.078074 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:16.077843 5078 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/15c572a7-5647-49de-831b-7039591e241a-istio-csr-dns-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:10:16.078074 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:16.077854 5078 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/15c572a7-5647-49de-831b-7039591e241a-istio-csr-ca-configmap\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:10:16.078074 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:16.077865 5078 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/15c572a7-5647-49de-831b-7039591e241a-cacerts\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:10:16.532561 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:16.532525 5078 generic.go:356] "Generic (PLEG): container finished" podID="15c572a7-5647-49de-831b-7039591e241a" containerID="f8b7273e3abaa8af12999686eed8650e78c8f690c9fb4bdf462e0793dcdca2a7" exitCode=0 Oct 30 20:10:16.533104 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:16.532596 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" Oct 30 20:10:16.533104 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:16.532660 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" event={"ID":"15c572a7-5647-49de-831b-7039591e241a","Type":"ContainerDied","Data":"f8b7273e3abaa8af12999686eed8650e78c8f690c9fb4bdf462e0793dcdca2a7"} Oct 30 20:10:16.533104 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:16.532713 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8" event={"ID":"15c572a7-5647-49de-831b-7039591e241a","Type":"ContainerDied","Data":"98ee0836418af158a42dca39fb5a5270a0087385ed1d83067d6778c307d8d4cc"} Oct 30 20:10:16.533104 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:16.532748 5078 scope.go:122] "RemoveContainer" containerID="f8b7273e3abaa8af12999686eed8650e78c8f690c9fb4bdf462e0793dcdca2a7" Oct 30 20:10:16.550633 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:16.550506 5078 scope.go:122] "RemoveContainer" containerID="f8b7273e3abaa8af12999686eed8650e78c8f690c9fb4bdf462e0793dcdca2a7" Oct 30 20:10:16.550961 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:10:16.550886 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8b7273e3abaa8af12999686eed8650e78c8f690c9fb4bdf462e0793dcdca2a7\": container with ID starting with f8b7273e3abaa8af12999686eed8650e78c8f690c9fb4bdf462e0793dcdca2a7 not found: ID does not exist" containerID="f8b7273e3abaa8af12999686eed8650e78c8f690c9fb4bdf462e0793dcdca2a7" Oct 30 20:10:16.550961 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:16.550935 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8b7273e3abaa8af12999686eed8650e78c8f690c9fb4bdf462e0793dcdca2a7"} err="failed to get container status \"f8b7273e3abaa8af12999686eed8650e78c8f690c9fb4bdf462e0793dcdca2a7\": rpc error: code = NotFound desc = could not find container \"f8b7273e3abaa8af12999686eed8650e78c8f690c9fb4bdf462e0793dcdca2a7\": container with ID starting with f8b7273e3abaa8af12999686eed8650e78c8f690c9fb4bdf462e0793dcdca2a7 not found: ID does not exist" Oct 30 20:10:16.560620 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:16.560591 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8"] Oct 30 20:10:16.567198 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:16.567138 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-dtrk8"] Oct 30 20:10:17.541025 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:17.540989 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-64vpw" event={"ID":"8fa2c3f1-8034-452b-9d06-fa6e84573c05","Type":"ContainerStarted","Data":"16329d018396ac192e185741e7c00d46c40981ad2b480c1ffac99f01339e86ed"} Oct 30 20:10:17.541493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:17.541081 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-64vpw" Oct 30 20:10:17.542690 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:17.542664 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-vgl8x" event={"ID":"0539e8ae-dc5f-4ed9-8f34-0c0a928b7409","Type":"ContainerStarted","Data":"8abe1f2dc2a88ac1f7ac365c73b891f280291bf5729de549c03c93fa2e1811ea"} Oct 30 20:10:17.542830 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:17.542748 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-vgl8x" Oct 30 20:10:17.544091 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:17.544070 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-f87fcf56c-kdkbm" event={"ID":"3ae3de76-2d1f-413a-a07a-46f367221dcf","Type":"ContainerStarted","Data":"bcbc07ea9024a4d476d4f7ba8b88cc8a9ba12094cce5637794b971e80f3c2e49"} Oct 30 20:10:17.561807 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:17.561759 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-64vpw" podStartSLOduration=1.3479343639999999 podStartE2EDuration="4.561742223s" totalImagesPullingTime="3.213807859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:10:17.560698849 +0000 UTC m=+392.093971456" watchObservedRunningTime="2026-10-30 20:10:17.561742223 +0000 UTC m=+392.095014816" Oct 30 20:10:17.581248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:17.581191 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-f87fcf56c-kdkbm" podStartSLOduration=1.125301567 podStartE2EDuration="4.581178235s" totalImagesPullingTime="3.455876668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:10:17.580462117 +0000 UTC m=+392.113734711" watchObservedRunningTime="2026-10-30 20:10:17.581178235 +0000 UTC m=+392.114450829" Oct 30 20:10:17.584318 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:17.584293 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="15c572a7-5647-49de-831b-7039591e241a" path="/var/lib/kubelet/pods/15c572a7-5647-49de-831b-7039591e241a/volumes" Oct 30 20:10:17.601523 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:17.601451 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-vgl8x" podStartSLOduration=1.952453266 podStartE2EDuration="4.601429715s" totalImagesPullingTime="2.648976449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:10:17.601037872 +0000 UTC m=+392.134310464" watchObservedRunningTime="2026-10-30 20:10:17.601429715 +0000 UTC m=+392.134702312" Oct 30 20:10:18.549472 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:18.549438 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-f87fcf56c-kdkbm" Oct 30 20:10:26.698403 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:10:26.698301 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:10:28.553474 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:28.553445 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-vgl8x" Oct 30 20:10:29.557459 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:29.557426 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-f87fcf56c-kdkbm" Oct 30 20:10:48.554342 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:10:48.554298 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-64vpw" Oct 30 20:10:56.698135 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:10:56.698094 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:11:26.699171 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:11:26.699130 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:11:29.041415 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:29.041382 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d6dd76dc-jm276"] Oct 30 20:11:29.041791 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:29.041755 5078 cpu_manager.go:414] "containerMap: removing container" podUID="15c572a7-5647-49de-831b-7039591e241a" containerName="discovery" Oct 30 20:11:29.041791 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:29.041765 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="15c572a7-5647-49de-831b-7039591e241a" containerName="discovery" Oct 30 20:11:29.041861 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:29.041823 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="15c572a7-5647-49de-831b-7039591e241a" containerName="discovery" Oct 30 20:11:29.044871 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:29.044854 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d6dd76dc-jm276" Oct 30 20:11:29.058049 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:29.058025 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Oct 30 20:11:29.060833 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:29.060807 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d6dd76dc-jm276"] Oct 30 20:11:29.060939 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:29.060896 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Oct 30 20:11:29.061015 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:29.061004 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-cqpv7\"" Oct 30 20:11:29.197224 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:29.197187 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccpk2\" (UniqueName: \"kubernetes.io/projected/5b1aff91-a0ed-41ac-bab9-00877ecc6b27-kube-api-access-ccpk2\") pod \"authorino-operator-68d6dd76dc-jm276\" (UID: \"5b1aff91-a0ed-41ac-bab9-00877ecc6b27\") " pod="kuadrant-system/authorino-operator-68d6dd76dc-jm276" Oct 30 20:11:29.298433 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:29.298315 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccpk2\" (UniqueName: \"kubernetes.io/projected/5b1aff91-a0ed-41ac-bab9-00877ecc6b27-kube-api-access-ccpk2\") pod \"authorino-operator-68d6dd76dc-jm276\" (UID: \"5b1aff91-a0ed-41ac-bab9-00877ecc6b27\") " pod="kuadrant-system/authorino-operator-68d6dd76dc-jm276" Oct 30 20:11:29.315369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:29.315320 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccpk2\" (UniqueName: \"kubernetes.io/projected/5b1aff91-a0ed-41ac-bab9-00877ecc6b27-kube-api-access-ccpk2\") pod \"authorino-operator-68d6dd76dc-jm276\" (UID: \"5b1aff91-a0ed-41ac-bab9-00877ecc6b27\") " pod="kuadrant-system/authorino-operator-68d6dd76dc-jm276" Oct 30 20:11:29.357594 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:29.357551 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d6dd76dc-jm276" Oct 30 20:11:29.632929 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:29.632894 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d6dd76dc-jm276"] Oct 30 20:11:29.637087 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:11:29.637057 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b1aff91_a0ed_41ac_bab9_00877ecc6b27.slice/crio-e766b2b6d7537b04a81fb83e97255ea3bae5301552faf215c60a43ed875caea8 WatchSource:0}: Error finding container e766b2b6d7537b04a81fb83e97255ea3bae5301552faf215c60a43ed875caea8: Status 404 returned error can't find the container with id e766b2b6d7537b04a81fb83e97255ea3bae5301552faf215c60a43ed875caea8 Oct 30 20:11:29.870344 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:29.870296 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d6dd76dc-jm276" event={"ID":"5b1aff91-a0ed-41ac-bab9-00877ecc6b27","Type":"ContainerStarted","Data":"e766b2b6d7537b04a81fb83e97255ea3bae5301552faf215c60a43ed875caea8"} Oct 30 20:11:32.888153 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:32.888117 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d6dd76dc-jm276" event={"ID":"5b1aff91-a0ed-41ac-bab9-00877ecc6b27","Type":"ContainerStarted","Data":"bee3406647414a75df37fff5352b2cd9c0a6c2ca0f68ba78881da32e609070ea"} Oct 30 20:11:32.888600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:32.888260 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d6dd76dc-jm276" Oct 30 20:11:32.914069 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:32.914009 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d6dd76dc-jm276" podStartSLOduration=1.086827721 podStartE2EDuration="3.913989125s" totalImagesPullingTime="2.827161404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:11:32.911966391 +0000 UTC m=+467.445238987" watchObservedRunningTime="2026-10-30 20:11:32.913989125 +0000 UTC m=+467.447261719" Oct 30 20:11:43.895803 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:43.895770 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d6dd76dc-jm276" Oct 30 20:11:56.697126 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:11:56.697045 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:11:57.073726 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:57.073692 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-vv9zl"] Oct 30 20:11:57.077004 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:57.076987 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-vv9zl" Oct 30 20:11:57.093167 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:57.093137 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-vv9zl"] Oct 30 20:11:57.103431 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:57.103411 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-t8dtz\"" Oct 30 20:11:57.138421 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:57.138388 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95487546-b974-453e-a7a1-bfeac1ce40fb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b76784d48-vv9zl\" (UID: \"95487546-b974-453e-a7a1-bfeac1ce40fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-vv9zl" Oct 30 20:11:57.138585 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:57.138569 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqt4c\" (UniqueName: \"kubernetes.io/projected/95487546-b974-453e-a7a1-bfeac1ce40fb-kube-api-access-dqt4c\") pod \"kuadrant-operator-controller-manager-6b76784d48-vv9zl\" (UID: \"95487546-b974-453e-a7a1-bfeac1ce40fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-vv9zl" Oct 30 20:11:57.239003 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:57.238971 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95487546-b974-453e-a7a1-bfeac1ce40fb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b76784d48-vv9zl\" (UID: \"95487546-b974-453e-a7a1-bfeac1ce40fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-vv9zl" Oct 30 20:11:57.239151 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:57.239096 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqt4c\" (UniqueName: \"kubernetes.io/projected/95487546-b974-453e-a7a1-bfeac1ce40fb-kube-api-access-dqt4c\") pod \"kuadrant-operator-controller-manager-6b76784d48-vv9zl\" (UID: \"95487546-b974-453e-a7a1-bfeac1ce40fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-vv9zl" Oct 30 20:11:57.239385 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:57.239363 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95487546-b974-453e-a7a1-bfeac1ce40fb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b76784d48-vv9zl\" (UID: \"95487546-b974-453e-a7a1-bfeac1ce40fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-vv9zl" Oct 30 20:11:57.253234 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:57.253208 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqt4c\" (UniqueName: \"kubernetes.io/projected/95487546-b974-453e-a7a1-bfeac1ce40fb-kube-api-access-dqt4c\") pod \"kuadrant-operator-controller-manager-6b76784d48-vv9zl\" (UID: \"95487546-b974-453e-a7a1-bfeac1ce40fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-vv9zl" Oct 30 20:11:57.390625 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:57.390544 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-vv9zl" Oct 30 20:11:57.671474 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:57.671301 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-vv9zl"] Oct 30 20:11:57.676054 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:11:57.676024 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95487546_b974_453e_a7a1_bfeac1ce40fb.slice/crio-f104dde2154c1c74402894d97fc3cdab5a29ab3cf30b83ca9006de247ff36e7e WatchSource:0}: Error finding container f104dde2154c1c74402894d97fc3cdab5a29ab3cf30b83ca9006de247ff36e7e: Status 404 returned error can't find the container with id f104dde2154c1c74402894d97fc3cdab5a29ab3cf30b83ca9006de247ff36e7e Oct 30 20:11:58.000158 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:58.000075 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-vv9zl" event={"ID":"95487546-b974-453e-a7a1-bfeac1ce40fb","Type":"ContainerStarted","Data":"f104dde2154c1c74402894d97fc3cdab5a29ab3cf30b83ca9006de247ff36e7e"} Oct 30 20:11:59.526417 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:59.526364 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-vv9zl"] Oct 30 20:11:59.537474 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:59.537441 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-vv9zl"] Oct 30 20:11:59.551209 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:59.551176 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42"] Oct 30 20:11:59.555477 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:59.555453 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42" Oct 30 20:11:59.570877 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:59.570847 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42"] Oct 30 20:11:59.663810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:59.663776 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/231cd36f-2b0c-4c6e-850f-4d34535d1b02-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b76784d48-qtf42\" (UID: \"231cd36f-2b0c-4c6e-850f-4d34535d1b02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42" Oct 30 20:11:59.663985 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:59.663820 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8cdg\" (UniqueName: \"kubernetes.io/projected/231cd36f-2b0c-4c6e-850f-4d34535d1b02-kube-api-access-n8cdg\") pod \"kuadrant-operator-controller-manager-6b76784d48-qtf42\" (UID: \"231cd36f-2b0c-4c6e-850f-4d34535d1b02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42" Oct 30 20:11:59.765086 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:59.765044 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/231cd36f-2b0c-4c6e-850f-4d34535d1b02-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b76784d48-qtf42\" (UID: \"231cd36f-2b0c-4c6e-850f-4d34535d1b02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42" Oct 30 20:11:59.765290 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:59.765121 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8cdg\" (UniqueName: \"kubernetes.io/projected/231cd36f-2b0c-4c6e-850f-4d34535d1b02-kube-api-access-n8cdg\") pod \"kuadrant-operator-controller-manager-6b76784d48-qtf42\" (UID: \"231cd36f-2b0c-4c6e-850f-4d34535d1b02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42" Oct 30 20:11:59.765569 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:59.765541 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/231cd36f-2b0c-4c6e-850f-4d34535d1b02-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b76784d48-qtf42\" (UID: \"231cd36f-2b0c-4c6e-850f-4d34535d1b02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42" Oct 30 20:11:59.781874 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:59.781815 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8cdg\" (UniqueName: \"kubernetes.io/projected/231cd36f-2b0c-4c6e-850f-4d34535d1b02-kube-api-access-n8cdg\") pod \"kuadrant-operator-controller-manager-6b76784d48-qtf42\" (UID: \"231cd36f-2b0c-4c6e-850f-4d34535d1b02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42" Oct 30 20:11:59.875221 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:11:59.875187 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42" Oct 30 20:12:00.164965 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:00.164937 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42"] Oct 30 20:12:00.169171 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:12:00.169133 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod231cd36f_2b0c_4c6e_850f_4d34535d1b02.slice/crio-4db500eec8ac124a5bbc6f0b8fb61d0a1506a198e10a96e53a2e171b79f89a06 WatchSource:0}: Error finding container 4db500eec8ac124a5bbc6f0b8fb61d0a1506a198e10a96e53a2e171b79f89a06: Status 404 returned error can't find the container with id 4db500eec8ac124a5bbc6f0b8fb61d0a1506a198e10a96e53a2e171b79f89a06 Oct 30 20:12:01.018362 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:01.018303 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42" event={"ID":"231cd36f-2b0c-4c6e-850f-4d34535d1b02","Type":"ContainerStarted","Data":"4db500eec8ac124a5bbc6f0b8fb61d0a1506a198e10a96e53a2e171b79f89a06"} Oct 30 20:12:02.025617 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:02.025495 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-vv9zl" podUID="95487546-b974-453e-a7a1-bfeac1ce40fb" containerName="manager" containerID="cri-o://ea9e614e4ca4ae8c6e1fc5e3d49da72e798640ac12dbbd8b260902681d3cd6bb" gracePeriod=2 Oct 30 20:12:02.293902 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:02.293847 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-vv9zl" Oct 30 20:12:02.296493 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:12:02.296453 5078 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b76784d48-vv9zl\" is forbidden: User \"system:node:ip-10-0-139-217.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-217.us-east-2.compute.internal' and this object" podUID="95487546-b974-453e-a7a1-bfeac1ce40fb" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-vv9zl" Oct 30 20:12:02.390757 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:02.390717 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/95487546-b974-453e-a7a1-bfeac1ce40fb-kube-api-access-dqt4c\" (UniqueName: \"kubernetes.io/projected/95487546-b974-453e-a7a1-bfeac1ce40fb-kube-api-access-dqt4c\") pod \"95487546-b974-453e-a7a1-bfeac1ce40fb\" (UID: \"95487546-b974-453e-a7a1-bfeac1ce40fb\") " Oct 30 20:12:02.390939 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:02.390773 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/95487546-b974-453e-a7a1-bfeac1ce40fb-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95487546-b974-453e-a7a1-bfeac1ce40fb-extensions-socket-volume\") pod \"95487546-b974-453e-a7a1-bfeac1ce40fb\" (UID: \"95487546-b974-453e-a7a1-bfeac1ce40fb\") " Oct 30 20:12:02.391089 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:02.391055 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95487546-b974-453e-a7a1-bfeac1ce40fb-extensions-socket-volume" pod "95487546-b974-453e-a7a1-bfeac1ce40fb" (UID: "95487546-b974-453e-a7a1-bfeac1ce40fb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:12:02.393288 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:02.393259 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95487546-b974-453e-a7a1-bfeac1ce40fb-kube-api-access-dqt4c" pod "95487546-b974-453e-a7a1-bfeac1ce40fb" (UID: "95487546-b974-453e-a7a1-bfeac1ce40fb"). InnerVolumeSpecName "kube-api-access-dqt4c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:12:02.491918 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:02.491883 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqt4c\" (UniqueName: \"kubernetes.io/projected/95487546-b974-453e-a7a1-bfeac1ce40fb-kube-api-access-dqt4c\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:12:02.491918 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:02.491918 5078 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/95487546-b974-453e-a7a1-bfeac1ce40fb-extensions-socket-volume\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:12:03.033727 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:03.033638 5078 generic.go:356] "Generic (PLEG): container finished" podID="95487546-b974-453e-a7a1-bfeac1ce40fb" containerID="ea9e614e4ca4ae8c6e1fc5e3d49da72e798640ac12dbbd8b260902681d3cd6bb" exitCode=2 Oct 30 20:12:03.033727 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:03.033691 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-vv9zl" Oct 30 20:12:03.034272 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:03.033737 5078 scope.go:122] "RemoveContainer" containerID="ea9e614e4ca4ae8c6e1fc5e3d49da72e798640ac12dbbd8b260902681d3cd6bb" Oct 30 20:12:03.036013 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:03.035981 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42" event={"ID":"231cd36f-2b0c-4c6e-850f-4d34535d1b02","Type":"ContainerStarted","Data":"13a080f53126770a0a5a7c988ce9cd50f4fda2f699079fde8e3a43ec9cd582c0"} Oct 30 20:12:03.036148 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:03.036132 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42" Oct 30 20:12:03.036478 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:12:03.036451 5078 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b76784d48-vv9zl\" is forbidden: User \"system:node:ip-10-0-139-217.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-217.us-east-2.compute.internal' and this object" podUID="95487546-b974-453e-a7a1-bfeac1ce40fb" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-vv9zl" Oct 30 20:12:03.039043 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:12:03.039017 5078 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b76784d48-vv9zl\" is forbidden: User \"system:node:ip-10-0-139-217.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-217.us-east-2.compute.internal' and this object" podUID="95487546-b974-453e-a7a1-bfeac1ce40fb" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-vv9zl" Oct 30 20:12:03.043255 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:03.043239 5078 scope.go:122] "RemoveContainer" containerID="ea9e614e4ca4ae8c6e1fc5e3d49da72e798640ac12dbbd8b260902681d3cd6bb" Oct 30 20:12:03.043537 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:12:03.043516 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea9e614e4ca4ae8c6e1fc5e3d49da72e798640ac12dbbd8b260902681d3cd6bb\": container with ID starting with ea9e614e4ca4ae8c6e1fc5e3d49da72e798640ac12dbbd8b260902681d3cd6bb not found: ID does not exist" containerID="ea9e614e4ca4ae8c6e1fc5e3d49da72e798640ac12dbbd8b260902681d3cd6bb" Oct 30 20:12:03.043631 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:03.043544 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea9e614e4ca4ae8c6e1fc5e3d49da72e798640ac12dbbd8b260902681d3cd6bb"} err="failed to get container status \"ea9e614e4ca4ae8c6e1fc5e3d49da72e798640ac12dbbd8b260902681d3cd6bb\": rpc error: code = NotFound desc = could not find container \"ea9e614e4ca4ae8c6e1fc5e3d49da72e798640ac12dbbd8b260902681d3cd6bb\": container with ID starting with ea9e614e4ca4ae8c6e1fc5e3d49da72e798640ac12dbbd8b260902681d3cd6bb not found: ID does not exist" Oct 30 20:12:03.066953 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:03.066909 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42" podStartSLOduration=1.587640388 podStartE2EDuration="4.066899111s" totalImagesPullingTime="2.479258723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:12:03.065641661 +0000 UTC m=+497.598914255" watchObservedRunningTime="2026-10-30 20:12:03.066899111 +0000 UTC m=+497.600171704" Oct 30 20:12:03.068413 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:12:03.068379 5078 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b76784d48-vv9zl\" is forbidden: User \"system:node:ip-10-0-139-217.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-217.us-east-2.compute.internal' and this object" podUID="95487546-b974-453e-a7a1-bfeac1ce40fb" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-vv9zl" Oct 30 20:12:03.584439 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:03.584403 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="95487546-b974-453e-a7a1-bfeac1ce40fb" path="/var/lib/kubelet/pods/95487546-b974-453e-a7a1-bfeac1ce40fb/volumes" Oct 30 20:12:14.044943 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:14.044909 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42" Oct 30 20:12:26.697240 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:12:26.697200 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:12:26.956826 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:26.956719 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42"] Oct 30 20:12:26.957001 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:26.956959 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42" podUID="231cd36f-2b0c-4c6e-850f-4d34535d1b02" containerName="manager" containerID="cri-o://13a080f53126770a0a5a7c988ce9cd50f4fda2f699079fde8e3a43ec9cd582c0" gracePeriod=10 Oct 30 20:12:27.146382 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:27.146323 5078 generic.go:356] "Generic (PLEG): container finished" podID="231cd36f-2b0c-4c6e-850f-4d34535d1b02" containerID="13a080f53126770a0a5a7c988ce9cd50f4fda2f699079fde8e3a43ec9cd582c0" exitCode=0 Oct 30 20:12:27.146541 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:27.146379 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42" event={"ID":"231cd36f-2b0c-4c6e-850f-4d34535d1b02","Type":"ContainerDied","Data":"13a080f53126770a0a5a7c988ce9cd50f4fda2f699079fde8e3a43ec9cd582c0"} Oct 30 20:12:27.214621 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:27.214556 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42" Oct 30 20:12:27.305489 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:27.305456 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/231cd36f-2b0c-4c6e-850f-4d34535d1b02-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/231cd36f-2b0c-4c6e-850f-4d34535d1b02-extensions-socket-volume\") pod \"231cd36f-2b0c-4c6e-850f-4d34535d1b02\" (UID: \"231cd36f-2b0c-4c6e-850f-4d34535d1b02\") " Oct 30 20:12:27.305489 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:27.305494 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/231cd36f-2b0c-4c6e-850f-4d34535d1b02-kube-api-access-n8cdg\" (UniqueName: \"kubernetes.io/projected/231cd36f-2b0c-4c6e-850f-4d34535d1b02-kube-api-access-n8cdg\") pod \"231cd36f-2b0c-4c6e-850f-4d34535d1b02\" (UID: \"231cd36f-2b0c-4c6e-850f-4d34535d1b02\") " Oct 30 20:12:27.305935 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:27.305910 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/231cd36f-2b0c-4c6e-850f-4d34535d1b02-extensions-socket-volume" pod "231cd36f-2b0c-4c6e-850f-4d34535d1b02" (UID: "231cd36f-2b0c-4c6e-850f-4d34535d1b02"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:12:27.307678 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:27.307645 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/231cd36f-2b0c-4c6e-850f-4d34535d1b02-kube-api-access-n8cdg" pod "231cd36f-2b0c-4c6e-850f-4d34535d1b02" (UID: "231cd36f-2b0c-4c6e-850f-4d34535d1b02"). InnerVolumeSpecName "kube-api-access-n8cdg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:12:27.406549 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:27.406518 5078 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/231cd36f-2b0c-4c6e-850f-4d34535d1b02-extensions-socket-volume\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:12:27.406549 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:27.406544 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8cdg\" (UniqueName: \"kubernetes.io/projected/231cd36f-2b0c-4c6e-850f-4d34535d1b02-kube-api-access-n8cdg\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:12:28.152191 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:28.152160 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42" Oct 30 20:12:28.152696 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:28.152208 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42" event={"ID":"231cd36f-2b0c-4c6e-850f-4d34535d1b02","Type":"ContainerDied","Data":"4db500eec8ac124a5bbc6f0b8fb61d0a1506a198e10a96e53a2e171b79f89a06"} Oct 30 20:12:28.152696 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:28.152281 5078 scope.go:122] "RemoveContainer" containerID="13a080f53126770a0a5a7c988ce9cd50f4fda2f699079fde8e3a43ec9cd582c0" Oct 30 20:12:28.178150 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:28.178127 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42"] Oct 30 20:12:28.186761 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:28.186741 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-qtf42"] Oct 30 20:12:29.582868 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:29.582838 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="231cd36f-2b0c-4c6e-850f-4d34535d1b02" path="/var/lib/kubelet/pods/231cd36f-2b0c-4c6e-850f-4d34535d1b02/volumes" Oct 30 20:12:31.383696 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.383663 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5"] Oct 30 20:12:31.384074 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.384038 5078 cpu_manager.go:414] "containerMap: removing container" podUID="95487546-b974-453e-a7a1-bfeac1ce40fb" containerName="manager" Oct 30 20:12:31.384074 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.384049 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="95487546-b974-453e-a7a1-bfeac1ce40fb" containerName="manager" Oct 30 20:12:31.384074 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.384057 5078 cpu_manager.go:414] "containerMap: removing container" podUID="231cd36f-2b0c-4c6e-850f-4d34535d1b02" containerName="manager" Oct 30 20:12:31.384074 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.384062 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="231cd36f-2b0c-4c6e-850f-4d34535d1b02" containerName="manager" Oct 30 20:12:31.384463 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.384127 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="95487546-b974-453e-a7a1-bfeac1ce40fb" containerName="manager" Oct 30 20:12:31.384463 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.384136 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="231cd36f-2b0c-4c6e-850f-4d34535d1b02" containerName="manager" Oct 30 20:12:31.390733 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.390710 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.416032 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.416004 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9k4qv\"" Oct 30 20:12:31.418061 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.418038 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5"] Oct 30 20:12:31.542489 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.542458 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/626f7c24-fa80-4b57-ab5c-9739398bd547-workload-certs\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.542489 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.542492 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/626f7c24-fa80-4b57-ab5c-9739398bd547-workload-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.542736 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.542535 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/626f7c24-fa80-4b57-ab5c-9739398bd547-istio-token\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.542736 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.542674 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/626f7c24-fa80-4b57-ab5c-9739398bd547-credential-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.542736 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.542731 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/626f7c24-fa80-4b57-ab5c-9739398bd547-istio-envoy\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.542871 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.542770 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/626f7c24-fa80-4b57-ab5c-9739398bd547-istio-data\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.542871 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.542808 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bflg4\" (UniqueName: \"kubernetes.io/projected/626f7c24-fa80-4b57-ab5c-9739398bd547-kube-api-access-bflg4\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.542969 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.542863 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/626f7c24-fa80-4b57-ab5c-9739398bd547-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.542969 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.542914 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/626f7c24-fa80-4b57-ab5c-9739398bd547-istio-podinfo\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.643804 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.643718 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/626f7c24-fa80-4b57-ab5c-9739398bd547-workload-certs\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.643804 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.643757 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/626f7c24-fa80-4b57-ab5c-9739398bd547-workload-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.643804 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.643788 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/626f7c24-fa80-4b57-ab5c-9739398bd547-istio-token\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.644093 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.643834 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/626f7c24-fa80-4b57-ab5c-9739398bd547-credential-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.644093 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.643878 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/626f7c24-fa80-4b57-ab5c-9739398bd547-istio-envoy\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.644093 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.643900 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/626f7c24-fa80-4b57-ab5c-9739398bd547-istio-data\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.644093 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.643928 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bflg4\" (UniqueName: \"kubernetes.io/projected/626f7c24-fa80-4b57-ab5c-9739398bd547-kube-api-access-bflg4\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.644093 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.643951 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/626f7c24-fa80-4b57-ab5c-9739398bd547-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.644093 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.643982 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/626f7c24-fa80-4b57-ab5c-9739398bd547-istio-podinfo\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.644434 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.644165 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/626f7c24-fa80-4b57-ab5c-9739398bd547-workload-certs\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.644434 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.644232 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/626f7c24-fa80-4b57-ab5c-9739398bd547-workload-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.644434 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.644354 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/626f7c24-fa80-4b57-ab5c-9739398bd547-istio-data\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.644639 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.644610 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/626f7c24-fa80-4b57-ab5c-9739398bd547-credential-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.644763 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.644713 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/626f7c24-fa80-4b57-ab5c-9739398bd547-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.646248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.646227 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/626f7c24-fa80-4b57-ab5c-9739398bd547-istio-envoy\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.646571 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.646549 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/626f7c24-fa80-4b57-ab5c-9739398bd547-istio-podinfo\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.662719 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.662689 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bflg4\" (UniqueName: \"kubernetes.io/projected/626f7c24-fa80-4b57-ab5c-9739398bd547-kube-api-access-bflg4\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.662839 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.662745 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/626f7c24-fa80-4b57-ab5c-9739398bd547-istio-token\") pod \"maas-default-gateway-openshift-default-64d4cc998c-pzpq5\" (UID: \"626f7c24-fa80-4b57-ab5c-9739398bd547\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.704505 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.704471 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:31.992636 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.992613 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5"] Oct 30 20:12:31.995113 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:12:31.995082 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod626f7c24_fa80_4b57_ab5c_9739398bd547.slice/crio-185995eeb4b6245eab27fde432879a8de01766288667f05b8d09f2cb2b4d6162 WatchSource:0}: Error finding container 185995eeb4b6245eab27fde432879a8de01766288667f05b8d09f2cb2b4d6162: Status 404 returned error can't find the container with id 185995eeb4b6245eab27fde432879a8de01766288667f05b8d09f2cb2b4d6162 Oct 30 20:12:31.997201 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.997165 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:12:31.997272 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.997235 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:12:31.997272 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:31.997262 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:12:32.176224 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:32.176176 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" event={"ID":"626f7c24-fa80-4b57-ab5c-9739398bd547","Type":"ContainerStarted","Data":"b5e947aea28a578fbaebfdf9b117b071b55ecc7416e04a61d0a8d8f70ad014eb"} Oct 30 20:12:32.176431 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:32.176245 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" event={"ID":"626f7c24-fa80-4b57-ab5c-9739398bd547","Type":"ContainerStarted","Data":"185995eeb4b6245eab27fde432879a8de01766288667f05b8d09f2cb2b4d6162"} Oct 30 20:12:32.203622 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:32.203576 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" podStartSLOduration=1.203562854 podStartE2EDuration="1.203562854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:12:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:12:32.201789716 +0000 UTC m=+526.735062311" watchObservedRunningTime="2026-10-30 20:12:32.203562854 +0000 UTC m=+526.736835449" Oct 30 20:12:32.705418 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:32.705388 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:33.710796 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:33.710764 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:34.188230 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:34.188194 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:34.189267 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:12:34.189245 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:12:56.697708 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:12:56.697671 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:13:24.841177 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:24.841092 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-577f596567-7ttkj"] Oct 30 20:13:24.844843 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:24.844823 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-7ttkj" Oct 30 20:13:24.852861 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:24.852839 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Oct 30 20:13:24.856480 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:24.856444 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c46xw\"" Oct 30 20:13:24.856480 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:24.856452 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Oct 30 20:13:24.856718 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:24.856682 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Oct 30 20:13:24.860981 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:24.860949 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-577f596567-7ttkj"] Oct 30 20:13:25.010574 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.010540 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e17f05a-e4af-4b5b-944a-77855daf29eb-webhook-cert\") pod \"maas-controller-577f596567-7ttkj\" (UID: \"4e17f05a-e4af-4b5b-944a-77855daf29eb\") " pod="opendatahub/maas-controller-577f596567-7ttkj" Oct 30 20:13:25.010764 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.010680 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e17f05a-e4af-4b5b-944a-77855daf29eb-metrics-certs\") pod \"maas-controller-577f596567-7ttkj\" (UID: \"4e17f05a-e4af-4b5b-944a-77855daf29eb\") " pod="opendatahub/maas-controller-577f596567-7ttkj" Oct 30 20:13:25.010839 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.010798 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6zrr\" (UniqueName: \"kubernetes.io/projected/4e17f05a-e4af-4b5b-944a-77855daf29eb-kube-api-access-d6zrr\") pod \"maas-controller-577f596567-7ttkj\" (UID: \"4e17f05a-e4af-4b5b-944a-77855daf29eb\") " pod="opendatahub/maas-controller-577f596567-7ttkj" Oct 30 20:13:25.111604 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.111508 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e17f05a-e4af-4b5b-944a-77855daf29eb-metrics-certs\") pod \"maas-controller-577f596567-7ttkj\" (UID: \"4e17f05a-e4af-4b5b-944a-77855daf29eb\") " pod="opendatahub/maas-controller-577f596567-7ttkj" Oct 30 20:13:25.111604 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.111572 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6zrr\" (UniqueName: \"kubernetes.io/projected/4e17f05a-e4af-4b5b-944a-77855daf29eb-kube-api-access-d6zrr\") pod \"maas-controller-577f596567-7ttkj\" (UID: \"4e17f05a-e4af-4b5b-944a-77855daf29eb\") " pod="opendatahub/maas-controller-577f596567-7ttkj" Oct 30 20:13:25.111604 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.111592 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e17f05a-e4af-4b5b-944a-77855daf29eb-webhook-cert\") pod \"maas-controller-577f596567-7ttkj\" (UID: \"4e17f05a-e4af-4b5b-944a-77855daf29eb\") " pod="opendatahub/maas-controller-577f596567-7ttkj" Oct 30 20:13:25.114030 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.114006 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e17f05a-e4af-4b5b-944a-77855daf29eb-webhook-cert\") pod \"maas-controller-577f596567-7ttkj\" (UID: \"4e17f05a-e4af-4b5b-944a-77855daf29eb\") " pod="opendatahub/maas-controller-577f596567-7ttkj" Oct 30 20:13:25.114146 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.114095 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e17f05a-e4af-4b5b-944a-77855daf29eb-metrics-certs\") pod \"maas-controller-577f596567-7ttkj\" (UID: \"4e17f05a-e4af-4b5b-944a-77855daf29eb\") " pod="opendatahub/maas-controller-577f596567-7ttkj" Oct 30 20:13:25.129267 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.129242 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6zrr\" (UniqueName: \"kubernetes.io/projected/4e17f05a-e4af-4b5b-944a-77855daf29eb-kube-api-access-d6zrr\") pod \"maas-controller-577f596567-7ttkj\" (UID: \"4e17f05a-e4af-4b5b-944a-77855daf29eb\") " pod="opendatahub/maas-controller-577f596567-7ttkj" Oct 30 20:13:25.159198 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.159168 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-7ttkj" Oct 30 20:13:25.211031 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.210161 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76fb996bcf-c5tbp"] Oct 30 20:13:25.215593 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.215569 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb996bcf-c5tbp" Oct 30 20:13:25.231370 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.231318 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76fb996bcf-c5tbp"] Oct 30 20:13:25.313770 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.313727 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12babe67-4721-4422-aa81-3cf403e5c2c9-metrics-certs\") pod \"maas-controller-76fb996bcf-c5tbp\" (UID: \"12babe67-4721-4422-aa81-3cf403e5c2c9\") " pod="opendatahub/maas-controller-76fb996bcf-c5tbp" Oct 30 20:13:25.313962 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.313785 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25xxh\" (UniqueName: \"kubernetes.io/projected/12babe67-4721-4422-aa81-3cf403e5c2c9-kube-api-access-25xxh\") pod \"maas-controller-76fb996bcf-c5tbp\" (UID: \"12babe67-4721-4422-aa81-3cf403e5c2c9\") " pod="opendatahub/maas-controller-76fb996bcf-c5tbp" Oct 30 20:13:25.313962 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.313885 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12babe67-4721-4422-aa81-3cf403e5c2c9-webhook-cert\") pod \"maas-controller-76fb996bcf-c5tbp\" (UID: \"12babe67-4721-4422-aa81-3cf403e5c2c9\") " pod="opendatahub/maas-controller-76fb996bcf-c5tbp" Oct 30 20:13:25.414794 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.414719 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12babe67-4721-4422-aa81-3cf403e5c2c9-webhook-cert\") pod \"maas-controller-76fb996bcf-c5tbp\" (UID: \"12babe67-4721-4422-aa81-3cf403e5c2c9\") " pod="opendatahub/maas-controller-76fb996bcf-c5tbp" Oct 30 20:13:25.414945 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.414805 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12babe67-4721-4422-aa81-3cf403e5c2c9-metrics-certs\") pod \"maas-controller-76fb996bcf-c5tbp\" (UID: \"12babe67-4721-4422-aa81-3cf403e5c2c9\") " pod="opendatahub/maas-controller-76fb996bcf-c5tbp" Oct 30 20:13:25.414945 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.414863 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25xxh\" (UniqueName: \"kubernetes.io/projected/12babe67-4721-4422-aa81-3cf403e5c2c9-kube-api-access-25xxh\") pod \"maas-controller-76fb996bcf-c5tbp\" (UID: \"12babe67-4721-4422-aa81-3cf403e5c2c9\") " pod="opendatahub/maas-controller-76fb996bcf-c5tbp" Oct 30 20:13:25.417291 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.417266 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12babe67-4721-4422-aa81-3cf403e5c2c9-webhook-cert\") pod \"maas-controller-76fb996bcf-c5tbp\" (UID: \"12babe67-4721-4422-aa81-3cf403e5c2c9\") " pod="opendatahub/maas-controller-76fb996bcf-c5tbp" Oct 30 20:13:25.417425 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.417385 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12babe67-4721-4422-aa81-3cf403e5c2c9-metrics-certs\") pod \"maas-controller-76fb996bcf-c5tbp\" (UID: \"12babe67-4721-4422-aa81-3cf403e5c2c9\") " pod="opendatahub/maas-controller-76fb996bcf-c5tbp" Oct 30 20:13:25.427828 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.427799 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25xxh\" (UniqueName: \"kubernetes.io/projected/12babe67-4721-4422-aa81-3cf403e5c2c9-kube-api-access-25xxh\") pod \"maas-controller-76fb996bcf-c5tbp\" (UID: \"12babe67-4721-4422-aa81-3cf403e5c2c9\") " pod="opendatahub/maas-controller-76fb996bcf-c5tbp" Oct 30 20:13:25.437919 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.437797 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-577f596567-7ttkj"] Oct 30 20:13:25.440287 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:13:25.440263 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e17f05a_e4af_4b5b_944a_77855daf29eb.slice/crio-421837cec594571e0d5ad5f6ad73714ea3eb0a4f111c86547ce9d85ab19a1ac1 WatchSource:0}: Error finding container 421837cec594571e0d5ad5f6ad73714ea3eb0a4f111c86547ce9d85ab19a1ac1: Status 404 returned error can't find the container with id 421837cec594571e0d5ad5f6ad73714ea3eb0a4f111c86547ce9d85ab19a1ac1 Oct 30 20:13:25.535811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.535771 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb996bcf-c5tbp" Oct 30 20:13:25.813432 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:25.813409 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76fb996bcf-c5tbp"] Oct 30 20:13:25.815834 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:13:25.815809 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12babe67_4721_4422_aa81_3cf403e5c2c9.slice/crio-2bcbb1da2f609f736e2d71141847d24f854d8cdc24d495d38381d83587475a13 WatchSource:0}: Error finding container 2bcbb1da2f609f736e2d71141847d24f854d8cdc24d495d38381d83587475a13: Status 404 returned error can't find the container with id 2bcbb1da2f609f736e2d71141847d24f854d8cdc24d495d38381d83587475a13 Oct 30 20:13:26.434161 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:26.434110 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-7ttkj" event={"ID":"4e17f05a-e4af-4b5b-944a-77855daf29eb","Type":"ContainerStarted","Data":"421837cec594571e0d5ad5f6ad73714ea3eb0a4f111c86547ce9d85ab19a1ac1"} Oct 30 20:13:26.436511 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:26.436440 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb996bcf-c5tbp" event={"ID":"12babe67-4721-4422-aa81-3cf403e5c2c9","Type":"ContainerStarted","Data":"2bcbb1da2f609f736e2d71141847d24f854d8cdc24d495d38381d83587475a13"} Oct 30 20:13:26.724975 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:13:26.724835 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:13:28.450005 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:28.449966 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-7ttkj" event={"ID":"4e17f05a-e4af-4b5b-944a-77855daf29eb","Type":"ContainerStarted","Data":"d279b3a28e7cbfef51a70e0f1b7bf719c502e47b2fe67456c1973e2913df312c"} Oct 30 20:13:28.450394 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:28.450130 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-577f596567-7ttkj" Oct 30 20:13:28.474304 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:28.474238 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-577f596567-7ttkj" podStartSLOduration=1.56709148 podStartE2EDuration="4.474218655s" totalImagesPullingTime="2.907127175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:13:28.472488875 +0000 UTC m=+583.005761468" watchObservedRunningTime="2026-10-30 20:13:28.474218655 +0000 UTC m=+583.007491251" Oct 30 20:13:29.456503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:29.456461 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb996bcf-c5tbp" event={"ID":"12babe67-4721-4422-aa81-3cf403e5c2c9","Type":"ContainerStarted","Data":"5a8cfd7b8a195aa27ee8b572242047a6670f95d6c9d264d400a9dd8115cc7fb2"} Oct 30 20:13:29.481908 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:29.481833 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-76fb996bcf-c5tbp" podStartSLOduration=1.694537835 podStartE2EDuration="4.481814283s" totalImagesPullingTime="2.787276448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:13:29.481167687 +0000 UTC m=+584.014440284" watchObservedRunningTime="2026-10-30 20:13:29.481814283 +0000 UTC m=+584.015086878" Oct 30 20:13:30.461539 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:30.461508 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76fb996bcf-c5tbp" Oct 30 20:13:31.895106 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:31.895065 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk"] Oct 30 20:13:31.899306 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:31.899277 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk" Oct 30 20:13:31.912050 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:31.911952 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-8wzm5\"" Oct 30 20:13:31.912050 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:31.912023 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\"" Oct 30 20:13:31.912450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:31.912421 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\"" Oct 30 20:13:31.912584 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:31.912553 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk"] Oct 30 20:13:31.912807 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:31.912786 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\"" Oct 30 20:13:31.970416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:31.970376 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlxq4\" (UniqueName: \"kubernetes.io/projected/6bd378ec-e598-445c-a5c5-6d46ebe9226d-kube-api-access-hlxq4\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-ltspk\" (UID: \"6bd378ec-e598-445c-a5c5-6d46ebe9226d\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk" Oct 30 20:13:31.970603 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:31.970434 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6bd378ec-e598-445c-a5c5-6d46ebe9226d-service-ca\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-ltspk\" (UID: \"6bd378ec-e598-445c-a5c5-6d46ebe9226d\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk" Oct 30 20:13:31.970603 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:31.970559 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6bd378ec-e598-445c-a5c5-6d46ebe9226d-tls-cert\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-ltspk\" (UID: \"6bd378ec-e598-445c-a5c5-6d46ebe9226d\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk" Oct 30 20:13:31.970713 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:31.970611 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/6bd378ec-e598-445c-a5c5-6d46ebe9226d-proxy-source\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-ltspk\" (UID: \"6bd378ec-e598-445c-a5c5-6d46ebe9226d\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk" Oct 30 20:13:32.071587 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:32.071553 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/6bd378ec-e598-445c-a5c5-6d46ebe9226d-proxy-source\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-ltspk\" (UID: \"6bd378ec-e598-445c-a5c5-6d46ebe9226d\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk" Oct 30 20:13:32.071803 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:32.071620 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlxq4\" (UniqueName: \"kubernetes.io/projected/6bd378ec-e598-445c-a5c5-6d46ebe9226d-kube-api-access-hlxq4\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-ltspk\" (UID: \"6bd378ec-e598-445c-a5c5-6d46ebe9226d\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk" Oct 30 20:13:32.071803 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:32.071784 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6bd378ec-e598-445c-a5c5-6d46ebe9226d-service-ca\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-ltspk\" (UID: \"6bd378ec-e598-445c-a5c5-6d46ebe9226d\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk" Oct 30 20:13:32.071933 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:32.071841 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6bd378ec-e598-445c-a5c5-6d46ebe9226d-tls-cert\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-ltspk\" (UID: \"6bd378ec-e598-445c-a5c5-6d46ebe9226d\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk" Oct 30 20:13:32.072399 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:32.072366 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6bd378ec-e598-445c-a5c5-6d46ebe9226d-service-ca\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-ltspk\" (UID: \"6bd378ec-e598-445c-a5c5-6d46ebe9226d\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk" Oct 30 20:13:32.072554 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:32.072463 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/6bd378ec-e598-445c-a5c5-6d46ebe9226d-proxy-source\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-ltspk\" (UID: \"6bd378ec-e598-445c-a5c5-6d46ebe9226d\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk" Oct 30 20:13:32.074253 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:32.074231 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6bd378ec-e598-445c-a5c5-6d46ebe9226d-tls-cert\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-ltspk\" (UID: \"6bd378ec-e598-445c-a5c5-6d46ebe9226d\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk" Oct 30 20:13:32.084981 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:32.084947 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlxq4\" (UniqueName: \"kubernetes.io/projected/6bd378ec-e598-445c-a5c5-6d46ebe9226d-kube-api-access-hlxq4\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-ltspk\" (UID: \"6bd378ec-e598-445c-a5c5-6d46ebe9226d\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk" Oct 30 20:13:32.214975 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:32.214886 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk" Oct 30 20:13:32.495071 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:32.495047 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk"] Oct 30 20:13:32.497549 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:13:32.497521 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bd378ec_e598_445c_a5c5_6d46ebe9226d.slice/crio-61cfd7ec97734cd4b725777fd07fac607d6931ad53e06d929b265d3401c27834 WatchSource:0}: Error finding container 61cfd7ec97734cd4b725777fd07fac607d6931ad53e06d929b265d3401c27834: Status 404 returned error can't find the container with id 61cfd7ec97734cd4b725777fd07fac607d6931ad53e06d929b265d3401c27834 Oct 30 20:13:33.476473 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:33.476437 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk" event={"ID":"6bd378ec-e598-445c-a5c5-6d46ebe9226d","Type":"ContainerStarted","Data":"61cfd7ec97734cd4b725777fd07fac607d6931ad53e06d929b265d3401c27834"} Oct 30 20:13:39.459123 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:39.459085 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-577f596567-7ttkj" Oct 30 20:13:41.469477 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:41.469443 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76fb996bcf-c5tbp" Oct 30 20:13:41.532825 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:41.532784 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-577f596567-7ttkj"] Oct 30 20:13:41.533519 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:41.533478 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-577f596567-7ttkj" podUID="4e17f05a-e4af-4b5b-944a-77855daf29eb" containerName="manager" containerID="cri-o://d279b3a28e7cbfef51a70e0f1b7bf719c502e47b2fe67456c1973e2913df312c" gracePeriod=30 Oct 30 20:13:41.800543 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:41.800518 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-7ttkj" Oct 30 20:13:41.868513 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:41.868478 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4e17f05a-e4af-4b5b-944a-77855daf29eb-kube-api-access-d6zrr\" (UniqueName: \"kubernetes.io/projected/4e17f05a-e4af-4b5b-944a-77855daf29eb-kube-api-access-d6zrr\") pod \"4e17f05a-e4af-4b5b-944a-77855daf29eb\" (UID: \"4e17f05a-e4af-4b5b-944a-77855daf29eb\") " Oct 30 20:13:41.868710 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:41.868524 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4e17f05a-e4af-4b5b-944a-77855daf29eb-metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e17f05a-e4af-4b5b-944a-77855daf29eb-metrics-certs\") pod \"4e17f05a-e4af-4b5b-944a-77855daf29eb\" (UID: \"4e17f05a-e4af-4b5b-944a-77855daf29eb\") " Oct 30 20:13:41.868710 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:41.868668 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4e17f05a-e4af-4b5b-944a-77855daf29eb-webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e17f05a-e4af-4b5b-944a-77855daf29eb-webhook-cert\") pod \"4e17f05a-e4af-4b5b-944a-77855daf29eb\" (UID: \"4e17f05a-e4af-4b5b-944a-77855daf29eb\") " Oct 30 20:13:41.871212 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:41.871181 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e17f05a-e4af-4b5b-944a-77855daf29eb-kube-api-access-d6zrr" pod "4e17f05a-e4af-4b5b-944a-77855daf29eb" (UID: "4e17f05a-e4af-4b5b-944a-77855daf29eb"). InnerVolumeSpecName "kube-api-access-d6zrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:13:41.871212 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:41.871197 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e17f05a-e4af-4b5b-944a-77855daf29eb-metrics-certs" pod "4e17f05a-e4af-4b5b-944a-77855daf29eb" (UID: "4e17f05a-e4af-4b5b-944a-77855daf29eb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:13:41.871516 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:41.871317 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e17f05a-e4af-4b5b-944a-77855daf29eb-webhook-cert" pod "4e17f05a-e4af-4b5b-944a-77855daf29eb" (UID: "4e17f05a-e4af-4b5b-944a-77855daf29eb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:13:41.970080 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:41.970045 5078 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e17f05a-e4af-4b5b-944a-77855daf29eb-webhook-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:13:41.970080 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:41.970079 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6zrr\" (UniqueName: \"kubernetes.io/projected/4e17f05a-e4af-4b5b-944a-77855daf29eb-kube-api-access-d6zrr\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:13:41.970080 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:41.970090 5078 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e17f05a-e4af-4b5b-944a-77855daf29eb-metrics-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:13:42.539260 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:42.539225 5078 generic.go:356] "Generic (PLEG): container finished" podID="4e17f05a-e4af-4b5b-944a-77855daf29eb" containerID="d279b3a28e7cbfef51a70e0f1b7bf719c502e47b2fe67456c1973e2913df312c" exitCode=0 Oct 30 20:13:42.539908 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:42.539267 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-7ttkj" Oct 30 20:13:42.539908 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:42.539294 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-7ttkj" event={"ID":"4e17f05a-e4af-4b5b-944a-77855daf29eb","Type":"ContainerDied","Data":"d279b3a28e7cbfef51a70e0f1b7bf719c502e47b2fe67456c1973e2913df312c"} Oct 30 20:13:42.539908 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:42.539372 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-7ttkj" event={"ID":"4e17f05a-e4af-4b5b-944a-77855daf29eb","Type":"ContainerDied","Data":"421837cec594571e0d5ad5f6ad73714ea3eb0a4f111c86547ce9d85ab19a1ac1"} Oct 30 20:13:42.539908 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:42.539405 5078 scope.go:122] "RemoveContainer" containerID="d279b3a28e7cbfef51a70e0f1b7bf719c502e47b2fe67456c1973e2913df312c" Oct 30 20:13:42.548736 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:42.548720 5078 scope.go:122] "RemoveContainer" containerID="d279b3a28e7cbfef51a70e0f1b7bf719c502e47b2fe67456c1973e2913df312c" Oct 30 20:13:42.549002 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:13:42.548980 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d279b3a28e7cbfef51a70e0f1b7bf719c502e47b2fe67456c1973e2913df312c\": container with ID starting with d279b3a28e7cbfef51a70e0f1b7bf719c502e47b2fe67456c1973e2913df312c not found: ID does not exist" containerID="d279b3a28e7cbfef51a70e0f1b7bf719c502e47b2fe67456c1973e2913df312c" Oct 30 20:13:42.549071 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:42.549009 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d279b3a28e7cbfef51a70e0f1b7bf719c502e47b2fe67456c1973e2913df312c"} err="failed to get container status \"d279b3a28e7cbfef51a70e0f1b7bf719c502e47b2fe67456c1973e2913df312c\": rpc error: code = NotFound desc = could not find container \"d279b3a28e7cbfef51a70e0f1b7bf719c502e47b2fe67456c1973e2913df312c\": container with ID starting with d279b3a28e7cbfef51a70e0f1b7bf719c502e47b2fe67456c1973e2913df312c not found: ID does not exist" Oct 30 20:13:42.563380 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:42.563355 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-577f596567-7ttkj"] Oct 30 20:13:42.570257 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:42.570233 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-577f596567-7ttkj"] Oct 30 20:13:43.585575 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:43.585544 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4e17f05a-e4af-4b5b-944a-77855daf29eb" path="/var/lib/kubelet/pods/4e17f05a-e4af-4b5b-944a-77855daf29eb/volumes" Oct 30 20:13:44.554129 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:44.554092 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk" event={"ID":"6bd378ec-e598-445c-a5c5-6d46ebe9226d","Type":"ContainerStarted","Data":"e1b30b5446221956c52ca163c5f06048ffb8700bf22e907281766320c648da7c"} Oct 30 20:13:44.554298 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:44.554216 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk" Oct 30 20:13:44.574402 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:44.574302 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk" podStartSLOduration=2.129261959 podStartE2EDuration="13.574286063s" totalImagesPullingTime="11.445024104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:13:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:13:44.573917369 +0000 UTC m=+599.107189975" watchObservedRunningTime="2026-10-30 20:13:44.574286063 +0000 UTC m=+599.107558659" Oct 30 20:13:45.631187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:45.631160 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/1.log" Oct 30 20:13:45.631667 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:45.631410 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/1.log" Oct 30 20:13:55.564287 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:13:55.564252 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-ltspk" Oct 30 20:13:56.698988 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:13:56.698950 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:14:02.079816 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.079780 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd"] Oct 30 20:14:02.080363 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.080189 5078 cpu_manager.go:414] "containerMap: removing container" podUID="4e17f05a-e4af-4b5b-944a-77855daf29eb" containerName="manager" Oct 30 20:14:02.080363 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.080199 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4e17f05a-e4af-4b5b-944a-77855daf29eb" containerName="manager" Oct 30 20:14:02.080363 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.080276 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="4e17f05a-e4af-4b5b-944a-77855daf29eb" containerName="manager" Oct 30 20:14:02.086752 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.086725 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" Oct 30 20:14:02.095287 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.095254 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Oct 30 20:14:02.095766 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.095299 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Oct 30 20:14:02.095766 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.095389 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 20:14:02.095766 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.095509 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g52k9\"" Oct 30 20:14:02.095934 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.095783 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 20:14:02.097975 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.097945 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd"] Oct 30 20:14:02.161012 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.160975 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-metrics-certs\") pod \"maas-api-5c48877c75-x9vxd\" (UID: \"6f3008b4-8bb4-4b51-b2ae-54d2a0148809\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" Oct 30 20:14:02.161225 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.161085 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-openshift-service-ca\") pod \"maas-api-5c48877c75-x9vxd\" (UID: \"6f3008b4-8bb4-4b51-b2ae-54d2a0148809\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" Oct 30 20:14:02.161225 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.161107 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdbjk\" (UniqueName: \"kubernetes.io/projected/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-kube-api-access-fdbjk\") pod \"maas-api-5c48877c75-x9vxd\" (UID: \"6f3008b4-8bb4-4b51-b2ae-54d2a0148809\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" Oct 30 20:14:02.161225 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.161192 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-maas-api-tls\") pod \"maas-api-5c48877c75-x9vxd\" (UID: \"6f3008b4-8bb4-4b51-b2ae-54d2a0148809\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" Oct 30 20:14:02.262158 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.262119 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-maas-api-tls\") pod \"maas-api-5c48877c75-x9vxd\" (UID: \"6f3008b4-8bb4-4b51-b2ae-54d2a0148809\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" Oct 30 20:14:02.262398 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.262212 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-metrics-certs\") pod \"maas-api-5c48877c75-x9vxd\" (UID: \"6f3008b4-8bb4-4b51-b2ae-54d2a0148809\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" Oct 30 20:14:02.262398 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.262263 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-openshift-service-ca\") pod \"maas-api-5c48877c75-x9vxd\" (UID: \"6f3008b4-8bb4-4b51-b2ae-54d2a0148809\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" Oct 30 20:14:02.262398 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.262279 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdbjk\" (UniqueName: \"kubernetes.io/projected/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-kube-api-access-fdbjk\") pod \"maas-api-5c48877c75-x9vxd\" (UID: \"6f3008b4-8bb4-4b51-b2ae-54d2a0148809\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" Oct 30 20:14:02.263045 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.263009 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-openshift-service-ca\") pod \"maas-api-5c48877c75-x9vxd\" (UID: \"6f3008b4-8bb4-4b51-b2ae-54d2a0148809\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" Oct 30 20:14:02.264848 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.264786 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-metrics-certs\") pod \"maas-api-5c48877c75-x9vxd\" (UID: \"6f3008b4-8bb4-4b51-b2ae-54d2a0148809\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" Oct 30 20:14:02.264966 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.264831 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-maas-api-tls\") pod \"maas-api-5c48877c75-x9vxd\" (UID: \"6f3008b4-8bb4-4b51-b2ae-54d2a0148809\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" Oct 30 20:14:02.275690 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.275648 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdbjk\" (UniqueName: \"kubernetes.io/projected/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-kube-api-access-fdbjk\") pod \"maas-api-5c48877c75-x9vxd\" (UID: \"6f3008b4-8bb4-4b51-b2ae-54d2a0148809\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" Oct 30 20:14:02.403973 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.403871 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" Oct 30 20:14:02.696632 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.696606 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd"] Oct 30 20:14:02.698772 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:14:02.698744 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f3008b4_8bb4_4b51_b2ae_54d2a0148809.slice/crio-b091945cf0fcc37e62df62887be42324d050fd8ffbb9884d4fd6458d90972328 WatchSource:0}: Error finding container b091945cf0fcc37e62df62887be42324d050fd8ffbb9884d4fd6458d90972328: Status 404 returned error can't find the container with id b091945cf0fcc37e62df62887be42324d050fd8ffbb9884d4fd6458d90972328 Oct 30 20:14:02.700184 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:02.700166 5078 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 20:14:03.662571 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:03.662531 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" event={"ID":"6f3008b4-8bb4-4b51-b2ae-54d2a0148809","Type":"ContainerStarted","Data":"b091945cf0fcc37e62df62887be42324d050fd8ffbb9884d4fd6458d90972328"} Oct 30 20:14:04.670632 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:04.670598 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" event={"ID":"6f3008b4-8bb4-4b51-b2ae-54d2a0148809","Type":"ContainerStarted","Data":"94fc7b3bce7a245efb0b8e2f8a0c0e986e05a689459cc7c42cb2b5dc5a0e9a7b"} Oct 30 20:14:04.671102 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:04.670675 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" Oct 30 20:14:04.691969 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:04.691916 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" podStartSLOduration=0.806317115 podStartE2EDuration="2.691902474s" totalImagesPullingTime="1.885585359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:14:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:14:04.691218624 +0000 UTC m=+619.224491217" watchObservedRunningTime="2026-10-30 20:14:04.691902474 +0000 UTC m=+619.225175069" Oct 30 20:14:10.682782 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:10.682752 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" Oct 30 20:14:12.711072 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:12.711038 5078 generic.go:356] "Generic (PLEG): container finished" podID="626f7c24-fa80-4b57-ab5c-9739398bd547" containerID="b5e947aea28a578fbaebfdf9b117b071b55ecc7416e04a61d0a8d8f70ad014eb" exitCode=0 Oct 30 20:14:12.711556 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:12.711112 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" event={"ID":"626f7c24-fa80-4b57-ab5c-9739398bd547","Type":"ContainerDied","Data":"b5e947aea28a578fbaebfdf9b117b071b55ecc7416e04a61d0a8d8f70ad014eb"} Oct 30 20:14:12.711556 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:12.711495 5078 scope.go:122] "RemoveContainer" containerID="b5e947aea28a578fbaebfdf9b117b071b55ecc7416e04a61d0a8d8f70ad014eb" Oct 30 20:14:12.712556 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:12.712528 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:14:12.712669 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:12.712609 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:14:12.712669 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:12.712653 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:14:13.718704 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:13.718668 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" event={"ID":"626f7c24-fa80-4b57-ab5c-9739398bd547","Type":"ContainerStarted","Data":"bbf287e32a129dc8f4bdfb9cdd697fd9e65605a98deeb7cbf6f8199ff00b5869"} Oct 30 20:14:14.705386 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:14.705348 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:14:14.706424 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:14.706401 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-pzpq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Oct 30 20:14:14.706531 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:14.706459 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" podUID="626f7c24-fa80-4b57-ab5c-9739398bd547" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Oct 30 20:14:15.705613 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:15.705580 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-pzpq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Oct 30 20:14:15.706000 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:15.705628 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" podUID="626f7c24-fa80-4b57-ab5c-9739398bd547" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Oct 30 20:14:16.705248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:16.705215 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-pzpq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Oct 30 20:14:16.705460 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:16.705269 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" podUID="626f7c24-fa80-4b57-ab5c-9739398bd547" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Oct 30 20:14:17.705294 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:17.705252 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-pzpq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Oct 30 20:14:17.705806 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:17.705353 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" podUID="626f7c24-fa80-4b57-ab5c-9739398bd547" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Oct 30 20:14:18.749498 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:18.749466 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:14:18.749984 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:18.749744 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:14:18.750683 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:14:18.750663 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-pzpq5" Oct 30 20:14:26.698243 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:14:26.698208 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:14:56.697892 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:14:56.697811 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:15:01.824204 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:01.824168 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t"] Oct 30 20:15:01.827829 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:01.827803 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:01.834966 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:01.834924 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9h5g9\"" Oct 30 20:15:01.835601 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:01.835032 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Oct 30 20:15:01.835601 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:01.835137 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Oct 30 20:15:01.835601 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:01.835341 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Oct 30 20:15:01.839990 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:01.839958 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t"] Oct 30 20:15:01.908421 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:01.908385 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99fc63f4-6234-44b4-9627-031cc95991ca-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t\" (UID: \"99fc63f4-6234-44b4-9627-031cc95991ca\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:01.908616 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:01.908444 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99fc63f4-6234-44b4-9627-031cc95991ca-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t\" (UID: \"99fc63f4-6234-44b4-9627-031cc95991ca\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:01.908616 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:01.908466 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrwts\" (UniqueName: \"kubernetes.io/projected/99fc63f4-6234-44b4-9627-031cc95991ca-kube-api-access-wrwts\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t\" (UID: \"99fc63f4-6234-44b4-9627-031cc95991ca\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:01.908710 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:01.908613 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99fc63f4-6234-44b4-9627-031cc95991ca-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t\" (UID: \"99fc63f4-6234-44b4-9627-031cc95991ca\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:01.908710 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:01.908650 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99fc63f4-6234-44b4-9627-031cc95991ca-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t\" (UID: \"99fc63f4-6234-44b4-9627-031cc95991ca\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:01.908785 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:01.908746 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99fc63f4-6234-44b4-9627-031cc95991ca-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t\" (UID: \"99fc63f4-6234-44b4-9627-031cc95991ca\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:02.009798 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:02.009753 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99fc63f4-6234-44b4-9627-031cc95991ca-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t\" (UID: \"99fc63f4-6234-44b4-9627-031cc95991ca\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:02.010005 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:02.009826 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99fc63f4-6234-44b4-9627-031cc95991ca-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t\" (UID: \"99fc63f4-6234-44b4-9627-031cc95991ca\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:02.010005 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:02.009859 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrwts\" (UniqueName: \"kubernetes.io/projected/99fc63f4-6234-44b4-9627-031cc95991ca-kube-api-access-wrwts\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t\" (UID: \"99fc63f4-6234-44b4-9627-031cc95991ca\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:02.010005 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:02.009910 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99fc63f4-6234-44b4-9627-031cc95991ca-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t\" (UID: \"99fc63f4-6234-44b4-9627-031cc95991ca\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:02.010005 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:02.009938 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99fc63f4-6234-44b4-9627-031cc95991ca-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t\" (UID: \"99fc63f4-6234-44b4-9627-031cc95991ca\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:02.010005 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:02.009994 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99fc63f4-6234-44b4-9627-031cc95991ca-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t\" (UID: \"99fc63f4-6234-44b4-9627-031cc95991ca\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:02.010272 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:02.010254 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99fc63f4-6234-44b4-9627-031cc95991ca-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t\" (UID: \"99fc63f4-6234-44b4-9627-031cc95991ca\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:02.010318 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:02.010296 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99fc63f4-6234-44b4-9627-031cc95991ca-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t\" (UID: \"99fc63f4-6234-44b4-9627-031cc95991ca\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:02.010395 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:02.010371 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99fc63f4-6234-44b4-9627-031cc95991ca-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t\" (UID: \"99fc63f4-6234-44b4-9627-031cc95991ca\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:02.012451 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:02.012428 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99fc63f4-6234-44b4-9627-031cc95991ca-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t\" (UID: \"99fc63f4-6234-44b4-9627-031cc95991ca\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:02.012595 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:02.012574 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99fc63f4-6234-44b4-9627-031cc95991ca-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t\" (UID: \"99fc63f4-6234-44b4-9627-031cc95991ca\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:02.023203 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:02.023174 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrwts\" (UniqueName: \"kubernetes.io/projected/99fc63f4-6234-44b4-9627-031cc95991ca-kube-api-access-wrwts\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t\" (UID: \"99fc63f4-6234-44b4-9627-031cc95991ca\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:02.142606 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:02.142512 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:02.426644 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:02.426618 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t"] Oct 30 20:15:02.428719 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:15:02.428690 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99fc63f4_6234_44b4_9627_031cc95991ca.slice/crio-51310de958fb50f78d860619f4fa7ad1aaf678f393e145e15ac639663dcb15da WatchSource:0}: Error finding container 51310de958fb50f78d860619f4fa7ad1aaf678f393e145e15ac639663dcb15da: Status 404 returned error can't find the container with id 51310de958fb50f78d860619f4fa7ad1aaf678f393e145e15ac639663dcb15da Oct 30 20:15:02.973524 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:02.973477 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" event={"ID":"99fc63f4-6234-44b4-9627-031cc95991ca","Type":"ContainerStarted","Data":"51310de958fb50f78d860619f4fa7ad1aaf678f393e145e15ac639663dcb15da"} Oct 30 20:15:04.755361 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.755319 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8"] Oct 30 20:15:04.759107 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.759087 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:04.768977 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.768914 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8"] Oct 30 20:15:04.769108 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.769024 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Oct 30 20:15:04.837252 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.837221 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6544cfff-736a-4c71-a9d2-630833e88a05-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-85ns8\" (UID: \"6544cfff-736a-4c71-a9d2-630833e88a05\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:04.837425 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.837263 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6544cfff-736a-4c71-a9d2-630833e88a05-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-85ns8\" (UID: \"6544cfff-736a-4c71-a9d2-630833e88a05\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:04.837425 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.837347 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6544cfff-736a-4c71-a9d2-630833e88a05-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-85ns8\" (UID: \"6544cfff-736a-4c71-a9d2-630833e88a05\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:04.837425 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.837399 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6544cfff-736a-4c71-a9d2-630833e88a05-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-85ns8\" (UID: \"6544cfff-736a-4c71-a9d2-630833e88a05\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:04.837537 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.837431 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6544cfff-736a-4c71-a9d2-630833e88a05-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-85ns8\" (UID: \"6544cfff-736a-4c71-a9d2-630833e88a05\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:04.837571 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.837538 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72dc9\" (UniqueName: \"kubernetes.io/projected/6544cfff-736a-4c71-a9d2-630833e88a05-kube-api-access-72dc9\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-85ns8\" (UID: \"6544cfff-736a-4c71-a9d2-630833e88a05\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:04.938259 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.938224 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6544cfff-736a-4c71-a9d2-630833e88a05-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-85ns8\" (UID: \"6544cfff-736a-4c71-a9d2-630833e88a05\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:04.938481 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.938268 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6544cfff-736a-4c71-a9d2-630833e88a05-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-85ns8\" (UID: \"6544cfff-736a-4c71-a9d2-630833e88a05\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:04.938481 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.938297 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72dc9\" (UniqueName: \"kubernetes.io/projected/6544cfff-736a-4c71-a9d2-630833e88a05-kube-api-access-72dc9\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-85ns8\" (UID: \"6544cfff-736a-4c71-a9d2-630833e88a05\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:04.938481 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.938361 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6544cfff-736a-4c71-a9d2-630833e88a05-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-85ns8\" (UID: \"6544cfff-736a-4c71-a9d2-630833e88a05\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:04.938481 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.938385 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6544cfff-736a-4c71-a9d2-630833e88a05-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-85ns8\" (UID: \"6544cfff-736a-4c71-a9d2-630833e88a05\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:04.938481 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.938405 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6544cfff-736a-4c71-a9d2-630833e88a05-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-85ns8\" (UID: \"6544cfff-736a-4c71-a9d2-630833e88a05\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:04.938779 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.938755 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6544cfff-736a-4c71-a9d2-630833e88a05-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-85ns8\" (UID: \"6544cfff-736a-4c71-a9d2-630833e88a05\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:04.938823 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.938806 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6544cfff-736a-4c71-a9d2-630833e88a05-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-85ns8\" (UID: \"6544cfff-736a-4c71-a9d2-630833e88a05\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:04.938823 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.938817 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6544cfff-736a-4c71-a9d2-630833e88a05-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-85ns8\" (UID: \"6544cfff-736a-4c71-a9d2-630833e88a05\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:04.940547 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.940522 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6544cfff-736a-4c71-a9d2-630833e88a05-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-85ns8\" (UID: \"6544cfff-736a-4c71-a9d2-630833e88a05\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:04.940811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.940795 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6544cfff-736a-4c71-a9d2-630833e88a05-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-85ns8\" (UID: \"6544cfff-736a-4c71-a9d2-630833e88a05\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:04.951440 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.951417 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72dc9\" (UniqueName: \"kubernetes.io/projected/6544cfff-736a-4c71-a9d2-630833e88a05-kube-api-access-72dc9\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-85ns8\" (UID: \"6544cfff-736a-4c71-a9d2-630833e88a05\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:04.990749 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:04.990711 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" event={"ID":"99fc63f4-6234-44b4-9627-031cc95991ca","Type":"ContainerStarted","Data":"258ecdc16ea92d4c2a604317d9ac312f1883d7db3110a1235c0acd9639e77ae1"} Oct 30 20:15:05.013227 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:05.013118 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" podStartSLOduration=2.5038594720000003 podStartE2EDuration="4.013104336s" totalImagesPullingTime="1.509244864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:15:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:15:05.012225328 +0000 UTC m=+679.545497934" watchObservedRunningTime="2026-10-30 20:15:05.013104336 +0000 UTC m=+679.546376930" Oct 30 20:15:05.074294 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:05.074260 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:05.142898 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:05.142868 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:05.359417 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:05.359386 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8"] Oct 30 20:15:05.363421 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:15:05.363396 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6544cfff_736a_4c71_a9d2_630833e88a05.slice/crio-1a07e91474a019dab73001c0abd77c3f1746c5168bb1f4b9607d19be5430994d WatchSource:0}: Error finding container 1a07e91474a019dab73001c0abd77c3f1746c5168bb1f4b9607d19be5430994d: Status 404 returned error can't find the container with id 1a07e91474a019dab73001c0abd77c3f1746c5168bb1f4b9607d19be5430994d Oct 30 20:15:05.998110 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:05.998000 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" event={"ID":"6544cfff-736a-4c71-a9d2-630833e88a05","Type":"ContainerStarted","Data":"45fa593924bdcf879b31e0f7d48fd40c477d62ce27d25acf02ddc29f776a4bc1"} Oct 30 20:15:05.998110 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:05.998066 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" event={"ID":"6544cfff-736a-4c71-a9d2-630833e88a05","Type":"ContainerStarted","Data":"1a07e91474a019dab73001c0abd77c3f1746c5168bb1f4b9607d19be5430994d"} Oct 30 20:15:06.019890 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:06.019457 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" podStartSLOduration=1.692662656 podStartE2EDuration="2.019417299s" totalImagesPullingTime="326.754643ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:15:06.019246155 +0000 UTC m=+680.552518746" watchObservedRunningTime="2026-10-30 20:15:06.019417299 +0000 UTC m=+680.552689895" Oct 30 20:15:06.075250 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:06.075202 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:08.419577 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.419540 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4"] Oct 30 20:15:08.424042 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.424017 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:08.428721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.428695 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Oct 30 20:15:08.438143 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.438112 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4"] Oct 30 20:15:08.570785 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.570752 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e426b14f-ee43-48e8-bac1-c82651a177ba-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4\" (UID: \"e426b14f-ee43-48e8-bac1-c82651a177ba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:08.570986 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.570802 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46n2v\" (UniqueName: \"kubernetes.io/projected/e426b14f-ee43-48e8-bac1-c82651a177ba-kube-api-access-46n2v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4\" (UID: \"e426b14f-ee43-48e8-bac1-c82651a177ba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:08.570986 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.570873 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e426b14f-ee43-48e8-bac1-c82651a177ba-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4\" (UID: \"e426b14f-ee43-48e8-bac1-c82651a177ba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:08.570986 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.570958 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e426b14f-ee43-48e8-bac1-c82651a177ba-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4\" (UID: \"e426b14f-ee43-48e8-bac1-c82651a177ba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:08.571177 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.571001 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e426b14f-ee43-48e8-bac1-c82651a177ba-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4\" (UID: \"e426b14f-ee43-48e8-bac1-c82651a177ba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:08.571177 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.571088 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e426b14f-ee43-48e8-bac1-c82651a177ba-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4\" (UID: \"e426b14f-ee43-48e8-bac1-c82651a177ba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:08.672235 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.672143 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e426b14f-ee43-48e8-bac1-c82651a177ba-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4\" (UID: \"e426b14f-ee43-48e8-bac1-c82651a177ba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:08.672235 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.672230 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e426b14f-ee43-48e8-bac1-c82651a177ba-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4\" (UID: \"e426b14f-ee43-48e8-bac1-c82651a177ba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:08.672494 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.672281 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e426b14f-ee43-48e8-bac1-c82651a177ba-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4\" (UID: \"e426b14f-ee43-48e8-bac1-c82651a177ba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:08.672494 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.672309 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e426b14f-ee43-48e8-bac1-c82651a177ba-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4\" (UID: \"e426b14f-ee43-48e8-bac1-c82651a177ba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:08.672494 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.672418 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e426b14f-ee43-48e8-bac1-c82651a177ba-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4\" (UID: \"e426b14f-ee43-48e8-bac1-c82651a177ba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:08.672649 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.672532 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46n2v\" (UniqueName: \"kubernetes.io/projected/e426b14f-ee43-48e8-bac1-c82651a177ba-kube-api-access-46n2v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4\" (UID: \"e426b14f-ee43-48e8-bac1-c82651a177ba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:08.673169 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.673137 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e426b14f-ee43-48e8-bac1-c82651a177ba-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4\" (UID: \"e426b14f-ee43-48e8-bac1-c82651a177ba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:08.673370 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.673257 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e426b14f-ee43-48e8-bac1-c82651a177ba-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4\" (UID: \"e426b14f-ee43-48e8-bac1-c82651a177ba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:08.673498 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.673410 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e426b14f-ee43-48e8-bac1-c82651a177ba-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4\" (UID: \"e426b14f-ee43-48e8-bac1-c82651a177ba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:08.675357 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.675308 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e426b14f-ee43-48e8-bac1-c82651a177ba-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4\" (UID: \"e426b14f-ee43-48e8-bac1-c82651a177ba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:08.675802 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.675776 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e426b14f-ee43-48e8-bac1-c82651a177ba-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4\" (UID: \"e426b14f-ee43-48e8-bac1-c82651a177ba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:08.685624 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.685594 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46n2v\" (UniqueName: \"kubernetes.io/projected/e426b14f-ee43-48e8-bac1-c82651a177ba-kube-api-access-46n2v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4\" (UID: \"e426b14f-ee43-48e8-bac1-c82651a177ba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:08.746323 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:08.746287 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:09.031215 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:09.031192 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4"] Oct 30 20:15:09.033313 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:15:09.033284 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode426b14f_ee43_48e8_bac1_c82651a177ba.slice/crio-fea90da9e0435ee115f72c642c0fd4383e931cddcb723c345f91691a975a15ee WatchSource:0}: Error finding container fea90da9e0435ee115f72c642c0fd4383e931cddcb723c345f91691a975a15ee: Status 404 returned error can't find the container with id fea90da9e0435ee115f72c642c0fd4383e931cddcb723c345f91691a975a15ee Oct 30 20:15:10.021321 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:10.021282 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" event={"ID":"e426b14f-ee43-48e8-bac1-c82651a177ba","Type":"ContainerStarted","Data":"e2efe9826fafc30b5cec0925c1645ee19f781675fac993ba9dbc24f06d4bcc4c"} Oct 30 20:15:10.021754 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:10.021357 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" event={"ID":"e426b14f-ee43-48e8-bac1-c82651a177ba","Type":"ContainerStarted","Data":"fea90da9e0435ee115f72c642c0fd4383e931cddcb723c345f91691a975a15ee"} Oct 30 20:15:10.043177 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:10.043119 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" podStartSLOduration=1.73825686 podStartE2EDuration="2.043102731s" totalImagesPullingTime="304.845871ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:15:10.041153109 +0000 UTC m=+684.574425715" watchObservedRunningTime="2026-10-30 20:15:10.043102731 +0000 UTC m=+684.576375327" Oct 30 20:15:10.747276 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:10.747235 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:12.143697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:12.143656 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:12.163447 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:12.163418 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:13.056530 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:13.056495 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" Oct 30 20:15:15.075473 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:15.075440 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:15.094242 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:15.094203 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:16.067480 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:16.067451 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-85ns8" Oct 30 20:15:18.746826 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:18.746798 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:18.759160 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:18.759134 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:19.083208 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:19.083182 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4" Oct 30 20:15:26.357372 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:26.357323 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s"] Oct 30 20:15:26.364434 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:26.364408 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s" Oct 30 20:15:26.374694 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:26.374655 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\"" Oct 30 20:15:26.374935 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:26.374818 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-6jxqc\"" Oct 30 20:15:26.377404 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:26.377378 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s"] Oct 30 20:15:26.444586 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:26.444545 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jshf7\" (UniqueName: \"kubernetes.io/projected/4a1d39c2-23ed-49e4-b188-1f876dac11b5-kube-api-access-jshf7\") pod \"ai-gateway-controller-5d9cd99f45-9fg8s\" (UID: \"4a1d39c2-23ed-49e4-b188-1f876dac11b5\") " pod="opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s" Oct 30 20:15:26.444768 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:26.444630 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a1d39c2-23ed-49e4-b188-1f876dac11b5-metrics-certs\") pod \"ai-gateway-controller-5d9cd99f45-9fg8s\" (UID: \"4a1d39c2-23ed-49e4-b188-1f876dac11b5\") " pod="opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s" Oct 30 20:15:26.463801 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:26.463770 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\"" Oct 30 20:15:26.546082 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:26.546035 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jshf7\" (UniqueName: \"kubernetes.io/projected/4a1d39c2-23ed-49e4-b188-1f876dac11b5-kube-api-access-jshf7\") pod \"ai-gateway-controller-5d9cd99f45-9fg8s\" (UID: \"4a1d39c2-23ed-49e4-b188-1f876dac11b5\") " pod="opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s" Oct 30 20:15:26.546247 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:26.546179 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a1d39c2-23ed-49e4-b188-1f876dac11b5-metrics-certs\") pod \"ai-gateway-controller-5d9cd99f45-9fg8s\" (UID: \"4a1d39c2-23ed-49e4-b188-1f876dac11b5\") " pod="opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s" Oct 30 20:15:26.548590 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:26.548561 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a1d39c2-23ed-49e4-b188-1f876dac11b5-metrics-certs\") pod \"ai-gateway-controller-5d9cd99f45-9fg8s\" (UID: \"4a1d39c2-23ed-49e4-b188-1f876dac11b5\") " pod="opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s" Oct 30 20:15:26.558986 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:26.558959 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jshf7\" (UniqueName: \"kubernetes.io/projected/4a1d39c2-23ed-49e4-b188-1f876dac11b5-kube-api-access-jshf7\") pod \"ai-gateway-controller-5d9cd99f45-9fg8s\" (UID: \"4a1d39c2-23ed-49e4-b188-1f876dac11b5\") " pod="opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s" Oct 30 20:15:26.680204 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:26.680106 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s" Oct 30 20:15:26.699829 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:15:26.699795 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:15:26.959094 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:26.959070 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s"] Oct 30 20:15:26.961380 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:15:26.961324 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a1d39c2_23ed_49e4_b188_1f876dac11b5.slice/crio-ebfa94964f2a5bc21771bed4c04fc996674eb7605c5739562329c60743635620 WatchSource:0}: Error finding container ebfa94964f2a5bc21771bed4c04fc996674eb7605c5739562329c60743635620: Status 404 returned error can't find the container with id ebfa94964f2a5bc21771bed4c04fc996674eb7605c5739562329c60743635620 Oct 30 20:15:27.111133 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:27.111086 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s" event={"ID":"4a1d39c2-23ed-49e4-b188-1f876dac11b5","Type":"ContainerStarted","Data":"ebfa94964f2a5bc21771bed4c04fc996674eb7605c5739562329c60743635620"} Oct 30 20:15:30.129849 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:30.129810 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s" event={"ID":"4a1d39c2-23ed-49e4-b188-1f876dac11b5","Type":"ContainerStarted","Data":"df3b3ba9ff06577ad7c8811888c32046563c7442723e3745212a03e3eda509d9"} Oct 30 20:15:30.130286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:30.129942 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s" Oct 30 20:15:30.150078 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:30.150018 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s" podStartSLOduration=1.62721364 podStartE2EDuration="4.150004496s" totalImagesPullingTime="2.522790856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:15:30.148081086 +0000 UTC m=+704.681353680" watchObservedRunningTime="2026-10-30 20:15:30.150004496 +0000 UTC m=+704.683277089" Oct 30 20:15:31.369638 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.369597 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-55qkv"] Oct 30 20:15:31.373400 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.373383 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-55qkv" Oct 30 20:15:31.380585 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.380438 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Oct 30 20:15:31.383132 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.383107 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ts5mg\"" Oct 30 20:15:31.383283 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.383259 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-55qkv"] Oct 30 20:15:31.392274 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.392248 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-sztc2"] Oct 30 20:15:31.395764 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.395741 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-sztc2" Oct 30 20:15:31.412488 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.412459 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-sztc2"] Oct 30 20:15:31.504278 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.504235 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21103aa0-66f4-446b-b377-d3bac5973c2e-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-55qkv\" (UID: \"21103aa0-66f4-446b-b377-d3bac5973c2e\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-55qkv" Oct 30 20:15:31.504467 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.504300 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq78l\" (UniqueName: \"kubernetes.io/projected/21103aa0-66f4-446b-b377-d3bac5973c2e-kube-api-access-bq78l\") pod \"payload-pre-processing-7b98bb678c-55qkv\" (UID: \"21103aa0-66f4-446b-b377-d3bac5973c2e\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-55qkv" Oct 30 20:15:31.504519 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.504481 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5392a640-4770-4118-90de-fdeb9ce14da1-plugins-config-volume\") pod \"payload-processing-5f78687d5b-sztc2\" (UID: \"5392a640-4770-4118-90de-fdeb9ce14da1\") " pod="openshift-ingress/payload-processing-5f78687d5b-sztc2" Oct 30 20:15:31.504519 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.504512 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9fcb\" (UniqueName: \"kubernetes.io/projected/5392a640-4770-4118-90de-fdeb9ce14da1-kube-api-access-j9fcb\") pod \"payload-processing-5f78687d5b-sztc2\" (UID: \"5392a640-4770-4118-90de-fdeb9ce14da1\") " pod="openshift-ingress/payload-processing-5f78687d5b-sztc2" Oct 30 20:15:31.605720 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.605688 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9fcb\" (UniqueName: \"kubernetes.io/projected/5392a640-4770-4118-90de-fdeb9ce14da1-kube-api-access-j9fcb\") pod \"payload-processing-5f78687d5b-sztc2\" (UID: \"5392a640-4770-4118-90de-fdeb9ce14da1\") " pod="openshift-ingress/payload-processing-5f78687d5b-sztc2" Oct 30 20:15:31.605894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.605741 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21103aa0-66f4-446b-b377-d3bac5973c2e-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-55qkv\" (UID: \"21103aa0-66f4-446b-b377-d3bac5973c2e\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-55qkv" Oct 30 20:15:31.605894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.605767 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq78l\" (UniqueName: \"kubernetes.io/projected/21103aa0-66f4-446b-b377-d3bac5973c2e-kube-api-access-bq78l\") pod \"payload-pre-processing-7b98bb678c-55qkv\" (UID: \"21103aa0-66f4-446b-b377-d3bac5973c2e\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-55qkv" Oct 30 20:15:31.606012 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.605940 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5392a640-4770-4118-90de-fdeb9ce14da1-plugins-config-volume\") pod \"payload-processing-5f78687d5b-sztc2\" (UID: \"5392a640-4770-4118-90de-fdeb9ce14da1\") " pod="openshift-ingress/payload-processing-5f78687d5b-sztc2" Oct 30 20:15:31.606654 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.606634 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5392a640-4770-4118-90de-fdeb9ce14da1-plugins-config-volume\") pod \"payload-processing-5f78687d5b-sztc2\" (UID: \"5392a640-4770-4118-90de-fdeb9ce14da1\") " pod="openshift-ingress/payload-processing-5f78687d5b-sztc2" Oct 30 20:15:31.606724 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.606704 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21103aa0-66f4-446b-b377-d3bac5973c2e-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-55qkv\" (UID: \"21103aa0-66f4-446b-b377-d3bac5973c2e\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-55qkv" Oct 30 20:15:31.622415 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.622355 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9fcb\" (UniqueName: \"kubernetes.io/projected/5392a640-4770-4118-90de-fdeb9ce14da1-kube-api-access-j9fcb\") pod \"payload-processing-5f78687d5b-sztc2\" (UID: \"5392a640-4770-4118-90de-fdeb9ce14da1\") " pod="openshift-ingress/payload-processing-5f78687d5b-sztc2" Oct 30 20:15:31.622415 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.622377 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq78l\" (UniqueName: \"kubernetes.io/projected/21103aa0-66f4-446b-b377-d3bac5973c2e-kube-api-access-bq78l\") pod \"payload-pre-processing-7b98bb678c-55qkv\" (UID: \"21103aa0-66f4-446b-b377-d3bac5973c2e\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-55qkv" Oct 30 20:15:31.688006 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.687968 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-55qkv" Oct 30 20:15:31.710651 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.710622 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-sztc2" Oct 30 20:15:31.966300 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:31.966274 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-55qkv"] Oct 30 20:15:31.969044 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:15:31.969015 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21103aa0_66f4_446b_b377_d3bac5973c2e.slice/crio-431c208e3d71a963e82deec006cb099df889a29dd3a7397c9c2aa9f0c0f8d005 WatchSource:0}: Error finding container 431c208e3d71a963e82deec006cb099df889a29dd3a7397c9c2aa9f0c0f8d005: Status 404 returned error can't find the container with id 431c208e3d71a963e82deec006cb099df889a29dd3a7397c9c2aa9f0c0f8d005 Oct 30 20:15:32.004154 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:32.004128 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-sztc2"] Oct 30 20:15:32.005548 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:15:32.005509 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5392a640_4770_4118_90de_fdeb9ce14da1.slice/crio-1b4280c64c5836f6ef76881a2d4db7bb42fe752a40daf4319e69267f2bf1a2bd WatchSource:0}: Error finding container 1b4280c64c5836f6ef76881a2d4db7bb42fe752a40daf4319e69267f2bf1a2bd: Status 404 returned error can't find the container with id 1b4280c64c5836f6ef76881a2d4db7bb42fe752a40daf4319e69267f2bf1a2bd Oct 30 20:15:32.140812 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:32.140769 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-sztc2" event={"ID":"5392a640-4770-4118-90de-fdeb9ce14da1","Type":"ContainerStarted","Data":"1b4280c64c5836f6ef76881a2d4db7bb42fe752a40daf4319e69267f2bf1a2bd"} Oct 30 20:15:32.141983 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:32.141951 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-55qkv" event={"ID":"21103aa0-66f4-446b-b377-d3bac5973c2e","Type":"ContainerStarted","Data":"431c208e3d71a963e82deec006cb099df889a29dd3a7397c9c2aa9f0c0f8d005"} Oct 30 20:15:35.166213 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:35.166179 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-sztc2" event={"ID":"5392a640-4770-4118-90de-fdeb9ce14da1","Type":"ContainerStarted","Data":"4542d5ce364aeac2d9b366246e38c5786564f58a45da04a104c8f6b1571fbe30"} Oct 30 20:15:35.166718 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:35.166288 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5f78687d5b-sztc2" Oct 30 20:15:35.167909 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:35.167880 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-55qkv" event={"ID":"21103aa0-66f4-446b-b377-d3bac5973c2e","Type":"ContainerStarted","Data":"2a47aeda7b217ed8be0dde336ade27a720ba9d3edda3e45ea6480d368fe00d87"} Oct 30 20:15:35.168016 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:35.167981 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-55qkv" Oct 30 20:15:35.206025 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:35.205976 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5f78687d5b-sztc2" podStartSLOduration=1.776214148 podStartE2EDuration="4.205962443s" totalImagesPullingTime="2.429748295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:15:35.185869345 +0000 UTC m=+709.719141938" watchObservedRunningTime="2026-10-30 20:15:35.205962443 +0000 UTC m=+709.739235063" Oct 30 20:15:35.206341 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:35.206309 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-55qkv" podStartSLOduration=1.772542295 podStartE2EDuration="4.20630493s" totalImagesPullingTime="2.433762635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:15:35.205000162 +0000 UTC m=+709.738272757" watchObservedRunningTime="2026-10-30 20:15:35.20630493 +0000 UTC m=+709.739577524" Oct 30 20:15:41.138138 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:41.138108 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s" Oct 30 20:15:41.416989 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:41.416910 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-6f69558f77-dxrdp"] Oct 30 20:15:41.420939 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:41.420918 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6f69558f77-dxrdp" Oct 30 20:15:41.430277 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:41.430248 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-6f69558f77-dxrdp"] Oct 30 20:15:41.506050 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:41.506017 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b266ac29-fd57-49a6-acc5-e67aba37864d-metrics-certs\") pod \"ai-gateway-controller-6f69558f77-dxrdp\" (UID: \"b266ac29-fd57-49a6-acc5-e67aba37864d\") " pod="opendatahub/ai-gateway-controller-6f69558f77-dxrdp" Oct 30 20:15:41.506203 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:41.506070 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtvp4\" (UniqueName: \"kubernetes.io/projected/b266ac29-fd57-49a6-acc5-e67aba37864d-kube-api-access-dtvp4\") pod \"ai-gateway-controller-6f69558f77-dxrdp\" (UID: \"b266ac29-fd57-49a6-acc5-e67aba37864d\") " pod="opendatahub/ai-gateway-controller-6f69558f77-dxrdp" Oct 30 20:15:41.607338 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:41.607307 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b266ac29-fd57-49a6-acc5-e67aba37864d-metrics-certs\") pod \"ai-gateway-controller-6f69558f77-dxrdp\" (UID: \"b266ac29-fd57-49a6-acc5-e67aba37864d\") " pod="opendatahub/ai-gateway-controller-6f69558f77-dxrdp" Oct 30 20:15:41.607512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:41.607381 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtvp4\" (UniqueName: \"kubernetes.io/projected/b266ac29-fd57-49a6-acc5-e67aba37864d-kube-api-access-dtvp4\") pod \"ai-gateway-controller-6f69558f77-dxrdp\" (UID: \"b266ac29-fd57-49a6-acc5-e67aba37864d\") " pod="opendatahub/ai-gateway-controller-6f69558f77-dxrdp" Oct 30 20:15:41.609715 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:41.609693 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b266ac29-fd57-49a6-acc5-e67aba37864d-metrics-certs\") pod \"ai-gateway-controller-6f69558f77-dxrdp\" (UID: \"b266ac29-fd57-49a6-acc5-e67aba37864d\") " pod="opendatahub/ai-gateway-controller-6f69558f77-dxrdp" Oct 30 20:15:41.620450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:41.620428 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtvp4\" (UniqueName: \"kubernetes.io/projected/b266ac29-fd57-49a6-acc5-e67aba37864d-kube-api-access-dtvp4\") pod \"ai-gateway-controller-6f69558f77-dxrdp\" (UID: \"b266ac29-fd57-49a6-acc5-e67aba37864d\") " pod="opendatahub/ai-gateway-controller-6f69558f77-dxrdp" Oct 30 20:15:41.735090 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:41.734997 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6f69558f77-dxrdp" Oct 30 20:15:42.012410 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:42.012383 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-6f69558f77-dxrdp"] Oct 30 20:15:42.014638 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:15:42.014603 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb266ac29_fd57_49a6_acc5_e67aba37864d.slice/crio-aece8069918fafb5d996ad4f46616de7523e73828d27afd890313076209f0407 WatchSource:0}: Error finding container aece8069918fafb5d996ad4f46616de7523e73828d27afd890313076209f0407: Status 404 returned error can't find the container with id aece8069918fafb5d996ad4f46616de7523e73828d27afd890313076209f0407 Oct 30 20:15:42.204980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:42.204945 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6f69558f77-dxrdp" event={"ID":"b266ac29-fd57-49a6-acc5-e67aba37864d","Type":"ContainerStarted","Data":"aece8069918fafb5d996ad4f46616de7523e73828d27afd890313076209f0407"} Oct 30 20:15:43.211260 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:43.211223 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6f69558f77-dxrdp" event={"ID":"b266ac29-fd57-49a6-acc5-e67aba37864d","Type":"ContainerStarted","Data":"cc8279a1b94d24e60b9476a4a152f06c9e0625eb4fcfa69b002381cfeb2d3260"} Oct 30 20:15:43.211693 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:43.211297 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-6f69558f77-dxrdp" Oct 30 20:15:43.231754 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:43.231708 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-6f69558f77-dxrdp" podStartSLOduration=1.8344005399999999 podStartE2EDuration="2.231694597s" totalImagesPullingTime="397.294057ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:15:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:15:43.230304947 +0000 UTC m=+717.763577541" watchObservedRunningTime="2026-10-30 20:15:43.231694597 +0000 UTC m=+717.764967221" Oct 30 20:15:46.176767 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:46.176739 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5f78687d5b-sztc2" Oct 30 20:15:46.177211 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:46.176805 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-55qkv" Oct 30 20:15:47.123779 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.123745 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr"] Oct 30 20:15:47.127793 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.127773 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.143601 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.143568 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr"] Oct 30 20:15:47.267119 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.267082 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.267551 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.267137 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-credential-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.267551 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.267213 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-token\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.267551 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.267262 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-data\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.267551 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.267286 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-workload-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.267551 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.267325 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-workload-certs\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.267551 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.267400 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw5cs\" (UniqueName: \"kubernetes.io/projected/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-kube-api-access-rw5cs\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.267551 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.267477 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-envoy\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.267551 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.267500 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-podinfo\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.368195 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.368153 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-workload-certs\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.368195 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.368197 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw5cs\" (UniqueName: \"kubernetes.io/projected/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-kube-api-access-rw5cs\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.368503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.368232 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-envoy\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.368503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.368254 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-podinfo\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.368503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.368278 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.368503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.368311 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-credential-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.368503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.368377 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-token\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.368503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.368410 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-data\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.368503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.368446 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-workload-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.368913 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.368596 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-workload-certs\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.368913 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.368753 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-workload-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.369028 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.368924 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-data\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.369028 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.368945 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-credential-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.369028 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.368990 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.370714 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.370688 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-envoy\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.370884 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.370868 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-podinfo\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.382027 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.381957 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-token\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.382138 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.382089 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw5cs\" (UniqueName: \"kubernetes.io/projected/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-kube-api-access-rw5cs\") pod \"maas-default-gateway-openshift-default-64d4cc998c-g8slr\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.444612 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.444571 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:47.728438 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.728409 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr"] Oct 30 20:15:47.730050 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:15:47.730022 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0abd4e01_5d55_4e34_976a_8e6e7e1252ad.slice/crio-db3a1e6790ec50a5feba205799b415a47d8a0d2000863152db752e5c1d7eaefc WatchSource:0}: Error finding container db3a1e6790ec50a5feba205799b415a47d8a0d2000863152db752e5c1d7eaefc: Status 404 returned error can't find the container with id db3a1e6790ec50a5feba205799b415a47d8a0d2000863152db752e5c1d7eaefc Oct 30 20:15:47.732357 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.732306 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:15:47.732434 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.732390 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:15:47.732434 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:47.732421 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:15:48.252090 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:48.251543 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" event={"ID":"0abd4e01-5d55-4e34-976a-8e6e7e1252ad","Type":"ContainerStarted","Data":"42021895e28fd8ebb50d94f17043ad48099bc60e6dda35ec34a6ebed05b7d125"} Oct 30 20:15:48.252090 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:48.251654 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" event={"ID":"0abd4e01-5d55-4e34-976a-8e6e7e1252ad","Type":"ContainerStarted","Data":"db3a1e6790ec50a5feba205799b415a47d8a0d2000863152db752e5c1d7eaefc"} Oct 30 20:15:48.278015 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:48.277956 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" podStartSLOduration=1.277940974 podStartE2EDuration="1.277940974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:15:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:15:48.276952905 +0000 UTC m=+722.810225498" watchObservedRunningTime="2026-10-30 20:15:48.277940974 +0000 UTC m=+722.811213568" Oct 30 20:15:48.447179 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:48.447141 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:48.447561 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:48.447538 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-g8slr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Oct 30 20:15:48.447727 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:48.447701 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" podUID="0abd4e01-5d55-4e34-976a-8e6e7e1252ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Oct 30 20:15:49.446353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:49.445809 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-g8slr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Oct 30 20:15:49.446353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:49.445873 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" podUID="0abd4e01-5d55-4e34-976a-8e6e7e1252ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Oct 30 20:15:50.452201 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:50.451732 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-g8slr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Oct 30 20:15:50.452201 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:50.451795 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" podUID="0abd4e01-5d55-4e34-976a-8e6e7e1252ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Oct 30 20:15:51.449790 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:51.449749 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-g8slr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Oct 30 20:15:51.450118 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:51.450070 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" podUID="0abd4e01-5d55-4e34-976a-8e6e7e1252ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Oct 30 20:15:52.450352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:52.445737 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-g8slr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Oct 30 20:15:52.450352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:52.445801 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" podUID="0abd4e01-5d55-4e34-976a-8e6e7e1252ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Oct 30 20:15:53.453722 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:53.453686 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-g8slr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Oct 30 20:15:53.454185 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:53.453745 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" podUID="0abd4e01-5d55-4e34-976a-8e6e7e1252ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Oct 30 20:15:54.219170 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:54.219138 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-6f69558f77-dxrdp" Oct 30 20:15:54.275008 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:54.274973 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s"] Oct 30 20:15:54.275264 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:54.275237 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s" podUID="4a1d39c2-23ed-49e4-b188-1f876dac11b5" containerName="manager" containerID="cri-o://df3b3ba9ff06577ad7c8811888c32046563c7442723e3745212a03e3eda509d9" gracePeriod=30 Oct 30 20:15:54.445961 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:54.445921 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-g8slr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Oct 30 20:15:54.446122 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:54.445998 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" podUID="0abd4e01-5d55-4e34-976a-8e6e7e1252ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Oct 30 20:15:54.533408 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:54.533385 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s" Oct 30 20:15:54.627909 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:54.627851 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4a1d39c2-23ed-49e4-b188-1f876dac11b5-kube-api-access-jshf7\" (UniqueName: \"kubernetes.io/projected/4a1d39c2-23ed-49e4-b188-1f876dac11b5-kube-api-access-jshf7\") pod \"4a1d39c2-23ed-49e4-b188-1f876dac11b5\" (UID: \"4a1d39c2-23ed-49e4-b188-1f876dac11b5\") " Oct 30 20:15:54.628096 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:54.628021 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4a1d39c2-23ed-49e4-b188-1f876dac11b5-metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a1d39c2-23ed-49e4-b188-1f876dac11b5-metrics-certs\") pod \"4a1d39c2-23ed-49e4-b188-1f876dac11b5\" (UID: \"4a1d39c2-23ed-49e4-b188-1f876dac11b5\") " Oct 30 20:15:54.629990 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:54.629954 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a1d39c2-23ed-49e4-b188-1f876dac11b5-metrics-certs" pod "4a1d39c2-23ed-49e4-b188-1f876dac11b5" (UID: "4a1d39c2-23ed-49e4-b188-1f876dac11b5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:15:54.630096 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:54.630031 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a1d39c2-23ed-49e4-b188-1f876dac11b5-kube-api-access-jshf7" pod "4a1d39c2-23ed-49e4-b188-1f876dac11b5" (UID: "4a1d39c2-23ed-49e4-b188-1f876dac11b5"). InnerVolumeSpecName "kube-api-access-jshf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:15:54.728732 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:54.728687 5078 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a1d39c2-23ed-49e4-b188-1f876dac11b5-metrics-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:15:54.728732 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:54.728730 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jshf7\" (UniqueName: \"kubernetes.io/projected/4a1d39c2-23ed-49e4-b188-1f876dac11b5-kube-api-access-jshf7\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:15:55.293632 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:55.293593 5078 generic.go:356] "Generic (PLEG): container finished" podID="4a1d39c2-23ed-49e4-b188-1f876dac11b5" containerID="df3b3ba9ff06577ad7c8811888c32046563c7442723e3745212a03e3eda509d9" exitCode=0 Oct 30 20:15:55.293818 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:55.293638 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s" Oct 30 20:15:55.293818 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:55.293688 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s" event={"ID":"4a1d39c2-23ed-49e4-b188-1f876dac11b5","Type":"ContainerDied","Data":"df3b3ba9ff06577ad7c8811888c32046563c7442723e3745212a03e3eda509d9"} Oct 30 20:15:55.293818 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:55.293746 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s" event={"ID":"4a1d39c2-23ed-49e4-b188-1f876dac11b5","Type":"ContainerDied","Data":"ebfa94964f2a5bc21771bed4c04fc996674eb7605c5739562329c60743635620"} Oct 30 20:15:55.293818 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:55.293776 5078 scope.go:122] "RemoveContainer" containerID="df3b3ba9ff06577ad7c8811888c32046563c7442723e3745212a03e3eda509d9" Oct 30 20:15:55.305176 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:55.305157 5078 scope.go:122] "RemoveContainer" containerID="df3b3ba9ff06577ad7c8811888c32046563c7442723e3745212a03e3eda509d9" Oct 30 20:15:55.305451 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:15:55.305428 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df3b3ba9ff06577ad7c8811888c32046563c7442723e3745212a03e3eda509d9\": container with ID starting with df3b3ba9ff06577ad7c8811888c32046563c7442723e3745212a03e3eda509d9 not found: ID does not exist" containerID="df3b3ba9ff06577ad7c8811888c32046563c7442723e3745212a03e3eda509d9" Oct 30 20:15:55.305534 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:55.305459 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df3b3ba9ff06577ad7c8811888c32046563c7442723e3745212a03e3eda509d9"} err="failed to get container status \"df3b3ba9ff06577ad7c8811888c32046563c7442723e3745212a03e3eda509d9\": rpc error: code = NotFound desc = could not find container \"df3b3ba9ff06577ad7c8811888c32046563c7442723e3745212a03e3eda509d9\": container with ID starting with df3b3ba9ff06577ad7c8811888c32046563c7442723e3745212a03e3eda509d9 not found: ID does not exist" Oct 30 20:15:55.318061 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:55.318035 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s"] Oct 30 20:15:55.325078 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:55.325045 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-5d9cd99f45-9fg8s"] Oct 30 20:15:55.586500 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:55.586464 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4a1d39c2-23ed-49e4-b188-1f876dac11b5" path="/var/lib/kubelet/pods/4a1d39c2-23ed-49e4-b188-1f876dac11b5/volumes" Oct 30 20:15:55.950729 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:55.950642 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:55.951055 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:55.951032 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:55.951740 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:15:55.951722 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:15:56.698870 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:15:56.698832 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:16:02.175907 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.175873 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj"] Oct 30 20:16:02.176562 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.176503 5078 cpu_manager.go:414] "containerMap: removing container" podUID="4a1d39c2-23ed-49e4-b188-1f876dac11b5" containerName="manager" Oct 30 20:16:02.176562 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.176523 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4a1d39c2-23ed-49e4-b188-1f876dac11b5" containerName="manager" Oct 30 20:16:02.176698 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.176678 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="4a1d39c2-23ed-49e4-b188-1f876dac11b5" containerName="manager" Oct 30 20:16:02.183450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.183430 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.196628 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.196602 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj"] Oct 30 20:16:02.197868 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.197838 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97082e84-45d0-4ca4-b427-d703172d8671-credential-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.198013 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.197881 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97082e84-45d0-4ca4-b427-d703172d8671-workload-certs\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.198013 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.197942 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhgjl\" (UniqueName: \"kubernetes.io/projected/97082e84-45d0-4ca4-b427-d703172d8671-kube-api-access-fhgjl\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.198197 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.198127 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97082e84-45d0-4ca4-b427-d703172d8671-istio-envoy\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.198253 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.198209 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97082e84-45d0-4ca4-b427-d703172d8671-istio-podinfo\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.198253 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.198228 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97082e84-45d0-4ca4-b427-d703172d8671-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.198424 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.198251 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97082e84-45d0-4ca4-b427-d703172d8671-workload-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.198424 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.198280 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97082e84-45d0-4ca4-b427-d703172d8671-istio-data\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.198424 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.198360 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97082e84-45d0-4ca4-b427-d703172d8671-istio-token\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.299754 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.299716 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97082e84-45d0-4ca4-b427-d703172d8671-istio-data\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.299952 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.299782 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97082e84-45d0-4ca4-b427-d703172d8671-istio-token\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.299952 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.299858 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97082e84-45d0-4ca4-b427-d703172d8671-credential-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.299952 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.299881 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97082e84-45d0-4ca4-b427-d703172d8671-workload-certs\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.299952 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.299934 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhgjl\" (UniqueName: \"kubernetes.io/projected/97082e84-45d0-4ca4-b427-d703172d8671-kube-api-access-fhgjl\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.300163 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.299966 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97082e84-45d0-4ca4-b427-d703172d8671-istio-envoy\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.300163 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.300020 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97082e84-45d0-4ca4-b427-d703172d8671-istio-podinfo\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.300163 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.300048 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97082e84-45d0-4ca4-b427-d703172d8671-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.300163 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.300076 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97082e84-45d0-4ca4-b427-d703172d8671-workload-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.300418 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.300177 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97082e84-45d0-4ca4-b427-d703172d8671-istio-data\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.300418 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.300321 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97082e84-45d0-4ca4-b427-d703172d8671-credential-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.300540 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.300437 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97082e84-45d0-4ca4-b427-d703172d8671-workload-certs\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.300540 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.300494 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97082e84-45d0-4ca4-b427-d703172d8671-workload-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.300888 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.300864 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97082e84-45d0-4ca4-b427-d703172d8671-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.302282 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.302263 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97082e84-45d0-4ca4-b427-d703172d8671-istio-envoy\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.302631 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.302612 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97082e84-45d0-4ca4-b427-d703172d8671-istio-podinfo\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.312918 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.312897 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97082e84-45d0-4ca4-b427-d703172d8671-istio-token\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.313251 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.313229 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhgjl\" (UniqueName: \"kubernetes.io/projected/97082e84-45d0-4ca4-b427-d703172d8671-kube-api-access-fhgjl\") pod \"maas-default-gateway-openshift-default-64d4cc998c-4p5zj\" (UID: \"97082e84-45d0-4ca4-b427-d703172d8671\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.499952 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.499867 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:02.783560 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.783529 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj"] Oct 30 20:16:02.785162 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:16:02.785128 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97082e84_45d0_4ca4_b427_d703172d8671.slice/crio-0e90491f1f7026b81323c1f16bb62471970bb420d126af5ab804cbc4212c7572 WatchSource:0}: Error finding container 0e90491f1f7026b81323c1f16bb62471970bb420d126af5ab804cbc4212c7572: Status 404 returned error can't find the container with id 0e90491f1f7026b81323c1f16bb62471970bb420d126af5ab804cbc4212c7572 Oct 30 20:16:02.787361 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.787314 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:02.787448 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.787393 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:02.787448 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:02.787440 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:03.359555 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:03.359520 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" event={"ID":"97082e84-45d0-4ca4-b427-d703172d8671","Type":"ContainerStarted","Data":"1da72cb41502db3377cfaa8c13f210839a229ce87613b92228b436c6d351d5c7"} Oct 30 20:16:03.359964 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:03.359573 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" event={"ID":"97082e84-45d0-4ca4-b427-d703172d8671","Type":"ContainerStarted","Data":"0e90491f1f7026b81323c1f16bb62471970bb420d126af5ab804cbc4212c7572"} Oct 30 20:16:03.386701 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:03.386658 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" podStartSLOduration=1.386645515 podStartE2EDuration="1.386645515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:16:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:16:03.383927483 +0000 UTC m=+737.917200078" watchObservedRunningTime="2026-10-30 20:16:03.386645515 +0000 UTC m=+737.919918108" Oct 30 20:16:03.500863 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:03.500822 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:03.502373 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:03.502321 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-4p5zj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Oct 30 20:16:03.502516 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:03.502415 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" podUID="97082e84-45d0-4ca4-b427-d703172d8671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Oct 30 20:16:04.500142 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:04.500108 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-4p5zj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Oct 30 20:16:04.500585 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:04.500162 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" podUID="97082e84-45d0-4ca4-b427-d703172d8671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Oct 30 20:16:05.500914 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:05.500878 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-4p5zj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Oct 30 20:16:05.501451 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:05.500932 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" podUID="97082e84-45d0-4ca4-b427-d703172d8671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Oct 30 20:16:06.500531 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:06.500496 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-4p5zj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Oct 30 20:16:06.500713 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:06.500550 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" podUID="97082e84-45d0-4ca4-b427-d703172d8671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Oct 30 20:16:07.500759 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:07.500723 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-4p5zj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Oct 30 20:16:07.501205 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:07.500798 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" podUID="97082e84-45d0-4ca4-b427-d703172d8671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Oct 30 20:16:08.500719 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:08.500684 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-4p5zj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Oct 30 20:16:08.500908 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:08.500737 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" podUID="97082e84-45d0-4ca4-b427-d703172d8671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Oct 30 20:16:09.501195 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:09.501156 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-4p5zj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Oct 30 20:16:09.501654 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:09.501221 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" podUID="97082e84-45d0-4ca4-b427-d703172d8671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Oct 30 20:16:11.054090 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:11.054057 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:11.054601 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:11.054438 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:11.055509 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:11.055487 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" Oct 30 20:16:17.194889 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.194851 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6"] Oct 30 20:16:17.202624 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.202596 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.224646 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.213594 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6"] Oct 30 20:16:17.269774 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.269734 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-credential-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.269936 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.269781 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7m6v\" (UniqueName: \"kubernetes.io/projected/585bc541-1d99-4500-80f2-4f224c638192-kube-api-access-v7m6v\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.269936 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.269884 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-istio-envoy\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.270023 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.269938 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/585bc541-1d99-4500-80f2-4f224c638192-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.270060 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.270031 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-workload-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.270125 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.270078 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-workload-certs\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.270189 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.270165 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-istio-data\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.270248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.270232 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/585bc541-1d99-4500-80f2-4f224c638192-istio-podinfo\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.270302 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.270269 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/585bc541-1d99-4500-80f2-4f224c638192-istio-token\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.370843 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.370806 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-istio-envoy\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.371027 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.370863 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/585bc541-1d99-4500-80f2-4f224c638192-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.371027 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.370896 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-workload-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.371027 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.370929 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-workload-certs\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.371027 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.370957 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-istio-data\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.371027 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.370999 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/585bc541-1d99-4500-80f2-4f224c638192-istio-podinfo\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.371306 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.371028 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/585bc541-1d99-4500-80f2-4f224c638192-istio-token\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.371306 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.371100 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-credential-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.371306 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.371125 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7m6v\" (UniqueName: \"kubernetes.io/projected/585bc541-1d99-4500-80f2-4f224c638192-kube-api-access-v7m6v\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.371873 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.371412 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-workload-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.371873 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.371480 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-workload-certs\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.371873 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.371494 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-istio-data\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.371873 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.371690 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-credential-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.371873 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.371782 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/585bc541-1d99-4500-80f2-4f224c638192-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.373154 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.373128 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-istio-envoy\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.373502 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.373483 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/585bc541-1d99-4500-80f2-4f224c638192-istio-podinfo\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.384452 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.384430 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/585bc541-1d99-4500-80f2-4f224c638192-istio-token\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.384586 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.384467 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7m6v\" (UniqueName: \"kubernetes.io/projected/585bc541-1d99-4500-80f2-4f224c638192-kube-api-access-v7m6v\") pod \"maas-default-gateway-openshift-default-64d4cc998c-k7hx6\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.529554 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.529472 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:17.813722 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.813696 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6"] Oct 30 20:16:17.815609 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:16:17.815580 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585bc541_1d99_4500_80f2_4f224c638192.slice/crio-37611252e0320c0f3284fcaff031a7defc5a1b8f6c20aff00c6ddc8d85f8079b WatchSource:0}: Error finding container 37611252e0320c0f3284fcaff031a7defc5a1b8f6c20aff00c6ddc8d85f8079b: Status 404 returned error can't find the container with id 37611252e0320c0f3284fcaff031a7defc5a1b8f6c20aff00c6ddc8d85f8079b Oct 30 20:16:17.817686 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.817654 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:17.817753 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.817720 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:17.817792 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:17.817753 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:18.458437 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:18.458401 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" event={"ID":"585bc541-1d99-4500-80f2-4f224c638192","Type":"ContainerStarted","Data":"9d41b13678f4673a1379811be2a9ba9dd141de2179e64de1004e9cb6366722ed"} Oct 30 20:16:18.459103 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:18.458458 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" event={"ID":"585bc541-1d99-4500-80f2-4f224c638192","Type":"ContainerStarted","Data":"37611252e0320c0f3284fcaff031a7defc5a1b8f6c20aff00c6ddc8d85f8079b"} Oct 30 20:16:18.484324 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:18.484275 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" podStartSLOduration=1.484260945 podStartE2EDuration="1.484260945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:16:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:16:18.482598713 +0000 UTC m=+753.015871318" watchObservedRunningTime="2026-10-30 20:16:18.484260945 +0000 UTC m=+753.017533538" Oct 30 20:16:18.549397 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:18.533711 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:18.553507 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:18.553472 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-k7hx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Oct 30 20:16:18.553704 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:18.553530 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" podUID="585bc541-1d99-4500-80f2-4f224c638192" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Oct 30 20:16:19.553467 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:19.553430 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-k7hx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Oct 30 20:16:19.553874 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:19.553487 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" podUID="585bc541-1d99-4500-80f2-4f224c638192" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Oct 30 20:16:20.550352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:20.549764 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-k7hx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Oct 30 20:16:20.550352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:20.549831 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" podUID="585bc541-1d99-4500-80f2-4f224c638192" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Oct 30 20:16:21.553473 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:21.553437 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-k7hx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Oct 30 20:16:21.553876 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:21.553493 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" podUID="585bc541-1d99-4500-80f2-4f224c638192" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Oct 30 20:16:22.549358 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:22.536741 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-k7hx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Oct 30 20:16:22.549358 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:22.536803 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" podUID="585bc541-1d99-4500-80f2-4f224c638192" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Oct 30 20:16:23.530814 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:23.530776 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-k7hx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Oct 30 20:16:23.531466 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:23.531434 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" podUID="585bc541-1d99-4500-80f2-4f224c638192" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Oct 30 20:16:23.993638 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:23.993555 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh"] Oct 30 20:16:23.998166 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:23.998109 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.015611 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.015576 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-5197ec-openshift-default-dockercfg-fvmqh\"" Oct 30 20:16:24.020778 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.020677 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh"] Oct 30 20:16:24.097318 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.097276 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk"] Oct 30 20:16:24.107603 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.107567 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.117480 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.115264 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-124fd1-openshift-default-dockercfg-n5plt\"" Oct 30 20:16:24.117480 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.117297 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk"] Oct 30 20:16:24.163798 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.163767 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khtxx\" (UniqueName: \"kubernetes.io/projected/8db14715-2a34-4191-8764-c9cfd82abcec-kube-api-access-khtxx\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.164002 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.163823 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-credential-socket\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.164002 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.163932 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8db14715-2a34-4191-8764-c9cfd82abcec-istio-token\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.164002 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.163995 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8db14715-2a34-4191-8764-c9cfd82abcec-istiod-ca-cert\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.164173 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.164023 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8db14715-2a34-4191-8764-c9cfd82abcec-istio-podinfo\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.164173 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.164082 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-workload-certs\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.164173 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.164115 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-istio-data\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.164173 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.164153 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-workload-socket\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.164387 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.164191 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-istio-envoy\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.265226 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.265129 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-workload-socket\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.265226 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.265192 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-istio-envoy\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.265226 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.265219 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-token\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.265537 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.265244 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-workload-socket\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.265537 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.265420 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-workload-certs\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.265537 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.265472 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khtxx\" (UniqueName: \"kubernetes.io/projected/8db14715-2a34-4191-8764-c9cfd82abcec-kube-api-access-khtxx\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.265537 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.265528 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-credential-socket\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.265748 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.265567 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-workload-socket\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.265748 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.265572 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pcz6\" (UniqueName: \"kubernetes.io/projected/a27e1ae4-d40d-4dc8-8d6f-588f38901365-kube-api-access-6pcz6\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.265748 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.265639 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-credential-socket\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.265748 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.265674 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-podinfo\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.265748 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.265709 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8db14715-2a34-4191-8764-c9cfd82abcec-istio-token\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.266007 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.265809 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8db14715-2a34-4191-8764-c9cfd82abcec-istiod-ca-cert\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.266007 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.265837 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-credential-socket\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.266007 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.265856 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-envoy\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.266007 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.265886 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8db14715-2a34-4191-8764-c9cfd82abcec-istio-podinfo\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.266007 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.265921 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istiod-ca-cert\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.266007 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.265965 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-data\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.266007 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.266000 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-workload-certs\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.266410 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.266030 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-istio-data\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.266410 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.266350 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-workload-certs\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.266521 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.266462 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-istio-data\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.266521 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.266497 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8db14715-2a34-4191-8764-c9cfd82abcec-istiod-ca-cert\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.267670 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.267648 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-istio-envoy\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.268568 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.268543 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8db14715-2a34-4191-8764-c9cfd82abcec-istio-podinfo\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.279553 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.279529 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8db14715-2a34-4191-8764-c9cfd82abcec-istio-token\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.279755 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.279734 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khtxx\" (UniqueName: \"kubernetes.io/projected/8db14715-2a34-4191-8764-c9cfd82abcec-kube-api-access-khtxx\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.320708 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.320573 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:24.369945 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.369896 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-workload-certs\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.380512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.369983 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pcz6\" (UniqueName: \"kubernetes.io/projected/a27e1ae4-d40d-4dc8-8d6f-588f38901365-kube-api-access-6pcz6\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.380512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.370022 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-credential-socket\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.380512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.370051 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-podinfo\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.380512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.370103 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-envoy\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.380512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.370156 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istiod-ca-cert\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.380512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.370184 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-data\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.380512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.370256 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-token\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.380512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.370293 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-workload-socket\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.380512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.370788 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-workload-socket\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.380512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.371061 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-workload-certs\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.380512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.371651 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-credential-socket\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.380512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.372634 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-data\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.381192 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.380802 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istiod-ca-cert\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.387369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.387321 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pcz6\" (UniqueName: \"kubernetes.io/projected/a27e1ae4-d40d-4dc8-8d6f-588f38901365-kube-api-access-6pcz6\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.388026 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.387965 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-token\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.392072 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.392047 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-envoy\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.400792 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.400426 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-podinfo\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.431106 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.431039 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:24.470038 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.469918 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l"] Oct 30 20:16:24.476275 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.476241 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.505154 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.505082 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l"] Oct 30 20:16:24.505583 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.505547 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-9c901b-openshift-default-dockercfg-hnkkz\"" Oct 30 20:16:24.570434 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.569251 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-k7hx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Oct 30 20:16:24.570434 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.569319 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" podUID="585bc541-1d99-4500-80f2-4f224c638192" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Oct 30 20:16:24.582078 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.574399 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25da5733-edc7-4a62-bc21-dbe63273deed-istio-podinfo\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.582078 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.574471 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwbwt\" (UniqueName: \"kubernetes.io/projected/25da5733-edc7-4a62-bc21-dbe63273deed-kube-api-access-fwbwt\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.582078 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.574535 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-credential-socket\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.582078 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.574578 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-workload-socket\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.582078 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.574630 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25da5733-edc7-4a62-bc21-dbe63273deed-istiod-ca-cert\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.582078 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.574663 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-istio-envoy\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.582078 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.574714 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-workload-certs\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.582078 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.574753 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-istio-data\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.582078 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.574817 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25da5733-edc7-4a62-bc21-dbe63273deed-istio-token\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.677874 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.677554 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25da5733-edc7-4a62-bc21-dbe63273deed-istiod-ca-cert\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.677874 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.677607 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-istio-envoy\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.677874 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.677666 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-workload-certs\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.677874 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.677702 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-istio-data\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.677874 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.677781 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25da5733-edc7-4a62-bc21-dbe63273deed-istio-token\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.681908 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.678451 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25da5733-edc7-4a62-bc21-dbe63273deed-istio-podinfo\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.681908 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.678532 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwbwt\" (UniqueName: \"kubernetes.io/projected/25da5733-edc7-4a62-bc21-dbe63273deed-kube-api-access-fwbwt\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.681908 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.678632 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-credential-socket\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.681908 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.678671 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-workload-socket\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.681908 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.679157 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-workload-socket\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.681908 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.680188 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25da5733-edc7-4a62-bc21-dbe63273deed-istiod-ca-cert\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.683070 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.683043 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-workload-certs\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.686703 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.683601 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-istio-data\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.686869 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.683845 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-istio-envoy\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.686969 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.686868 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25da5733-edc7-4a62-bc21-dbe63273deed-istio-podinfo\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.687154 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.687127 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-credential-socket\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.697277 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.697231 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr"] Oct 30 20:16:24.701779 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:16:24.701750 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8db14715_2a34_4191_8764_c9cfd82abcec.slice/crio-0808873b57f7c14c332d6047c3a3557d6125baafd06a7c63b6d46efe637a8438 WatchSource:0}: Error finding container 0808873b57f7c14c332d6047c3a3557d6125baafd06a7c63b6d46efe637a8438: Status 404 returned error can't find the container with id 0808873b57f7c14c332d6047c3a3557d6125baafd06a7c63b6d46efe637a8438 Oct 30 20:16:24.704018 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.703994 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh"] Oct 30 20:16:24.704133 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.704110 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.706183 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.706149 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:24.706266 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.706224 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:24.706324 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.706267 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:24.711783 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.711759 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25da5733-edc7-4a62-bc21-dbe63273deed-istio-token\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.712705 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.712673 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-44135b-openshift-default-dockercfg-sp9bd\"" Oct 30 20:16:24.714445 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.714392 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwbwt\" (UniqueName: \"kubernetes.io/projected/25da5733-edc7-4a62-bc21-dbe63273deed-kube-api-access-fwbwt\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.720839 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.720763 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr"] Oct 30 20:16:24.779941 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.779894 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-credential-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.780070 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.779973 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx57s\" (UniqueName: \"kubernetes.io/projected/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-kube-api-access-tx57s\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.780070 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.780008 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-data\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.780070 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.780055 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-envoy\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.780251 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.780140 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-token\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.780251 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.780188 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-workload-certs\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.780368 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.780264 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istiod-ca-cert\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.780368 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.780298 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-podinfo\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.780476 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.780375 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-workload-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.794532 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.794463 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk"] Oct 30 20:16:24.804443 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.803735 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:24.804443 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.803821 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:24.804443 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.803860 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:24.869593 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.869568 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:24.882033 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.882002 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-token\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.882246 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.882058 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-workload-certs\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.882246 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.882119 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istiod-ca-cert\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.882246 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.882148 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-podinfo\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.882246 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.882195 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-workload-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.882639 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.882252 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-credential-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.882639 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.882284 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx57s\" (UniqueName: \"kubernetes.io/projected/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-kube-api-access-tx57s\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.882639 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.882314 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-data\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.882639 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.882360 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-envoy\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.887780 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.886068 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-credential-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.887780 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.886293 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-workload-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.887780 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.887165 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istiod-ca-cert\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.887780 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.887620 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-data\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.888227 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.888201 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-envoy\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.888507 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.888486 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-workload-certs\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.888975 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.888956 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-podinfo\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.902618 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.902573 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-token\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:24.904361 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:24.904314 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx57s\" (UniqueName: \"kubernetes.io/projected/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-kube-api-access-tx57s\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:25.029755 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.029513 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:25.218402 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.218308 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l"] Oct 30 20:16:25.235997 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:16:25.235949 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25da5733_edc7_4a62_bc21_dbe63273deed.slice/crio-c1061d4c52fb81fe69e310f53e0c8ae768365efc7c6022d07e3d774cb57f8781 WatchSource:0}: Error finding container c1061d4c52fb81fe69e310f53e0c8ae768365efc7c6022d07e3d774cb57f8781: Status 404 returned error can't find the container with id c1061d4c52fb81fe69e310f53e0c8ae768365efc7c6022d07e3d774cb57f8781 Oct 30 20:16:25.239091 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.238704 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:25.239091 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.238776 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:25.239091 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.238810 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:25.414100 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.414060 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr"] Oct 30 20:16:25.419665 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:16:25.419631 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca42f8ad_24a9_4bec_9fcf_48582787f1c9.slice/crio-6296148b1ab5a6dd24bd4975bb3a8ad6105181d1eb7205f9acfe93395782e900 WatchSource:0}: Error finding container 6296148b1ab5a6dd24bd4975bb3a8ad6105181d1eb7205f9acfe93395782e900: Status 404 returned error can't find the container with id 6296148b1ab5a6dd24bd4975bb3a8ad6105181d1eb7205f9acfe93395782e900 Oct 30 20:16:25.422494 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.422460 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:25.422618 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.422528 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:25.422618 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.422560 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:25.530568 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.530537 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-k7hx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Oct 30 20:16:25.530734 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.530593 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" podUID="585bc541-1d99-4500-80f2-4f224c638192" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Oct 30 20:16:25.596411 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.596294 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" event={"ID":"ca42f8ad-24a9-4bec-9fcf-48582787f1c9","Type":"ContainerStarted","Data":"6a761981d861343f7414399ae4070e99f313534193b5c20527be54552fe42d6e"} Oct 30 20:16:25.597051 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.597008 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" event={"ID":"ca42f8ad-24a9-4bec-9fcf-48582787f1c9","Type":"ContainerStarted","Data":"6296148b1ab5a6dd24bd4975bb3a8ad6105181d1eb7205f9acfe93395782e900"} Oct 30 20:16:25.598196 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.598170 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" event={"ID":"a27e1ae4-d40d-4dc8-8d6f-588f38901365","Type":"ContainerStarted","Data":"e51c7e0a35ef62224e4bba342c177b0317ba970fddbcb0b650b97c0e5fbac82e"} Oct 30 20:16:25.598308 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.598216 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" event={"ID":"a27e1ae4-d40d-4dc8-8d6f-588f38901365","Type":"ContainerStarted","Data":"8ea9ede986186814d6d26a797dac6483aab726f19125e26ae8fd346416262c81"} Oct 30 20:16:25.600709 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.600499 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" event={"ID":"25da5733-edc7-4a62-bc21-dbe63273deed","Type":"ContainerStarted","Data":"74f60db9863d5ea001fb375abd6651c4eee7f4bbb836337c6a22296384349cae"} Oct 30 20:16:25.600709 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.600554 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" event={"ID":"25da5733-edc7-4a62-bc21-dbe63273deed","Type":"ContainerStarted","Data":"c1061d4c52fb81fe69e310f53e0c8ae768365efc7c6022d07e3d774cb57f8781"} Oct 30 20:16:25.602281 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.602261 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" event={"ID":"8db14715-2a34-4191-8764-c9cfd82abcec","Type":"ContainerStarted","Data":"baea419920171942f788ec03adb3b6b87556171bc77445e940b9a4fd2dd0b841"} Oct 30 20:16:25.602399 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.602301 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" event={"ID":"8db14715-2a34-4191-8764-c9cfd82abcec","Type":"ContainerStarted","Data":"0808873b57f7c14c332d6047c3a3557d6125baafd06a7c63b6d46efe637a8438"} Oct 30 20:16:25.622910 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.622819 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" podStartSLOduration=1.622799645 podStartE2EDuration="1.622799645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:16:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:16:25.620231167 +0000 UTC m=+760.153503761" watchObservedRunningTime="2026-10-30 20:16:25.622799645 +0000 UTC m=+760.156072240" Oct 30 20:16:25.649679 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.649627 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" podStartSLOduration=1.64961358 podStartE2EDuration="1.64961358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:16:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:16:25.648825561 +0000 UTC m=+760.182098152" watchObservedRunningTime="2026-10-30 20:16:25.64961358 +0000 UTC m=+760.182886174" Oct 30 20:16:25.675582 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.675532 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" podStartSLOduration=2.6755169739999998 podStartE2EDuration="2.675516974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:16:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:16:25.673143545 +0000 UTC m=+760.206416135" watchObservedRunningTime="2026-10-30 20:16:25.675516974 +0000 UTC m=+760.208789568" Oct 30 20:16:25.706293 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.706227 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" podStartSLOduration=1.7061942289999998 podStartE2EDuration="1.706194229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:16:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:16:25.703511729 +0000 UTC m=+760.236784394" watchObservedRunningTime="2026-10-30 20:16:25.706194229 +0000 UTC m=+760.239466824" Oct 30 20:16:25.874588 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:25.874445 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:26.035354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:26.035294 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:26.040693 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:26.040666 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:26.321601 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:26.321567 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:26.327048 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:26.327025 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:26.431580 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:26.431545 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:26.438027 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:26.438001 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:26.608609 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:26.608519 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:26.609147 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:26.609126 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:26.609294 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:26.609266 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:26.609738 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:26.609715 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:26.609842 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:26.609784 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:26.610274 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:26.610257 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:26.714274 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:26.713723 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:26.715635 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:26.715614 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:26.717226 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:26.717209 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:16:26.727592 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:16:26.727550 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:16:26.876523 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:26.876439 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:27.614133 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:27.614102 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:27.614961 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:27.614945 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:29.625095 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.625066 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl"] Oct 30 20:16:29.629014 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.628997 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl" Oct 30 20:16:29.637701 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.636827 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-9c901b\"" Oct 30 20:16:29.637701 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.636876 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-9c901b-dockercfg-nr6kr\"" Oct 30 20:16:29.640507 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.640482 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl"] Oct 30 20:16:29.672218 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.672184 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7"] Oct 30 20:16:29.676103 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.676081 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7" Oct 30 20:16:29.683965 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.683941 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqw98\" (UniqueName: \"kubernetes.io/projected/9f0b2906-f246-4b28-b48a-f50456e27840-kube-api-access-fqw98\") pod \"payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl\" (UID: \"9f0b2906-f246-4b28-b48a-f50456e27840\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl" Oct 30 20:16:29.684082 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.684065 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f0b2906-f246-4b28-b48a-f50456e27840-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl\" (UID: \"9f0b2906-f246-4b28-b48a-f50456e27840\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl" Oct 30 20:16:29.690372 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.690345 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7"] Oct 30 20:16:29.784913 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.784875 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqw98\" (UniqueName: \"kubernetes.io/projected/9f0b2906-f246-4b28-b48a-f50456e27840-kube-api-access-fqw98\") pod \"payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl\" (UID: \"9f0b2906-f246-4b28-b48a-f50456e27840\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl" Oct 30 20:16:29.785578 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.785552 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc623b5b-8385-4b36-82b7-4939ae2bf727-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7\" (UID: \"cc623b5b-8385-4b36-82b7-4939ae2bf727\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7" Oct 30 20:16:29.785817 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.785801 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4j76\" (UniqueName: \"kubernetes.io/projected/cc623b5b-8385-4b36-82b7-4939ae2bf727-kube-api-access-b4j76\") pod \"payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7\" (UID: \"cc623b5b-8385-4b36-82b7-4939ae2bf727\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7" Oct 30 20:16:29.786013 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.785996 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f0b2906-f246-4b28-b48a-f50456e27840-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl\" (UID: \"9f0b2906-f246-4b28-b48a-f50456e27840\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl" Oct 30 20:16:29.787142 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.786996 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f0b2906-f246-4b28-b48a-f50456e27840-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl\" (UID: \"9f0b2906-f246-4b28-b48a-f50456e27840\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl" Oct 30 20:16:29.820074 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.820044 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqw98\" (UniqueName: \"kubernetes.io/projected/9f0b2906-f246-4b28-b48a-f50456e27840-kube-api-access-fqw98\") pod \"payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl\" (UID: \"9f0b2906-f246-4b28-b48a-f50456e27840\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl" Oct 30 20:16:29.888301 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.888199 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc623b5b-8385-4b36-82b7-4939ae2bf727-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7\" (UID: \"cc623b5b-8385-4b36-82b7-4939ae2bf727\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7" Oct 30 20:16:29.888301 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.888270 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4j76\" (UniqueName: \"kubernetes.io/projected/cc623b5b-8385-4b36-82b7-4939ae2bf727-kube-api-access-b4j76\") pod \"payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7\" (UID: \"cc623b5b-8385-4b36-82b7-4939ae2bf727\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7" Oct 30 20:16:29.888937 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.888909 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc623b5b-8385-4b36-82b7-4939ae2bf727-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7\" (UID: \"cc623b5b-8385-4b36-82b7-4939ae2bf727\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7" Oct 30 20:16:29.900872 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.900847 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4j76\" (UniqueName: \"kubernetes.io/projected/cc623b5b-8385-4b36-82b7-4939ae2bf727-kube-api-access-b4j76\") pod \"payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7\" (UID: \"cc623b5b-8385-4b36-82b7-4939ae2bf727\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7" Oct 30 20:16:29.945594 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.945555 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl" Oct 30 20:16:29.991125 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:29.991097 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7" Oct 30 20:16:30.225538 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.225509 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl"] Oct 30 20:16:30.227073 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:16:30.227050 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f0b2906_f246_4b28_b48a_f50456e27840.slice/crio-d54d61b36a0f1044187bc6df2b620c5fb8877b99726d3fa8442975c3f6738241 WatchSource:0}: Error finding container d54d61b36a0f1044187bc6df2b620c5fb8877b99726d3fa8442975c3f6738241: Status 404 returned error can't find the container with id d54d61b36a0f1044187bc6df2b620c5fb8877b99726d3fa8442975c3f6738241 Oct 30 20:16:30.309491 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.309462 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7"] Oct 30 20:16:30.312575 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:16:30.312543 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc623b5b_8385_4b36_82b7_4939ae2bf727.slice/crio-015d2b9805c0f55384ff656475305fcf6e0d6e2c6c140a7a3716911d74899725 WatchSource:0}: Error finding container 015d2b9805c0f55384ff656475305fcf6e0d6e2c6c140a7a3716911d74899725: Status 404 returned error can't find the container with id 015d2b9805c0f55384ff656475305fcf6e0d6e2c6c140a7a3716911d74899725 Oct 30 20:16:30.319344 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.319307 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct"] Oct 30 20:16:30.325857 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.325834 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" Oct 30 20:16:30.337153 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.337132 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-44135b-serving-cert\"" Oct 30 20:16:30.354390 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.354364 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct"] Oct 30 20:16:30.394177 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.394149 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bc6c031-5ab7-4ff5-8c4a-13286258090f-maas-api-tls\") pod \"maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct\" (UID: \"2bc6c031-5ab7-4ff5-8c4a-13286258090f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" Oct 30 20:16:30.394312 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.394276 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bc6c031-5ab7-4ff5-8c4a-13286258090f-metrics-certs\") pod \"maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct\" (UID: \"2bc6c031-5ab7-4ff5-8c4a-13286258090f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" Oct 30 20:16:30.394412 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.394386 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsm9b\" (UniqueName: \"kubernetes.io/projected/2bc6c031-5ab7-4ff5-8c4a-13286258090f-kube-api-access-vsm9b\") pod \"maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct\" (UID: \"2bc6c031-5ab7-4ff5-8c4a-13286258090f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" Oct 30 20:16:30.394469 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.394436 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bc6c031-5ab7-4ff5-8c4a-13286258090f-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct\" (UID: \"2bc6c031-5ab7-4ff5-8c4a-13286258090f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" Oct 30 20:16:30.495883 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.495781 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsm9b\" (UniqueName: \"kubernetes.io/projected/2bc6c031-5ab7-4ff5-8c4a-13286258090f-kube-api-access-vsm9b\") pod \"maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct\" (UID: \"2bc6c031-5ab7-4ff5-8c4a-13286258090f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" Oct 30 20:16:30.495883 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.495828 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bc6c031-5ab7-4ff5-8c4a-13286258090f-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct\" (UID: \"2bc6c031-5ab7-4ff5-8c4a-13286258090f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" Oct 30 20:16:30.496138 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.495956 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bc6c031-5ab7-4ff5-8c4a-13286258090f-maas-api-tls\") pod \"maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct\" (UID: \"2bc6c031-5ab7-4ff5-8c4a-13286258090f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" Oct 30 20:16:30.496138 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.496042 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bc6c031-5ab7-4ff5-8c4a-13286258090f-metrics-certs\") pod \"maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct\" (UID: \"2bc6c031-5ab7-4ff5-8c4a-13286258090f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" Oct 30 20:16:30.496800 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.496768 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bc6c031-5ab7-4ff5-8c4a-13286258090f-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct\" (UID: \"2bc6c031-5ab7-4ff5-8c4a-13286258090f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" Oct 30 20:16:30.498589 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.498566 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bc6c031-5ab7-4ff5-8c4a-13286258090f-maas-api-tls\") pod \"maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct\" (UID: \"2bc6c031-5ab7-4ff5-8c4a-13286258090f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" Oct 30 20:16:30.498712 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.498629 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bc6c031-5ab7-4ff5-8c4a-13286258090f-metrics-certs\") pod \"maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct\" (UID: \"2bc6c031-5ab7-4ff5-8c4a-13286258090f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" Oct 30 20:16:30.514050 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.514016 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsm9b\" (UniqueName: \"kubernetes.io/projected/2bc6c031-5ab7-4ff5-8c4a-13286258090f-kube-api-access-vsm9b\") pod \"maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct\" (UID: \"2bc6c031-5ab7-4ff5-8c4a-13286258090f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" Oct 30 20:16:30.640758 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.640714 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl" event={"ID":"9f0b2906-f246-4b28-b48a-f50456e27840","Type":"ContainerStarted","Data":"01e2787fdbd597930cc58125f027258cb2e3b0bbc27bccd56d573da642a8976e"} Oct 30 20:16:30.641283 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.640784 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl" event={"ID":"9f0b2906-f246-4b28-b48a-f50456e27840","Type":"ContainerStarted","Data":"d54d61b36a0f1044187bc6df2b620c5fb8877b99726d3fa8442975c3f6738241"} Oct 30 20:16:30.641283 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.640983 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl" Oct 30 20:16:30.643214 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.643185 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7" event={"ID":"cc623b5b-8385-4b36-82b7-4939ae2bf727","Type":"ContainerStarted","Data":"ec09b333a624c226cf268b77dcf505469e467984d527ce5b047972347606550e"} Oct 30 20:16:30.643467 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.643444 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7" Oct 30 20:16:30.643594 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.643478 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7" event={"ID":"cc623b5b-8385-4b36-82b7-4939ae2bf727","Type":"ContainerStarted","Data":"015d2b9805c0f55384ff656475305fcf6e0d6e2c6c140a7a3716911d74899725"} Oct 30 20:16:30.658074 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.658045 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" Oct 30 20:16:30.662715 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.662663 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl" podStartSLOduration=1.662644383 podStartE2EDuration="1.662644383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:16:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:16:30.661568682 +0000 UTC m=+765.194841278" watchObservedRunningTime="2026-10-30 20:16:30.662644383 +0000 UTC m=+765.195916979" Oct 30 20:16:30.692255 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.692206 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7" podStartSLOduration=1.6921922 podStartE2EDuration="1.6921922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:16:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:16:30.689416873 +0000 UTC m=+765.222689470" watchObservedRunningTime="2026-10-30 20:16:30.6921922 +0000 UTC m=+765.225464788" Oct 30 20:16:30.939487 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:30.939461 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct"] Oct 30 20:16:30.941967 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:16:30.941941 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bc6c031_5ab7_4ff5_8c4a_13286258090f.slice/crio-5d5656cea780f6709232e8a87042a0d319297382a4d2a0f00ef00d622e233afa WatchSource:0}: Error finding container 5d5656cea780f6709232e8a87042a0d319297382a4d2a0f00ef00d622e233afa: Status 404 returned error can't find the container with id 5d5656cea780f6709232e8a87042a0d319297382a4d2a0f00ef00d622e233afa Oct 30 20:16:31.328202 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:31.328167 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s"] Oct 30 20:16:31.333755 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:31.333730 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" Oct 30 20:16:31.354438 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:31.354408 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s"] Oct 30 20:16:31.361442 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:31.361409 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-124fd1-serving-cert\"" Oct 30 20:16:31.428106 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:31.428075 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fee13d2-5043-487c-8940-8fb5e4682083-metrics-certs\") pod \"maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s\" (UID: \"5fee13d2-5043-487c-8940-8fb5e4682083\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" Oct 30 20:16:31.428305 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:31.428237 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fee13d2-5043-487c-8940-8fb5e4682083-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s\" (UID: \"5fee13d2-5043-487c-8940-8fb5e4682083\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" Oct 30 20:16:31.428373 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:31.428301 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqsh5\" (UniqueName: \"kubernetes.io/projected/5fee13d2-5043-487c-8940-8fb5e4682083-kube-api-access-gqsh5\") pod \"maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s\" (UID: \"5fee13d2-5043-487c-8940-8fb5e4682083\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" Oct 30 20:16:31.428528 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:31.428511 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fee13d2-5043-487c-8940-8fb5e4682083-maas-api-tls\") pod \"maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s\" (UID: \"5fee13d2-5043-487c-8940-8fb5e4682083\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" Oct 30 20:16:31.534408 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:31.534254 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fee13d2-5043-487c-8940-8fb5e4682083-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s\" (UID: \"5fee13d2-5043-487c-8940-8fb5e4682083\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" Oct 30 20:16:31.534408 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:31.534319 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqsh5\" (UniqueName: \"kubernetes.io/projected/5fee13d2-5043-487c-8940-8fb5e4682083-kube-api-access-gqsh5\") pod \"maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s\" (UID: \"5fee13d2-5043-487c-8940-8fb5e4682083\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" Oct 30 20:16:31.535515 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:31.534770 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fee13d2-5043-487c-8940-8fb5e4682083-maas-api-tls\") pod \"maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s\" (UID: \"5fee13d2-5043-487c-8940-8fb5e4682083\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" Oct 30 20:16:31.535515 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:31.534855 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fee13d2-5043-487c-8940-8fb5e4682083-metrics-certs\") pod \"maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s\" (UID: \"5fee13d2-5043-487c-8940-8fb5e4682083\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" Oct 30 20:16:31.535515 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:31.535451 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fee13d2-5043-487c-8940-8fb5e4682083-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s\" (UID: \"5fee13d2-5043-487c-8940-8fb5e4682083\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" Oct 30 20:16:31.544840 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:31.544810 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fee13d2-5043-487c-8940-8fb5e4682083-metrics-certs\") pod \"maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s\" (UID: \"5fee13d2-5043-487c-8940-8fb5e4682083\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" Oct 30 20:16:31.545709 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:31.545663 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fee13d2-5043-487c-8940-8fb5e4682083-maas-api-tls\") pod \"maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s\" (UID: \"5fee13d2-5043-487c-8940-8fb5e4682083\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" Oct 30 20:16:31.569703 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:31.569609 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqsh5\" (UniqueName: \"kubernetes.io/projected/5fee13d2-5043-487c-8940-8fb5e4682083-kube-api-access-gqsh5\") pod \"maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s\" (UID: \"5fee13d2-5043-487c-8940-8fb5e4682083\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" Oct 30 20:16:31.651770 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:31.651737 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" event={"ID":"2bc6c031-5ab7-4ff5-8c4a-13286258090f","Type":"ContainerStarted","Data":"b7bbf16cf8668307dcbde2893fbe0386eef1d8fb006d9b65d80e4ac599bbe15f"} Oct 30 20:16:31.652164 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:31.651795 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" event={"ID":"2bc6c031-5ab7-4ff5-8c4a-13286258090f","Type":"ContainerStarted","Data":"5d5656cea780f6709232e8a87042a0d319297382a4d2a0f00ef00d622e233afa"} Oct 30 20:16:31.652164 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:31.652064 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" Oct 30 20:16:31.655503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:31.655486 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" Oct 30 20:16:31.678306 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:31.678241 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" podStartSLOduration=1.173526465 podStartE2EDuration="1.67822149s" totalImagesPullingTime="504.695025ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:16:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:16:31.674799291 +0000 UTC m=+766.208071893" watchObservedRunningTime="2026-10-30 20:16:31.67822149 +0000 UTC m=+766.211494084" Oct 30 20:16:32.025987 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:32.025954 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s"] Oct 30 20:16:32.520682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:32.510119 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws"] Oct 30 20:16:32.547957 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:32.547151 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws"] Oct 30 20:16:32.547957 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:32.547288 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" Oct 30 20:16:32.555298 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:32.555272 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-5197ec-serving-cert\"" Oct 30 20:16:32.656452 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:32.656423 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws\" (UID: \"5781f3d7-e5ad-43b1-9de6-592eb80bdf39\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" Oct 30 20:16:32.656775 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:32.656599 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhzpq\" (UniqueName: \"kubernetes.io/projected/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-kube-api-access-zhzpq\") pod \"maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws\" (UID: \"5781f3d7-e5ad-43b1-9de6-592eb80bdf39\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" Oct 30 20:16:32.656775 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:32.656683 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-metrics-certs\") pod \"maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws\" (UID: \"5781f3d7-e5ad-43b1-9de6-592eb80bdf39\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" Oct 30 20:16:32.656865 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:32.656776 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-maas-api-tls\") pod \"maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws\" (UID: \"5781f3d7-e5ad-43b1-9de6-592eb80bdf39\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" Oct 30 20:16:32.658741 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:32.658689 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" event={"ID":"5fee13d2-5043-487c-8940-8fb5e4682083","Type":"ContainerStarted","Data":"92a9b42541dbfedeee9fc73fac985ee89fa25b810bfef8a27081dea8e815360a"} Oct 30 20:16:32.761706 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:32.760987 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-metrics-certs\") pod \"maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws\" (UID: \"5781f3d7-e5ad-43b1-9de6-592eb80bdf39\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" Oct 30 20:16:32.761706 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:32.761077 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-maas-api-tls\") pod \"maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws\" (UID: \"5781f3d7-e5ad-43b1-9de6-592eb80bdf39\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" Oct 30 20:16:32.761706 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:32.761197 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws\" (UID: \"5781f3d7-e5ad-43b1-9de6-592eb80bdf39\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" Oct 30 20:16:32.761706 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:32.761348 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhzpq\" (UniqueName: \"kubernetes.io/projected/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-kube-api-access-zhzpq\") pod \"maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws\" (UID: \"5781f3d7-e5ad-43b1-9de6-592eb80bdf39\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" Oct 30 20:16:32.764347 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:32.763777 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws\" (UID: \"5781f3d7-e5ad-43b1-9de6-592eb80bdf39\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" Oct 30 20:16:32.773397 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:32.768886 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-maas-api-tls\") pod \"maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws\" (UID: \"5781f3d7-e5ad-43b1-9de6-592eb80bdf39\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" Oct 30 20:16:32.775997 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:32.775726 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-metrics-certs\") pod \"maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws\" (UID: \"5781f3d7-e5ad-43b1-9de6-592eb80bdf39\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" Oct 30 20:16:32.775997 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:32.775987 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhzpq\" (UniqueName: \"kubernetes.io/projected/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-kube-api-access-zhzpq\") pod \"maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws\" (UID: \"5781f3d7-e5ad-43b1-9de6-592eb80bdf39\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" Oct 30 20:16:32.955056 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:32.955020 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" Oct 30 20:16:33.259154 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:33.259124 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws"] Oct 30 20:16:33.260492 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:16:33.260465 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5781f3d7_e5ad_43b1_9de6_592eb80bdf39.slice/crio-af19bf1af5164ee68694a180f8d25b322f88fdc696cd107e9c4f9b5af724c26e WatchSource:0}: Error finding container af19bf1af5164ee68694a180f8d25b322f88fdc696cd107e9c4f9b5af724c26e: Status 404 returned error can't find the container with id af19bf1af5164ee68694a180f8d25b322f88fdc696cd107e9c4f9b5af724c26e Oct 30 20:16:33.709892 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:33.709142 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p"] Oct 30 20:16:33.742181 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:33.741642 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" event={"ID":"5781f3d7-e5ad-43b1-9de6-592eb80bdf39","Type":"ContainerStarted","Data":"af19bf1af5164ee68694a180f8d25b322f88fdc696cd107e9c4f9b5af724c26e"} Oct 30 20:16:33.742181 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:33.741697 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" Oct 30 20:16:33.742181 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:33.741725 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" event={"ID":"5fee13d2-5043-487c-8940-8fb5e4682083","Type":"ContainerStarted","Data":"7fa904ea95512ea330ad5982d6a749737cd637cee07a8cc63fffbe926aeace73"} Oct 30 20:16:33.742181 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:33.741746 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" Oct 30 20:16:33.742558 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:33.741753 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p"] Oct 30 20:16:33.748083 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:33.745566 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" podStartSLOduration=2.265274135 podStartE2EDuration="2.745548172s" totalImagesPullingTime="480.274037ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:16:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:16:33.742922662 +0000 UTC m=+768.276195255" watchObservedRunningTime="2026-10-30 20:16:33.745548172 +0000 UTC m=+768.278820764" Oct 30 20:16:33.748083 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:33.747350 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w6-75e734-serving-cert\"" Oct 30 20:16:33.810751 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:33.810725 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e445c74-350f-49be-b2fa-40f6ff72c2d5-maas-api-tls\") pod \"maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p\" (UID: \"1e445c74-350f-49be-b2fa-40f6ff72c2d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" Oct 30 20:16:33.810867 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:33.810771 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9l85\" (UniqueName: \"kubernetes.io/projected/1e445c74-350f-49be-b2fa-40f6ff72c2d5-kube-api-access-j9l85\") pod \"maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p\" (UID: \"1e445c74-350f-49be-b2fa-40f6ff72c2d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" Oct 30 20:16:33.810982 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:33.810967 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e445c74-350f-49be-b2fa-40f6ff72c2d5-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p\" (UID: \"1e445c74-350f-49be-b2fa-40f6ff72c2d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" Oct 30 20:16:33.811095 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:33.811068 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e445c74-350f-49be-b2fa-40f6ff72c2d5-metrics-certs\") pod \"maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p\" (UID: \"1e445c74-350f-49be-b2fa-40f6ff72c2d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" Oct 30 20:16:33.912742 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:33.912697 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9l85\" (UniqueName: \"kubernetes.io/projected/1e445c74-350f-49be-b2fa-40f6ff72c2d5-kube-api-access-j9l85\") pod \"maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p\" (UID: \"1e445c74-350f-49be-b2fa-40f6ff72c2d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" Oct 30 20:16:33.912950 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:33.912899 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e445c74-350f-49be-b2fa-40f6ff72c2d5-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p\" (UID: \"1e445c74-350f-49be-b2fa-40f6ff72c2d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" Oct 30 20:16:33.913082 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:33.912957 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e445c74-350f-49be-b2fa-40f6ff72c2d5-metrics-certs\") pod \"maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p\" (UID: \"1e445c74-350f-49be-b2fa-40f6ff72c2d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" Oct 30 20:16:33.913152 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:33.913100 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e445c74-350f-49be-b2fa-40f6ff72c2d5-maas-api-tls\") pod \"maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p\" (UID: \"1e445c74-350f-49be-b2fa-40f6ff72c2d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" Oct 30 20:16:33.914237 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:33.914209 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e445c74-350f-49be-b2fa-40f6ff72c2d5-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p\" (UID: \"1e445c74-350f-49be-b2fa-40f6ff72c2d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" Oct 30 20:16:33.915825 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:33.915803 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e445c74-350f-49be-b2fa-40f6ff72c2d5-maas-api-tls\") pod \"maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p\" (UID: \"1e445c74-350f-49be-b2fa-40f6ff72c2d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" Oct 30 20:16:33.916252 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:33.916233 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e445c74-350f-49be-b2fa-40f6ff72c2d5-metrics-certs\") pod \"maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p\" (UID: \"1e445c74-350f-49be-b2fa-40f6ff72c2d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" Oct 30 20:16:33.930969 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:33.930944 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9l85\" (UniqueName: \"kubernetes.io/projected/1e445c74-350f-49be-b2fa-40f6ff72c2d5-kube-api-access-j9l85\") pod \"maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p\" (UID: \"1e445c74-350f-49be-b2fa-40f6ff72c2d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" Oct 30 20:16:34.076501 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:34.076469 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" Oct 30 20:16:34.464451 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:34.461410 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p"] Oct 30 20:16:34.733296 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:34.733195 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" event={"ID":"5781f3d7-e5ad-43b1-9de6-592eb80bdf39","Type":"ContainerStarted","Data":"e4a6a91ff57a00afbaaa5b59bbe0fcaccd565881f3ae7639221e422c2f93d432"} Oct 30 20:16:34.745687 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:34.745649 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" event={"ID":"1e445c74-350f-49be-b2fa-40f6ff72c2d5","Type":"ContainerStarted","Data":"0a7ef848942421586d7427d0db7f11ebb896ce862ab6b4e0c75ad244a37fa868"} Oct 30 20:16:34.755310 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:34.749904 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" Oct 30 20:16:34.798186 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:34.798123 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" podStartSLOduration=2.35678112 podStartE2EDuration="2.798103892s" totalImagesPullingTime="441.322772ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:16:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:16:34.786429977 +0000 UTC m=+769.319702572" watchObservedRunningTime="2026-10-30 20:16:34.798103892 +0000 UTC m=+769.331376486" Oct 30 20:16:35.781496 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:35.781396 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" event={"ID":"1e445c74-350f-49be-b2fa-40f6ff72c2d5","Type":"ContainerStarted","Data":"ecb0cbe68662d48b66f766807858e65ab1630db854f4703f7b96ec06c34d56b5"} Oct 30 20:16:35.782135 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:35.782110 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" Oct 30 20:16:35.805894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:35.805867 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465"] Oct 30 20:16:35.809376 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:35.808970 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" podStartSLOduration=2.310485348 podStartE2EDuration="2.80895593s" totalImagesPullingTime="498.470582ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:16:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:16:35.804954119 +0000 UTC m=+770.338226713" watchObservedRunningTime="2026-10-30 20:16:35.80895593 +0000 UTC m=+770.342228503" Oct 30 20:16:35.817388 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:35.815814 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" Oct 30 20:16:35.823862 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:35.821409 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465"] Oct 30 20:16:35.826044 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:35.825702 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-909519-serving-cert\"" Oct 30 20:16:36.015356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:36.008303 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq5pg\" (UniqueName: \"kubernetes.io/projected/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-kube-api-access-rq5pg\") pod \"maas-api-e2e-worker-w2-909519-7d8789995f-p9465\" (UID: \"bb6d3cde-8f40-4aa2-a446-ee6a410aba52\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" Oct 30 20:16:36.015356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:36.008420 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-maas-api-tls\") pod \"maas-api-e2e-worker-w2-909519-7d8789995f-p9465\" (UID: \"bb6d3cde-8f40-4aa2-a446-ee6a410aba52\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" Oct 30 20:16:36.015356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:36.008454 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-909519-7d8789995f-p9465\" (UID: \"bb6d3cde-8f40-4aa2-a446-ee6a410aba52\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" Oct 30 20:16:36.015356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:36.008495 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-metrics-certs\") pod \"maas-api-e2e-worker-w2-909519-7d8789995f-p9465\" (UID: \"bb6d3cde-8f40-4aa2-a446-ee6a410aba52\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" Oct 30 20:16:36.109792 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:36.109757 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq5pg\" (UniqueName: \"kubernetes.io/projected/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-kube-api-access-rq5pg\") pod \"maas-api-e2e-worker-w2-909519-7d8789995f-p9465\" (UID: \"bb6d3cde-8f40-4aa2-a446-ee6a410aba52\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" Oct 30 20:16:36.110059 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:36.110044 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-maas-api-tls\") pod \"maas-api-e2e-worker-w2-909519-7d8789995f-p9465\" (UID: \"bb6d3cde-8f40-4aa2-a446-ee6a410aba52\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" Oct 30 20:16:36.110149 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:36.110139 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-909519-7d8789995f-p9465\" (UID: \"bb6d3cde-8f40-4aa2-a446-ee6a410aba52\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" Oct 30 20:16:36.110248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:36.110224 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-metrics-certs\") pod \"maas-api-e2e-worker-w2-909519-7d8789995f-p9465\" (UID: \"bb6d3cde-8f40-4aa2-a446-ee6a410aba52\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" Oct 30 20:16:36.110862 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:36.110835 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-909519-7d8789995f-p9465\" (UID: \"bb6d3cde-8f40-4aa2-a446-ee6a410aba52\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" Oct 30 20:16:36.112704 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:36.112682 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-maas-api-tls\") pod \"maas-api-e2e-worker-w2-909519-7d8789995f-p9465\" (UID: \"bb6d3cde-8f40-4aa2-a446-ee6a410aba52\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" Oct 30 20:16:36.112796 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:36.112710 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-metrics-certs\") pod \"maas-api-e2e-worker-w2-909519-7d8789995f-p9465\" (UID: \"bb6d3cde-8f40-4aa2-a446-ee6a410aba52\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" Oct 30 20:16:36.122447 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:36.122423 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq5pg\" (UniqueName: \"kubernetes.io/projected/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-kube-api-access-rq5pg\") pod \"maas-api-e2e-worker-w2-909519-7d8789995f-p9465\" (UID: \"bb6d3cde-8f40-4aa2-a446-ee6a410aba52\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" Oct 30 20:16:36.201838 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:36.201807 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" Oct 30 20:16:36.551409 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:36.541943 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465"] Oct 30 20:16:36.794532 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:36.793435 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" event={"ID":"bb6d3cde-8f40-4aa2-a446-ee6a410aba52","Type":"ContainerStarted","Data":"3273bdf669323f0dac97a349d51db99b6a914ce3dff0154b2805194b99312a36"} Oct 30 20:16:36.884358 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:36.883048 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg"] Oct 30 20:16:36.894452 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:36.892634 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" Oct 30 20:16:36.894452 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:36.893588 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg"] Oct 30 20:16:36.902114 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:36.901924 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-9c901b-serving-cert\"" Oct 30 20:16:37.029351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:37.026322 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbn28\" (UniqueName: \"kubernetes.io/projected/e8433528-266c-4508-a35b-d7345ef1bbd7-kube-api-access-dbn28\") pod \"maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg\" (UID: \"e8433528-266c-4508-a35b-d7345ef1bbd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" Oct 30 20:16:37.029351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:37.026402 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8433528-266c-4508-a35b-d7345ef1bbd7-metrics-certs\") pod \"maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg\" (UID: \"e8433528-266c-4508-a35b-d7345ef1bbd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" Oct 30 20:16:37.029351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:37.026438 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8433528-266c-4508-a35b-d7345ef1bbd7-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg\" (UID: \"e8433528-266c-4508-a35b-d7345ef1bbd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" Oct 30 20:16:37.029351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:37.026518 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8433528-266c-4508-a35b-d7345ef1bbd7-maas-api-tls\") pod \"maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg\" (UID: \"e8433528-266c-4508-a35b-d7345ef1bbd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" Oct 30 20:16:37.127752 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:37.127724 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbn28\" (UniqueName: \"kubernetes.io/projected/e8433528-266c-4508-a35b-d7345ef1bbd7-kube-api-access-dbn28\") pod \"maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg\" (UID: \"e8433528-266c-4508-a35b-d7345ef1bbd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" Oct 30 20:16:37.127804 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:37.127781 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8433528-266c-4508-a35b-d7345ef1bbd7-metrics-certs\") pod \"maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg\" (UID: \"e8433528-266c-4508-a35b-d7345ef1bbd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" Oct 30 20:16:37.127836 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:37.127818 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8433528-266c-4508-a35b-d7345ef1bbd7-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg\" (UID: \"e8433528-266c-4508-a35b-d7345ef1bbd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" Oct 30 20:16:37.127902 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:37.127888 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8433528-266c-4508-a35b-d7345ef1bbd7-maas-api-tls\") pod \"maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg\" (UID: \"e8433528-266c-4508-a35b-d7345ef1bbd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" Oct 30 20:16:37.171444 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:37.152386 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8433528-266c-4508-a35b-d7345ef1bbd7-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg\" (UID: \"e8433528-266c-4508-a35b-d7345ef1bbd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" Oct 30 20:16:37.171444 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:37.158920 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8433528-266c-4508-a35b-d7345ef1bbd7-maas-api-tls\") pod \"maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg\" (UID: \"e8433528-266c-4508-a35b-d7345ef1bbd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" Oct 30 20:16:37.172261 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:37.172231 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8433528-266c-4508-a35b-d7345ef1bbd7-metrics-certs\") pod \"maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg\" (UID: \"e8433528-266c-4508-a35b-d7345ef1bbd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" Oct 30 20:16:37.176351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:37.174837 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbn28\" (UniqueName: \"kubernetes.io/projected/e8433528-266c-4508-a35b-d7345ef1bbd7-kube-api-access-dbn28\") pod \"maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg\" (UID: \"e8433528-266c-4508-a35b-d7345ef1bbd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" Oct 30 20:16:37.213020 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:37.212994 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" Oct 30 20:16:37.604503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:37.604477 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg"] Oct 30 20:16:37.684615 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:37.684580 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" Oct 30 20:16:37.802088 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:37.802052 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" event={"ID":"bb6d3cde-8f40-4aa2-a446-ee6a410aba52","Type":"ContainerStarted","Data":"05dd6ed92df6140f405042331cb81ac4973cd363c5c6dfc036440fd95a4542d4"} Oct 30 20:16:37.802909 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:37.802888 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" Oct 30 20:16:37.804263 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:37.804238 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" event={"ID":"e8433528-266c-4508-a35b-d7345ef1bbd7","Type":"ContainerStarted","Data":"efbbda386dcf732915dd96412e4e34dbd2d865bad66c37a248b7d7ec92ea290f"} Oct 30 20:16:37.866418 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:37.861531 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" podStartSLOduration=2.326767753 podStartE2EDuration="2.861511203s" totalImagesPullingTime="534.74345ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:16:37.859666817 +0000 UTC m=+772.392939412" watchObservedRunningTime="2026-10-30 20:16:37.861511203 +0000 UTC m=+772.394783798" Oct 30 20:16:38.811682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:38.811646 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" event={"ID":"e8433528-266c-4508-a35b-d7345ef1bbd7","Type":"ContainerStarted","Data":"a62c8d65efb6fd2966c947ffa11caaabeb0c46444ce59cf66df2b0a7b689508f"} Oct 30 20:16:39.773354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:39.772511 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" Oct 30 20:16:39.806447 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:39.802363 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" podStartSLOduration=3.27354786 podStartE2EDuration="3.802324045s" totalImagesPullingTime="528.776185ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:16:38.840983873 +0000 UTC m=+773.374256468" watchObservedRunningTime="2026-10-30 20:16:39.802324045 +0000 UTC m=+774.335596640" Oct 30 20:16:39.820918 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:39.820789 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" Oct 30 20:16:41.665447 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:41.665418 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7" Oct 30 20:16:41.666840 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:41.666816 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl" Oct 30 20:16:41.803238 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:41.803203 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" Oct 30 20:16:41.804229 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:41.804202 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" Oct 30 20:16:42.660384 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:42.657914 5078 patch_prober.go:29] interesting pod/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:16:42.660384 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:42.657990 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" podUID="a27e1ae4-d40d-4dc8-8d6f-588f38901365" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:16:42.660384 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:42.658343 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:16:42.660384 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:42.658377 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" podUID="ca42f8ad-24a9-4bec-9fcf-48582787f1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:16:44.855311 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:44.854522 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" Oct 30 20:16:45.856725 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:45.856006 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" Oct 30 20:16:45.912918 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:45.912832 5078 generic.go:356] "Generic (PLEG): container finished" podID="ca42f8ad-24a9-4bec-9fcf-48582787f1c9" containerID="6a761981d861343f7414399ae4070e99f313534193b5c20527be54552fe42d6e" exitCode=0 Oct 30 20:16:45.913087 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:45.912931 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" event={"ID":"ca42f8ad-24a9-4bec-9fcf-48582787f1c9","Type":"ContainerDied","Data":"6a761981d861343f7414399ae4070e99f313534193b5c20527be54552fe42d6e"} Oct 30 20:16:45.913416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:45.913392 5078 scope.go:122] "RemoveContainer" containerID="6a761981d861343f7414399ae4070e99f313534193b5c20527be54552fe42d6e" Oct 30 20:16:45.915084 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:45.915050 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:45.915187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:45.915143 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:45.915249 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:45.915196 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:46.922689 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:46.922645 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" event={"ID":"ca42f8ad-24a9-4bec-9fcf-48582787f1c9","Type":"ContainerStarted","Data":"808ed515f1446a14db628954c25d3950a58eeb62be7920ecbd6f59228fc43b49"} Oct 30 20:16:46.924696 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:46.924666 5078 generic.go:356] "Generic (PLEG): container finished" podID="a27e1ae4-d40d-4dc8-8d6f-588f38901365" containerID="e51c7e0a35ef62224e4bba342c177b0317ba970fddbcb0b650b97c0e5fbac82e" exitCode=0 Oct 30 20:16:46.924830 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:46.924735 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" event={"ID":"a27e1ae4-d40d-4dc8-8d6f-588f38901365","Type":"ContainerDied","Data":"e51c7e0a35ef62224e4bba342c177b0317ba970fddbcb0b650b97c0e5fbac82e"} Oct 30 20:16:46.925080 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:46.925065 5078 scope.go:122] "RemoveContainer" containerID="e51c7e0a35ef62224e4bba342c177b0317ba970fddbcb0b650b97c0e5fbac82e" Oct 30 20:16:46.926457 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:46.926430 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:46.926551 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:46.926494 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:46.926551 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:46.926527 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:47.036782 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:47.034735 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:47.036782 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:47.034848 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 30 20:16:47.036782 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:47.034888 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" podUID="ca42f8ad-24a9-4bec-9fcf-48582787f1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 30 20:16:48.015353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:48.014402 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" event={"ID":"a27e1ae4-d40d-4dc8-8d6f-588f38901365","Type":"ContainerStarted","Data":"82f10f7e259f4a8b3104c6e13fd1d184f1aaea68ced639c7b029cd287441a348"} Oct 30 20:16:48.043352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:48.042521 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 30 20:16:48.043352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:48.042584 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" podUID="ca42f8ad-24a9-4bec-9fcf-48582787f1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 30 20:16:48.438222 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:48.437735 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:48.438222 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:48.437878 5078 patch_prober.go:29] interesting pod/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Oct 30 20:16:48.438222 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:48.437923 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" podUID="a27e1ae4-d40d-4dc8-8d6f-588f38901365" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Oct 30 20:16:49.040354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:49.036748 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 30 20:16:49.040354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:49.036815 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" podUID="ca42f8ad-24a9-4bec-9fcf-48582787f1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 30 20:16:49.484059 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:49.437965 5078 patch_prober.go:29] interesting pod/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Oct 30 20:16:49.484059 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:49.438027 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" podUID="a27e1ae4-d40d-4dc8-8d6f-588f38901365" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Oct 30 20:16:50.037818 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:50.037785 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 30 20:16:50.046675 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:50.046637 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" podUID="ca42f8ad-24a9-4bec-9fcf-48582787f1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 30 20:16:50.438463 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:50.433678 5078 patch_prober.go:29] interesting pod/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Oct 30 20:16:50.438463 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:50.433736 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" podUID="a27e1ae4-d40d-4dc8-8d6f-588f38901365" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Oct 30 20:16:51.050354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:51.047241 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 30 20:16:51.050354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:51.047297 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" podUID="ca42f8ad-24a9-4bec-9fcf-48582787f1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 30 20:16:51.437352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:51.433156 5078 patch_prober.go:29] interesting pod/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Oct 30 20:16:51.437352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:51.433225 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" podUID="a27e1ae4-d40d-4dc8-8d6f-588f38901365" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Oct 30 20:16:52.037287 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:52.036827 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 30 20:16:52.037287 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:52.036890 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" podUID="ca42f8ad-24a9-4bec-9fcf-48582787f1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 30 20:16:52.437760 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:52.437720 5078 patch_prober.go:29] interesting pod/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Oct 30 20:16:52.438416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:52.438380 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" podUID="a27e1ae4-d40d-4dc8-8d6f-588f38901365" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Oct 30 20:16:53.445352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:53.443665 5078 patch_prober.go:29] interesting pod/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Oct 30 20:16:53.445352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:53.443745 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" podUID="a27e1ae4-d40d-4dc8-8d6f-588f38901365" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Oct 30 20:16:53.482257 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:53.482145 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:53.482902 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:53.482855 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:53.485906 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:53.485883 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:16:54.102670 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:54.102638 5078 generic.go:356] "Generic (PLEG): container finished" podID="8db14715-2a34-4191-8764-c9cfd82abcec" containerID="baea419920171942f788ec03adb3b6b87556171bc77445e940b9a4fd2dd0b841" exitCode=0 Oct 30 20:16:54.102873 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:54.102718 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" event={"ID":"8db14715-2a34-4191-8764-c9cfd82abcec","Type":"ContainerDied","Data":"baea419920171942f788ec03adb3b6b87556171bc77445e940b9a4fd2dd0b841"} Oct 30 20:16:54.103342 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:54.103311 5078 scope.go:122] "RemoveContainer" containerID="baea419920171942f788ec03adb3b6b87556171bc77445e940b9a4fd2dd0b841" Oct 30 20:16:54.104625 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:54.104599 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:54.104697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:54.104662 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:54.104697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:54.104694 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:54.436780 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:54.436691 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:54.437120 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:54.437088 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:54.437947 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:54.437927 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:16:55.112673 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:55.112641 5078 generic.go:356] "Generic (PLEG): container finished" podID="25da5733-edc7-4a62-bc21-dbe63273deed" containerID="74f60db9863d5ea001fb375abd6651c4eee7f4bbb836337c6a22296384349cae" exitCode=0 Oct 30 20:16:55.113186 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:55.112727 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" event={"ID":"25da5733-edc7-4a62-bc21-dbe63273deed","Type":"ContainerDied","Data":"74f60db9863d5ea001fb375abd6651c4eee7f4bbb836337c6a22296384349cae"} Oct 30 20:16:55.113295 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:55.113276 5078 scope.go:122] "RemoveContainer" containerID="74f60db9863d5ea001fb375abd6651c4eee7f4bbb836337c6a22296384349cae" Oct 30 20:16:55.115371 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:55.115314 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" event={"ID":"8db14715-2a34-4191-8764-c9cfd82abcec","Type":"ContainerStarted","Data":"104f54fd2878b62ae351224b1c971f953a9f3949c7a875e9bb8751da8de63c3b"} Oct 30 20:16:55.117228 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:55.117202 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:55.117318 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:55.117261 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:55.117318 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:55.117295 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:16:55.321497 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:55.321469 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:55.323607 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:55.323579 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Oct 30 20:16:55.323739 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:55.323623 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" podUID="8db14715-2a34-4191-8764-c9cfd82abcec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Oct 30 20:16:56.124776 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:56.124740 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" event={"ID":"25da5733-edc7-4a62-bc21-dbe63273deed","Type":"ContainerStarted","Data":"6a69fd0727b1f9f170b5b0ecadee0ad98cce269006bbce82152d8c349947208b"} Oct 30 20:16:56.321774 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:56.321746 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Oct 30 20:16:56.322025 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:56.322004 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" podUID="8db14715-2a34-4191-8764-c9cfd82abcec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Oct 30 20:16:56.608587 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:56.608500 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:16:56.710761 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:16:56.710722 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:16:56.872417 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:56.871695 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:56.872417 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:56.871841 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Oct 30 20:16:56.872417 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:56.871885 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" podUID="25da5733-edc7-4a62-bc21-dbe63273deed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Oct 30 20:16:57.321140 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:57.321109 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Oct 30 20:16:57.321570 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:57.321163 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" podUID="8db14715-2a34-4191-8764-c9cfd82abcec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Oct 30 20:16:57.614610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:57.614505 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:16:57.876417 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:57.872747 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Oct 30 20:16:57.876417 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:57.872812 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" podUID="25da5733-edc7-4a62-bc21-dbe63273deed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Oct 30 20:16:58.323561 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:58.323518 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Oct 30 20:16:58.323955 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:58.323594 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" podUID="8db14715-2a34-4191-8764-c9cfd82abcec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Oct 30 20:16:58.877354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:58.875717 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Oct 30 20:16:58.877354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:58.875783 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" podUID="25da5733-edc7-4a62-bc21-dbe63273deed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Oct 30 20:16:59.330355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:59.328783 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Oct 30 20:16:59.330355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:59.328875 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" podUID="8db14715-2a34-4191-8764-c9cfd82abcec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Oct 30 20:16:59.874353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:59.872699 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Oct 30 20:16:59.874353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:16:59.872762 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" podUID="25da5733-edc7-4a62-bc21-dbe63273deed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Oct 30 20:17:00.320970 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:00.320934 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Oct 30 20:17:00.321171 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:00.321000 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" podUID="8db14715-2a34-4191-8764-c9cfd82abcec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Oct 30 20:17:00.870656 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:00.870611 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Oct 30 20:17:00.871147 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:00.870674 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" podUID="25da5733-edc7-4a62-bc21-dbe63273deed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Oct 30 20:17:01.325244 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:01.325195 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:17:01.326223 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:01.326204 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:17:01.875037 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:01.874999 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:17:01.876121 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:01.876101 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:17:26.699259 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:17:26.699212 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:17:54.928594 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:54.928502 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk"] Oct 30 20:17:54.934413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:54.934384 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:54.946525 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:54.946488 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk"] Oct 30 20:17:54.956069 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:54.956017 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-75e734-openshift-default-dockercfg-dv849\"" Oct 30 20:17:55.031641 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.031599 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-podinfo\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.031810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.031646 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-credential-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.031810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.031669 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-token\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.031944 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.031836 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-workload-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.031944 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.031884 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85w2q\" (UniqueName: \"kubernetes.io/projected/179c807f-ec84-47b4-ba09-51354cbcff6a-kube-api-access-85w2q\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.032050 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.032018 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-workload-certs\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.032104 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.032070 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-data\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.032163 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.032149 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/179c807f-ec84-47b4-ba09-51354cbcff6a-istiod-ca-cert\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.032220 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.032193 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-envoy\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.133438 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.133402 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-podinfo\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.133438 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.133449 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-credential-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.133732 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.133470 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-token\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.133732 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.133506 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-workload-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.133732 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.133524 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85w2q\" (UniqueName: \"kubernetes.io/projected/179c807f-ec84-47b4-ba09-51354cbcff6a-kube-api-access-85w2q\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.133732 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.133612 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-workload-certs\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.133732 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.133657 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-data\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.133732 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.133708 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/179c807f-ec84-47b4-ba09-51354cbcff6a-istiod-ca-cert\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.134092 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.133749 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-envoy\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.134092 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.133957 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-workload-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.134092 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.134024 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-credential-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.134245 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.134091 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-workload-certs\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.134245 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.134152 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-data\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.134496 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.134473 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/179c807f-ec84-47b4-ba09-51354cbcff6a-istiod-ca-cert\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.136078 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.136052 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-envoy\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.136442 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.136424 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-podinfo\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.146592 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.146562 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-token\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.146724 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.146636 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85w2q\" (UniqueName: \"kubernetes.io/projected/179c807f-ec84-47b4-ba09-51354cbcff6a-kube-api-access-85w2q\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.284990 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.284894 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:55.588050 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.588023 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk"] Oct 30 20:17:55.589865 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:17:55.589837 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod179c807f_ec84_47b4_ba09_51354cbcff6a.slice/crio-08448d86756da6bae14f4d93e2f44e2a9a31b0719ee7eab05a72196cae38ce30 WatchSource:0}: Error finding container 08448d86756da6bae14f4d93e2f44e2a9a31b0719ee7eab05a72196cae38ce30: Status 404 returned error can't find the container with id 08448d86756da6bae14f4d93e2f44e2a9a31b0719ee7eab05a72196cae38ce30 Oct 30 20:17:55.592265 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.592233 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:17:55.592396 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.592300 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:17:55.592396 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.592353 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:17:55.607737 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:55.607708 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" event={"ID":"179c807f-ec84-47b4-ba09-51354cbcff6a","Type":"ContainerStarted","Data":"08448d86756da6bae14f4d93e2f44e2a9a31b0719ee7eab05a72196cae38ce30"} Oct 30 20:17:56.616063 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:56.616016 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" event={"ID":"179c807f-ec84-47b4-ba09-51354cbcff6a","Type":"ContainerStarted","Data":"6f66c7161b977b4327b9f483d5b132db4ed309135819bcbfec8acd3352bb559b"} Oct 30 20:17:56.657402 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:56.653462 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" podStartSLOduration=2.6534426250000003 podStartE2EDuration="2.653442625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:17:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:17:56.651665993 +0000 UTC m=+851.184938614" watchObservedRunningTime="2026-10-30 20:17:56.653442625 +0000 UTC m=+851.186715221" Oct 30 20:17:56.700185 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:17:56.700144 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:17:57.286463 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:57.286432 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:17:57.287182 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:57.287153 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Oct 30 20:17:57.287391 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:57.287363 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" podUID="179c807f-ec84-47b4-ba09-51354cbcff6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Oct 30 20:17:58.285781 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:58.285734 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Oct 30 20:17:58.286498 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:58.285802 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" podUID="179c807f-ec84-47b4-ba09-51354cbcff6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Oct 30 20:17:59.285714 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:59.285682 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Oct 30 20:17:59.285911 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:17:59.285732 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" podUID="179c807f-ec84-47b4-ba09-51354cbcff6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Oct 30 20:18:00.285530 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:00.285490 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Oct 30 20:18:00.285715 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:00.285549 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" podUID="179c807f-ec84-47b4-ba09-51354cbcff6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Oct 30 20:18:01.286250 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:01.286211 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Oct 30 20:18:01.286800 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:01.286288 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" podUID="179c807f-ec84-47b4-ba09-51354cbcff6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Oct 30 20:18:02.285647 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:02.285611 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Oct 30 20:18:02.285835 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:02.285668 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" podUID="179c807f-ec84-47b4-ba09-51354cbcff6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Oct 30 20:18:03.748644 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:03.748612 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:18:03.749168 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:03.749009 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:18:03.749866 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:03.749846 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:18:09.526629 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.526594 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7"] Oct 30 20:18:09.532135 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.532109 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.540642 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.540616 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-c646da-openshift-default-dockercfg-2gm5m\"" Oct 30 20:18:09.547821 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.547791 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7"] Oct 30 20:18:09.574012 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.573977 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqcmp\" (UniqueName: \"kubernetes.io/projected/f8cf8036-fa67-45ef-a16f-fa7041a61305-kube-api-access-sqcmp\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.574195 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.574047 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-token\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.574195 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.574088 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-envoy\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.574195 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.574107 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-podinfo\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.574195 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.574141 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-workload-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.574195 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.574175 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-workload-certs\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.574587 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.574210 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-credential-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.574587 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.574228 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-data\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.574587 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.574250 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8cf8036-fa67-45ef-a16f-fa7041a61305-istiod-ca-cert\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.675497 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.675462 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-token\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.675708 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.675528 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-envoy\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.675708 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.675654 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-podinfo\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.675830 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.675728 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-workload-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.675830 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.675781 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-workload-certs\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.676458 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.676169 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-workload-certs\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.676458 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.676214 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-workload-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.676458 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.676262 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-credential-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.676458 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.676311 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-data\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.676458 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.676362 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8cf8036-fa67-45ef-a16f-fa7041a61305-istiod-ca-cert\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.676458 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.676438 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqcmp\" (UniqueName: \"kubernetes.io/projected/f8cf8036-fa67-45ef-a16f-fa7041a61305-kube-api-access-sqcmp\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.676782 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.676610 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-credential-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.676900 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.676869 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-data\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.677238 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.677218 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8cf8036-fa67-45ef-a16f-fa7041a61305-istiod-ca-cert\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.678695 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.678669 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-podinfo\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.678899 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.678878 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-envoy\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.697147 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.697077 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-token\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.699175 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.699146 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqcmp\" (UniqueName: \"kubernetes.io/projected/f8cf8036-fa67-45ef-a16f-fa7041a61305-kube-api-access-sqcmp\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.755930 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.755898 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg"] Oct 30 20:18:09.762678 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.762653 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.774284 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.774257 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg"] Oct 30 20:18:09.852460 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.852430 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-909519-openshift-default-dockercfg-r5l5q\"" Oct 30 20:18:09.859691 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.859660 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:09.879699 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.879666 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-istio-data\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.879799 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.879714 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmnzl\" (UniqueName: \"kubernetes.io/projected/62edb9f6-a9af-4488-849b-6c9115b79513-kube-api-access-jmnzl\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.879918 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.879903 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-istio-envoy\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.879955 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.879933 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-workload-certs\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.879998 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.879962 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62edb9f6-a9af-4488-849b-6c9115b79513-istio-podinfo\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.880161 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.880131 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-credential-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.880243 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.880175 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62edb9f6-a9af-4488-849b-6c9115b79513-istio-token\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.880344 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.880308 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62edb9f6-a9af-4488-849b-6c9115b79513-istiod-ca-cert\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.880418 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.880390 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-workload-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.981612 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.981575 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-istio-envoy\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.981814 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.981621 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-workload-certs\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.981814 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.981649 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62edb9f6-a9af-4488-849b-6c9115b79513-istio-podinfo\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.981814 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.981714 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-credential-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.981814 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.981737 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62edb9f6-a9af-4488-849b-6c9115b79513-istio-token\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.981814 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.981766 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62edb9f6-a9af-4488-849b-6c9115b79513-istiod-ca-cert\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.981814 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.981799 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-workload-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.982742 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.981882 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-istio-data\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.982742 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.981911 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmnzl\" (UniqueName: \"kubernetes.io/projected/62edb9f6-a9af-4488-849b-6c9115b79513-kube-api-access-jmnzl\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.982742 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.982186 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-workload-certs\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.982742 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.982466 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-workload-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.982742 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.982635 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-istio-data\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.982971 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.982914 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-credential-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.983777 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.983752 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62edb9f6-a9af-4488-849b-6c9115b79513-istiod-ca-cert\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.985168 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.985140 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-istio-envoy\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.986390 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.986371 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62edb9f6-a9af-4488-849b-6c9115b79513-istio-podinfo\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.999590 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.999552 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62edb9f6-a9af-4488-849b-6c9115b79513-istio-token\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:09.999758 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:09.999687 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmnzl\" (UniqueName: \"kubernetes.io/projected/62edb9f6-a9af-4488-849b-6c9115b79513-kube-api-access-jmnzl\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-scbzg\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:10.080201 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:10.080168 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:10.160389 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:10.160354 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7"] Oct 30 20:18:10.171679 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:10.171642 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:18:10.171801 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:10.171716 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:18:10.171801 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:10.171775 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:18:10.367588 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:10.367560 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg"] Oct 30 20:18:10.370106 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:18:10.370080 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62edb9f6_a9af_4488_849b_6c9115b79513.slice/crio-23a35a6db17d6129595db3c38658870751c7ec6944d0b2b640acce508ae3cd3a WatchSource:0}: Error finding container 23a35a6db17d6129595db3c38658870751c7ec6944d0b2b640acce508ae3cd3a: Status 404 returned error can't find the container with id 23a35a6db17d6129595db3c38658870751c7ec6944d0b2b640acce508ae3cd3a Oct 30 20:18:10.373274 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:10.373243 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:18:10.373386 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:10.373310 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:18:10.373386 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:10.373378 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:18:10.767071 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:10.766979 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" event={"ID":"f8cf8036-fa67-45ef-a16f-fa7041a61305","Type":"ContainerStarted","Data":"ab059bd8bc094bc33a5bc4ee2ba6aeccb96f8dafb336693693361dca7037f03a"} Oct 30 20:18:10.767071 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:10.767044 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" event={"ID":"f8cf8036-fa67-45ef-a16f-fa7041a61305","Type":"ContainerStarted","Data":"82d138cc1971e7500377a89421899dc2da43f5809b194eb0f41f5be8213ae444"} Oct 30 20:18:10.769035 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:10.769003 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" event={"ID":"62edb9f6-a9af-4488-849b-6c9115b79513","Type":"ContainerStarted","Data":"463c571146c70350a65727f408bfccd4a054320e67e042e0e6042e1c3592fca5"} Oct 30 20:18:10.769170 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:10.769056 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" event={"ID":"62edb9f6-a9af-4488-849b-6c9115b79513","Type":"ContainerStarted","Data":"23a35a6db17d6129595db3c38658870751c7ec6944d0b2b640acce508ae3cd3a"} Oct 30 20:18:10.792686 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:10.792624 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" podStartSLOduration=1.792604668 podStartE2EDuration="1.792604668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:18:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:18:10.791718123 +0000 UTC m=+865.324990739" watchObservedRunningTime="2026-10-30 20:18:10.792604668 +0000 UTC m=+865.325877263" Oct 30 20:18:10.817206 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:10.817139 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" podStartSLOduration=1.817120015 podStartE2EDuration="1.817120015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:18:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:18:10.814768294 +0000 UTC m=+865.348040889" watchObservedRunningTime="2026-10-30 20:18:10.817120015 +0000 UTC m=+865.350392609" Oct 30 20:18:10.859833 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:10.859779 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:11.092192 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:11.092151 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:11.093993 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:11.093619 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Oct 30 20:18:11.093993 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:11.093667 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" podUID="62edb9f6-a9af-4488-849b-6c9115b79513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Oct 30 20:18:11.863359 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:11.863269 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Oct 30 20:18:11.864262 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:11.863960 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" podUID="f8cf8036-fa67-45ef-a16f-fa7041a61305" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Oct 30 20:18:12.087094 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:12.087065 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Oct 30 20:18:12.087321 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:12.087302 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" podUID="62edb9f6-a9af-4488-849b-6c9115b79513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Oct 30 20:18:12.865773 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:12.865736 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Oct 30 20:18:12.866401 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:12.866370 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" podUID="f8cf8036-fa67-45ef-a16f-fa7041a61305" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Oct 30 20:18:13.083356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:13.082485 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Oct 30 20:18:13.083356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:13.082546 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" podUID="62edb9f6-a9af-4488-849b-6c9115b79513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Oct 30 20:18:13.860743 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:13.860706 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Oct 30 20:18:13.861008 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:13.860982 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" podUID="f8cf8036-fa67-45ef-a16f-fa7041a61305" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Oct 30 20:18:14.084854 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:14.084818 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Oct 30 20:18:14.085455 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:14.085423 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" podUID="62edb9f6-a9af-4488-849b-6c9115b79513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Oct 30 20:18:14.867355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:14.863531 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Oct 30 20:18:14.867355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:14.863592 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" podUID="f8cf8036-fa67-45ef-a16f-fa7041a61305" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Oct 30 20:18:15.085670 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:15.085487 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Oct 30 20:18:15.085670 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:15.085563 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" podUID="62edb9f6-a9af-4488-849b-6c9115b79513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Oct 30 20:18:15.861759 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:15.861721 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Oct 30 20:18:15.862113 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:15.862084 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" podUID="f8cf8036-fa67-45ef-a16f-fa7041a61305" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Oct 30 20:18:16.083625 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:16.082658 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Oct 30 20:18:16.083625 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:16.082722 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" podUID="62edb9f6-a9af-4488-849b-6c9115b79513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Oct 30 20:18:17.081051 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:17.081014 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Oct 30 20:18:17.081566 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:17.081071 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" podUID="62edb9f6-a9af-4488-849b-6c9115b79513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Oct 30 20:18:17.177094 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:17.177055 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:17.178394 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:17.178368 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:17.182003 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:17.181980 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:18:18.086045 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:18.086006 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:18.086578 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:18.086470 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:18.087181 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:18.087160 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:18:20.335413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.326567 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6"] Oct 30 20:18:20.491498 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.491457 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:20.509434 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.509389 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6"] Oct 30 20:18:20.528849 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.528819 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-44135b\"/\"distinct-w5-44135b-kserve-self-signed-certs\"" Oct 30 20:18:20.562227 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.562202 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-44135b\"/\"openshift-service-ca.crt\"" Oct 30 20:18:20.564421 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.564390 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-44135b\"/\"kube-root-ca.crt\"" Oct 30 20:18:20.595411 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.593321 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-home\") pod \"distinct-w5-44135b-kserve-7586946495-d2tw6\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:20.595411 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.593396 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvp6v\" (UniqueName: \"kubernetes.io/projected/33f80c7b-4092-4406-aa02-3a25d9e8501a-kube-api-access-xvp6v\") pod \"distinct-w5-44135b-kserve-7586946495-d2tw6\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:20.595411 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.593440 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33f80c7b-4092-4406-aa02-3a25d9e8501a-tls-certs\") pod \"distinct-w5-44135b-kserve-7586946495-d2tw6\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:20.595411 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.593496 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-model-cache\") pod \"distinct-w5-44135b-kserve-7586946495-d2tw6\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:20.595411 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.593540 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-tmp-dir\") pod \"distinct-w5-44135b-kserve-7586946495-d2tw6\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:20.595411 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.593614 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-dshm\") pod \"distinct-w5-44135b-kserve-7586946495-d2tw6\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:20.674995 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.674962 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-44135b\"/\"default-dockercfg-7wx9c\"" Oct 30 20:18:20.726059 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.707606 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvp6v\" (UniqueName: \"kubernetes.io/projected/33f80c7b-4092-4406-aa02-3a25d9e8501a-kube-api-access-xvp6v\") pod \"distinct-w5-44135b-kserve-7586946495-d2tw6\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:20.726059 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.723799 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33f80c7b-4092-4406-aa02-3a25d9e8501a-tls-certs\") pod \"distinct-w5-44135b-kserve-7586946495-d2tw6\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:20.726059 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.723900 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-model-cache\") pod \"distinct-w5-44135b-kserve-7586946495-d2tw6\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:20.726059 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.723970 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-tmp-dir\") pod \"distinct-w5-44135b-kserve-7586946495-d2tw6\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:20.726059 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.724207 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-dshm\") pod \"distinct-w5-44135b-kserve-7586946495-d2tw6\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:20.726059 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.724378 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-home\") pod \"distinct-w5-44135b-kserve-7586946495-d2tw6\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:20.726059 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.725447 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-home\") pod \"distinct-w5-44135b-kserve-7586946495-d2tw6\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:20.757361 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.741028 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-model-cache\") pod \"distinct-w5-44135b-kserve-7586946495-d2tw6\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:20.766086 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.766046 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-tmp-dir\") pod \"distinct-w5-44135b-kserve-7586946495-d2tw6\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:20.834963 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:20.834928 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvp6v\" (UniqueName: \"kubernetes.io/projected/33f80c7b-4092-4406-aa02-3a25d9e8501a-kube-api-access-xvp6v\") pod \"distinct-w5-44135b-kserve-7586946495-d2tw6\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:21.074931 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:21.074886 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-dshm\") pod \"distinct-w5-44135b-kserve-7586946495-d2tw6\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:21.129365 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:21.129112 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33f80c7b-4092-4406-aa02-3a25d9e8501a-tls-certs\") pod \"distinct-w5-44135b-kserve-7586946495-d2tw6\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:21.199819 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:21.199775 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:22.638575 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:22.638541 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6"] Oct 30 20:18:23.390365 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:23.386713 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" event={"ID":"33f80c7b-4092-4406-aa02-3a25d9e8501a","Type":"ContainerStarted","Data":"17544bc46a7b03a1ca7e7f4cc211962866d194017ff475f0f51ccb070482311c"} Oct 30 20:18:23.390365 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:23.386773 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" event={"ID":"33f80c7b-4092-4406-aa02-3a25d9e8501a","Type":"ContainerStarted","Data":"a858be2c015d142d0f8cad5d207aa3e212a9311a71df64373b78d72a2a0d495d"} Oct 30 20:18:24.201451 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:24.201418 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:26.699794 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:18:26.699753 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:18:30.448238 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.448179 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podStartSLOduration=10.448163921 podStartE2EDuration="10.448163921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:18:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:18:23.423475314 +0000 UTC m=+877.956747910" watchObservedRunningTime="2026-10-30 20:18:30.448163921 +0000 UTC m=+884.981436514" Oct 30 20:18:30.451707 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.451678 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl"] Oct 30 20:18:30.458257 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.458236 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:30.481020 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.479302 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-909519\"/\"kube-root-ca.crt\"" Oct 30 20:18:30.482828 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.482801 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-909519\"/\"openshift-service-ca.crt\"" Oct 30 20:18:30.482999 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.482863 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-909519\"/\"default-dockercfg-p2vpb\"" Oct 30 20:18:30.482999 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.482959 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-909519\"/\"distinct-w2-909519-kserve-self-signed-certs\"" Oct 30 20:18:30.486125 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.486097 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl"] Oct 30 20:18:30.505161 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.505134 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-model-cache\") pod \"distinct-w2-909519-kserve-6f668f5d58-qdpkl\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:30.505324 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.505300 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-tmp-dir\") pod \"distinct-w2-909519-kserve-6f668f5d58-qdpkl\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:30.505418 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.505399 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-home\") pod \"distinct-w2-909519-kserve-6f668f5d58-qdpkl\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:30.505485 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.505437 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-dshm\") pod \"distinct-w2-909519-kserve-6f668f5d58-qdpkl\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:30.505595 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.505574 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0f5a46d-0671-46de-b229-4449baf28a99-tls-certs\") pod \"distinct-w2-909519-kserve-6f668f5d58-qdpkl\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:30.505656 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.505607 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzfkf\" (UniqueName: \"kubernetes.io/projected/a0f5a46d-0671-46de-b229-4449baf28a99-kube-api-access-xzfkf\") pod \"distinct-w2-909519-kserve-6f668f5d58-qdpkl\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:30.619350 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.614188 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-tmp-dir\") pod \"distinct-w2-909519-kserve-6f668f5d58-qdpkl\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:30.619350 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.614264 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-home\") pod \"distinct-w2-909519-kserve-6f668f5d58-qdpkl\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:30.619350 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.614293 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-dshm\") pod \"distinct-w2-909519-kserve-6f668f5d58-qdpkl\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:30.619350 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.614427 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0f5a46d-0671-46de-b229-4449baf28a99-tls-certs\") pod \"distinct-w2-909519-kserve-6f668f5d58-qdpkl\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:30.619350 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.614461 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzfkf\" (UniqueName: \"kubernetes.io/projected/a0f5a46d-0671-46de-b229-4449baf28a99-kube-api-access-xzfkf\") pod \"distinct-w2-909519-kserve-6f668f5d58-qdpkl\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:30.619350 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.614524 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-model-cache\") pod \"distinct-w2-909519-kserve-6f668f5d58-qdpkl\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:30.619350 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.615015 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-model-cache\") pod \"distinct-w2-909519-kserve-6f668f5d58-qdpkl\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:30.619350 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.615264 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-tmp-dir\") pod \"distinct-w2-909519-kserve-6f668f5d58-qdpkl\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:30.619350 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.615565 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-home\") pod \"distinct-w2-909519-kserve-6f668f5d58-qdpkl\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:30.641682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.641643 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-dshm\") pod \"distinct-w2-909519-kserve-6f668f5d58-qdpkl\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:30.650955 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.650919 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0f5a46d-0671-46de-b229-4449baf28a99-tls-certs\") pod \"distinct-w2-909519-kserve-6f668f5d58-qdpkl\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:30.657613 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.657578 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzfkf\" (UniqueName: \"kubernetes.io/projected/a0f5a46d-0671-46de-b229-4449baf28a99-kube-api-access-xzfkf\") pod \"distinct-w2-909519-kserve-6f668f5d58-qdpkl\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:30.787085 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:30.786998 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:31.083403 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:31.083371 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl"] Oct 30 20:18:31.083532 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:18:31.083435 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0f5a46d_0671_46de_b229_4449baf28a99.slice/crio-433be835d9c188a972115269c15af985a619bb08737f47502abb15d7db0239c5 WatchSource:0}: Error finding container 433be835d9c188a972115269c15af985a619bb08737f47502abb15d7db0239c5: Status 404 returned error can't find the container with id 433be835d9c188a972115269c15af985a619bb08737f47502abb15d7db0239c5 Oct 30 20:18:31.200753 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:31.200721 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:31.215391 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:31.214963 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:31.460601 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:31.460499 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" event={"ID":"a0f5a46d-0671-46de-b229-4449baf28a99","Type":"ContainerStarted","Data":"f7d2db75a17a08431897ea422621133b719d12fe5ef8e6bc777a7e4291891614"} Oct 30 20:18:31.460601 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:31.460547 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" event={"ID":"a0f5a46d-0671-46de-b229-4449baf28a99","Type":"ContainerStarted","Data":"433be835d9c188a972115269c15af985a619bb08737f47502abb15d7db0239c5"} Oct 30 20:18:31.472154 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:31.472126 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:18:31.486479 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:31.486436 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podStartSLOduration=1.486422463 podStartE2EDuration="1.486422463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:18:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:18:31.484157938 +0000 UTC m=+886.017430533" watchObservedRunningTime="2026-10-30 20:18:31.486422463 +0000 UTC m=+886.019695057" Oct 30 20:18:31.787824 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:31.787732 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:40.787521 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:40.787481 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:40.801156 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:40.801129 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:41.658797 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:41.658763 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:18:45.676082 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:45.676049 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/1.log" Oct 30 20:18:45.678604 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:45.678582 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/1.log" Oct 30 20:18:47.813355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.810564 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk"] Oct 30 20:18:47.840352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.836913 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:47.840536 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.840514 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk"] Oct 30 20:18:47.855622 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.853071 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-44135b\"/\"distinct-2-w5-44135b-kserve-self-signed-certs\"" Oct 30 20:18:47.866407 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.866299 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-tmp-dir\") pod \"distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:47.866579 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.866404 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snk68\" (UniqueName: \"kubernetes.io/projected/49a87331-7606-4e95-8d8c-b8f1ad754a9a-kube-api-access-snk68\") pod \"distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:47.866579 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.866504 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-home\") pod \"distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:47.866579 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.866568 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-model-cache\") pod \"distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:47.866751 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.866613 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49a87331-7606-4e95-8d8c-b8f1ad754a9a-tls-certs\") pod \"distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:47.866751 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.866701 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-dshm\") pod \"distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:47.968344 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.968294 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49a87331-7606-4e95-8d8c-b8f1ad754a9a-tls-certs\") pod \"distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:47.968524 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.968403 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-dshm\") pod \"distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:47.968524 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.968459 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-tmp-dir\") pod \"distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:47.968524 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.968492 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snk68\" (UniqueName: \"kubernetes.io/projected/49a87331-7606-4e95-8d8c-b8f1ad754a9a-kube-api-access-snk68\") pod \"distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:47.968666 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.968559 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-home\") pod \"distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:47.968666 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.968595 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-model-cache\") pod \"distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:47.969122 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.969059 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-home\") pod \"distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:47.969122 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.969085 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-model-cache\") pod \"distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:47.969444 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.969290 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-tmp-dir\") pod \"distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:47.971041 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.971019 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-dshm\") pod \"distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:47.971744 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.971718 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49a87331-7606-4e95-8d8c-b8f1ad754a9a-tls-certs\") pod \"distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:47.981755 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:47.981731 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snk68\" (UniqueName: \"kubernetes.io/projected/49a87331-7606-4e95-8d8c-b8f1ad754a9a-kube-api-access-snk68\") pod \"distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:48.178668 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:48.178583 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:48.485161 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:48.484380 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk"] Oct 30 20:18:48.695856 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:48.695801 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" event={"ID":"49a87331-7606-4e95-8d8c-b8f1ad754a9a","Type":"ContainerStarted","Data":"493cdd4f98e3f5a37472f47b4ea3c859483bd09717bb2baeff1c3c73f39ac6f8"} Oct 30 20:18:48.695856 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:48.695861 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" event={"ID":"49a87331-7606-4e95-8d8c-b8f1ad754a9a","Type":"ContainerStarted","Data":"3e315dbf38680ae6810b3daa9ea41acf93e3946b3266ecaf1b8bb08c886a9603"} Oct 30 20:18:48.717539 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:48.717476 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podStartSLOduration=1.717462538 podStartE2EDuration="1.717462538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:18:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:18:48.715662652 +0000 UTC m=+903.248935247" watchObservedRunningTime="2026-10-30 20:18:48.717462538 +0000 UTC m=+903.250735132" Oct 30 20:18:49.179234 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:49.179189 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:54.597286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.597248 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq"] Oct 30 20:18:54.601902 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.601878 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.618415 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.618391 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq"] Oct 30 20:18:54.702670 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.702628 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k57tk\" (UniqueName: \"kubernetes.io/projected/6b463b25-8a3d-4b36-9925-5358b34f0c4c-kube-api-access-k57tk\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.702850 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.702706 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-envoy\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.702850 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.702732 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istiod-ca-cert\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.702850 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.702760 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-podinfo\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.702984 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.702951 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-token\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.703090 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.703071 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-workload-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.703125 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.703098 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-credential-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.703259 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.703242 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-workload-certs\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.703443 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.703418 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-data\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.722294 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.722063 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c"] Oct 30 20:18:54.726478 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.726451 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.750724 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.749101 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c"] Oct 30 20:18:54.804322 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.804280 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k57tk\" (UniqueName: \"kubernetes.io/projected/6b463b25-8a3d-4b36-9925-5358b34f0c4c-kube-api-access-k57tk\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.804499 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.804360 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-token\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.804499 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.804394 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istiod-ca-cert\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.804578 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.804535 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-envoy\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.804617 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.804578 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istiod-ca-cert\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.804617 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.804606 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-podinfo\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.804682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.804635 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-credential-socket\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.804717 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.804694 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-token\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.804807 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.804779 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lj22\" (UniqueName: \"kubernetes.io/projected/6de7d150-b3e9-44f2-9b6a-71e69df471a9-kube-api-access-8lj22\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.805036 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.805007 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-workload-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.805186 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.805045 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-credential-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.805186 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.805067 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-envoy\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.805186 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.805098 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-podinfo\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.805431 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.805265 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-workload-certs\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.805431 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.805301 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-workload-socket\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.805431 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.805365 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-credential-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.805431 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.805394 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-data\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.805431 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.805419 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-workload-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.805704 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.805454 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istiod-ca-cert\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.805704 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.805488 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-workload-certs\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.805704 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.805551 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-data\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.805704 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.805581 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-workload-certs\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.805925 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.805835 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-data\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.807130 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.807094 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-envoy\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.807516 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.807493 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-podinfo\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.817575 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.817546 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-token\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.817698 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.817681 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k57tk\" (UniqueName: \"kubernetes.io/projected/6b463b25-8a3d-4b36-9925-5358b34f0c4c-kube-api-access-k57tk\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.906490 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.906400 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-data\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.906490 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.906447 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-workload-certs\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.906722 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.906519 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-token\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.906722 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.906537 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istiod-ca-cert\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.906722 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.906571 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-credential-socket\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.906722 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.906625 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lj22\" (UniqueName: \"kubernetes.io/projected/6de7d150-b3e9-44f2-9b6a-71e69df471a9-kube-api-access-8lj22\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.906722 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.906668 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-envoy\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.906722 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.906686 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-podinfo\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.907032 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.906749 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-workload-socket\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.907032 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.906860 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-data\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.907032 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.906911 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-workload-certs\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.907032 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.906930 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-credential-socket\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.907231 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.907108 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-workload-socket\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.907342 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.907311 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istiod-ca-cert\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.909288 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.909264 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-envoy\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.909549 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.909527 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-podinfo\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.916400 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.916379 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:54.920022 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.919997 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-token\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.920165 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.920132 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lj22\" (UniqueName: \"kubernetes.io/projected/6de7d150-b3e9-44f2-9b6a-71e69df471a9-kube-api-access-8lj22\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:54.938670 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.938643 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb"] Oct 30 20:18:54.944827 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.944802 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:54.955776 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:54.955748 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb"] Oct 30 20:18:55.043057 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.043025 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:55.110234 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.110205 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-workload-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.111003 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.110239 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-workload-certs\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.111003 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.110271 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dm86\" (UniqueName: \"kubernetes.io/projected/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-kube-api-access-2dm86\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.111003 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.110313 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-envoy\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.111003 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.110368 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-credential-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.111003 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.110384 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-data\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.111003 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.110404 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istiod-ca-cert\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.111003 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.110461 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-token\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.111003 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.110484 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-podinfo\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.212192 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.212118 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istiod-ca-cert\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.212192 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.212189 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-token\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.212416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.212213 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-podinfo\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.212416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.212292 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-workload-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.212416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.212310 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-workload-certs\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.212416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.212374 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dm86\" (UniqueName: \"kubernetes.io/projected/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-kube-api-access-2dm86\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.212614 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.212444 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-envoy\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.212614 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.212507 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-credential-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.212614 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.212531 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-data\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.212732 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.212716 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-workload-certs\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.212945 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.212911 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istiod-ca-cert\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.213057 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.212952 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-workload-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.213181 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.213159 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-credential-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.213237 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.213172 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-data\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.214782 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.214758 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-envoy\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.214897 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.214881 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-podinfo\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.220781 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.220762 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq"] Oct 30 20:18:55.221897 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:18:55.221874 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b463b25_8a3d_4b36_9925_5358b34f0c4c.slice/crio-10fe44f0e7a900103befd18a7146bb6543baae568d8f78caef4925812aa9c404 WatchSource:0}: Error finding container 10fe44f0e7a900103befd18a7146bb6543baae568d8f78caef4925812aa9c404: Status 404 returned error can't find the container with id 10fe44f0e7a900103befd18a7146bb6543baae568d8f78caef4925812aa9c404 Oct 30 20:18:55.224227 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.224196 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:18:55.224305 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.224264 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:18:55.224361 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.224309 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:18:55.227549 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.227529 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-token\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.227633 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.227615 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dm86\" (UniqueName: \"kubernetes.io/projected/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-kube-api-access-2dm86\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.278938 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.278880 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:55.383026 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.340505 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c"] Oct 30 20:18:55.383026 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:18:55.347427 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de7d150_b3e9_44f2_9b6a_71e69df471a9.slice/crio-ff833d485cc586887b9a63e0385ff6c422ffa774a8790953763a80de315bf96a WatchSource:0}: Error finding container ff833d485cc586887b9a63e0385ff6c422ffa774a8790953763a80de315bf96a: Status 404 returned error can't find the container with id ff833d485cc586887b9a63e0385ff6c422ffa774a8790953763a80de315bf96a Oct 30 20:18:55.383026 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.350078 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:18:55.383026 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.350156 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:18:55.383026 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.350198 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:18:55.575387 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.574864 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb"] Oct 30 20:18:55.583014 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:18:55.582972 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb5acf0_bbb2_4cf7_b212_9bd9f5b952bd.slice/crio-f93f424211bc872dc02d06bb526609bb5dd579c77845cedb385ccba1d3b8a638 WatchSource:0}: Error finding container f93f424211bc872dc02d06bb526609bb5dd579c77845cedb385ccba1d3b8a638: Status 404 returned error can't find the container with id f93f424211bc872dc02d06bb526609bb5dd579c77845cedb385ccba1d3b8a638 Oct 30 20:18:55.587626 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.587589 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:18:55.587772 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.587678 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:18:55.587772 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.587725 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:18:55.748688 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.748651 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" event={"ID":"6de7d150-b3e9-44f2-9b6a-71e69df471a9","Type":"ContainerStarted","Data":"e2fe6d9f731b3f3e82666262385d84ceedd7c61cfe4093e3df0060b3bfdc5167"} Oct 30 20:18:55.749181 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.748707 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" event={"ID":"6de7d150-b3e9-44f2-9b6a-71e69df471a9","Type":"ContainerStarted","Data":"ff833d485cc586887b9a63e0385ff6c422ffa774a8790953763a80de315bf96a"} Oct 30 20:18:55.752268 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.752238 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" event={"ID":"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd","Type":"ContainerStarted","Data":"96b1c9741724402e163a667f134cfb07b1dcc35725f3d154b76b911ee3d63836"} Oct 30 20:18:55.752409 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.752283 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" event={"ID":"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd","Type":"ContainerStarted","Data":"f93f424211bc872dc02d06bb526609bb5dd579c77845cedb385ccba1d3b8a638"} Oct 30 20:18:55.755640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.755574 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" event={"ID":"6b463b25-8a3d-4b36-9925-5358b34f0c4c","Type":"ContainerStarted","Data":"827c121433535c10c59eb988b6ab6633dd7b921db9085db3fdc0db911a1eda4c"} Oct 30 20:18:55.755640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.755620 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" event={"ID":"6b463b25-8a3d-4b36-9925-5358b34f0c4c","Type":"ContainerStarted","Data":"10fe44f0e7a900103befd18a7146bb6543baae568d8f78caef4925812aa9c404"} Oct 30 20:18:55.778855 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.778776 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" podStartSLOduration=1.7787550109999999 podStartE2EDuration="1.778755011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:18:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:18:55.773031755 +0000 UTC m=+910.306304350" watchObservedRunningTime="2026-10-30 20:18:55.778755011 +0000 UTC m=+910.312027603" Oct 30 20:18:55.798762 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.798712 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" podStartSLOduration=1.798694474 podStartE2EDuration="1.798694474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:18:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:18:55.796149249 +0000 UTC m=+910.329421843" watchObservedRunningTime="2026-10-30 20:18:55.798694474 +0000 UTC m=+910.331967067" Oct 30 20:18:55.821844 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.821768 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" podStartSLOduration=1.821745839 podStartE2EDuration="1.821745839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:18:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:18:55.819161049 +0000 UTC m=+910.352433644" watchObservedRunningTime="2026-10-30 20:18:55.821745839 +0000 UTC m=+910.355018433" Oct 30 20:18:55.917484 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:55.917316 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:18:56.044242 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:56.044161 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:18:56.045418 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:56.045398 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body= Oct 30 20:18:56.045494 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:56.045445 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" podUID="6de7d150-b3e9-44f2-9b6a-71e69df471a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" Oct 30 20:18:56.286161 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:56.281500 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:18:56.290364 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:56.289459 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Oct 30 20:18:56.290364 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:56.289524 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" podUID="9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Oct 30 20:18:56.822245 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:18:56.822207 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:18:56.918722 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:56.918688 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Oct 30 20:18:56.918890 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:56.918740 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" podUID="6b463b25-8a3d-4b36-9925-5358b34f0c4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Oct 30 20:18:57.057354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:57.055757 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body= Oct 30 20:18:57.057354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:57.055820 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" podUID="6de7d150-b3e9-44f2-9b6a-71e69df471a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" Oct 30 20:18:57.282414 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:57.281748 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Oct 30 20:18:57.282414 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:57.281811 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" podUID="9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Oct 30 20:18:57.917832 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:57.917578 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Oct 30 20:18:57.917832 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:57.917626 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" podUID="6b463b25-8a3d-4b36-9925-5358b34f0c4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Oct 30 20:18:58.054354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:58.053734 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body= Oct 30 20:18:58.054354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:58.053801 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" podUID="6de7d150-b3e9-44f2-9b6a-71e69df471a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" Oct 30 20:18:58.193411 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:58.183954 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:58.216095 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:58.216065 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:58.281355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:58.280771 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Oct 30 20:18:58.281355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:58.280835 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" podUID="9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Oct 30 20:18:58.923806 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:58.923767 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Oct 30 20:18:58.924446 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:58.923817 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" podUID="6b463b25-8a3d-4b36-9925-5358b34f0c4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Oct 30 20:18:59.010254 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:59.009847 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:18:59.059355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:59.053053 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body= Oct 30 20:18:59.059355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:59.053110 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" podUID="6de7d150-b3e9-44f2-9b6a-71e69df471a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" Oct 30 20:18:59.342355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:59.328197 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Oct 30 20:18:59.342355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:59.328255 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" podUID="9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Oct 30 20:18:59.922221 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:59.921771 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Oct 30 20:18:59.922221 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:18:59.921833 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" podUID="6b463b25-8a3d-4b36-9925-5358b34f0c4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Oct 30 20:19:00.048350 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:00.044749 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body= Oct 30 20:19:00.048350 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:00.044825 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" podUID="6de7d150-b3e9-44f2-9b6a-71e69df471a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" Oct 30 20:19:00.288413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:00.287827 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Oct 30 20:19:00.288413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:00.287895 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" podUID="9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Oct 30 20:19:00.483353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:00.481427 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:19:00.921065 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:00.921030 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Oct 30 20:19:00.921431 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:00.921383 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" podUID="6b463b25-8a3d-4b36-9925-5358b34f0c4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Oct 30 20:19:01.043643 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:01.043597 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body= Oct 30 20:19:01.043951 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:01.043907 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" podUID="6de7d150-b3e9-44f2-9b6a-71e69df471a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" Oct 30 20:19:01.280070 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:01.279961 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Oct 30 20:19:01.280728 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:01.280677 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" podUID="9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Oct 30 20:19:01.787750 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:01.787584 5078 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:19:01.886351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:01.856509 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:19:01.945367 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:01.918840 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Oct 30 20:19:01.945367 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:01.918901 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" podUID="6b463b25-8a3d-4b36-9925-5358b34f0c4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Oct 30 20:19:02.117978 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:02.101673 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body= Oct 30 20:19:02.117978 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:02.101737 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" podUID="6de7d150-b3e9-44f2-9b6a-71e69df471a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" Oct 30 20:19:02.245364 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:02.218751 5078 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/health\": context deadline exceeded" Oct 30 20:19:02.302349 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:02.287749 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Oct 30 20:19:02.302349 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:02.287809 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" podUID="9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Oct 30 20:19:02.535412 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:02.534830 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:19:02.709993 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:02.709935 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 30 20:19:02.917635 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:02.917596 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Oct 30 20:19:02.917814 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:02.917679 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" podUID="6b463b25-8a3d-4b36-9925-5358b34f0c4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Oct 30 20:19:03.084994 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:03.084957 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body= Oct 30 20:19:03.085592 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:03.085399 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" podUID="6de7d150-b3e9-44f2-9b6a-71e69df471a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" Oct 30 20:19:03.288935 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:03.288836 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Oct 30 20:19:03.289201 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:03.289161 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" podUID="9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Oct 30 20:19:04.149501 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:04.149468 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:19:04.151531 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:04.151505 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:19:04.152718 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:04.152698 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:19:04.429723 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:04.429625 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:19:04.431231 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:04.431199 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:19:04.431923 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:04.431902 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:19:04.700972 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:04.700890 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:19:04.701196 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:04.701175 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:19:04.702160 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:04.702138 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:19:09.853349 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:09.853303 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6"] Oct 30 20:19:09.858213 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:09.858184 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:09.874403 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:09.871024 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6"] Oct 30 20:19:09.933438 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:09.933405 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx5ls\" (UniqueName: \"kubernetes.io/projected/e9729fb9-30d8-45ce-ad35-9e881630030a-kube-api-access-fx5ls\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:09.933438 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:09.933445 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-credential-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:09.933712 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:09.933573 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-workload-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:09.933712 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:09.933624 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-data\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:09.933826 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:09.933728 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-envoy\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:09.933826 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:09.933747 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9729fb9-30d8-45ce-ad35-9e881630030a-istiod-ca-cert\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:09.933826 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:09.933770 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-workload-certs\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:09.933985 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:09.933868 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-token\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:09.933985 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:09.933914 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-podinfo\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:10.034757 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.034726 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-token\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:10.034938 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.034773 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-podinfo\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:10.034938 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.034820 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx5ls\" (UniqueName: \"kubernetes.io/projected/e9729fb9-30d8-45ce-ad35-9e881630030a-kube-api-access-fx5ls\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:10.034938 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.034837 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-credential-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:10.034938 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.034894 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-workload-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:10.034938 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.034934 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-data\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:10.035198 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.035014 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-envoy\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:10.035198 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.035041 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9729fb9-30d8-45ce-ad35-9e881630030a-istiod-ca-cert\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:10.035198 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.035076 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-workload-certs\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:10.035414 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.035391 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-data\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:10.035476 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.035418 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-workload-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:10.035533 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.035504 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-workload-certs\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:10.035611 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.035591 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-credential-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:10.036138 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.036106 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9729fb9-30d8-45ce-ad35-9e881630030a-istiod-ca-cert\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:10.037509 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.037486 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-podinfo\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:10.037624 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.037542 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-envoy\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:10.050541 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.050518 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-token\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:10.051359 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.051323 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx5ls\" (UniqueName: \"kubernetes.io/projected/e9729fb9-30d8-45ce-ad35-9e881630030a-kube-api-access-fx5ls\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-t65d6\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:10.179953 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.179863 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:10.475235 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.475208 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6"] Oct 30 20:19:10.476785 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:19:10.476755 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9729fb9_30d8_45ce_ad35_9e881630030a.slice/crio-f4438a541d052deb82e01be0d9f1c16e4c95b83f874b816b2d3ec86424707c1a WatchSource:0}: Error finding container f4438a541d052deb82e01be0d9f1c16e4c95b83f874b816b2d3ec86424707c1a: Status 404 returned error can't find the container with id f4438a541d052deb82e01be0d9f1c16e4c95b83f874b816b2d3ec86424707c1a Oct 30 20:19:10.479371 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.479319 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:19:10.479448 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.479416 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:19:10.479486 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:10.479458 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:19:11.212081 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:11.212042 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" event={"ID":"e9729fb9-30d8-45ce-ad35-9e881630030a","Type":"ContainerStarted","Data":"815e9e387d5c0cda89b05d9986b3468c1b5183091005943e6cd29f19cd0959b9"} Oct 30 20:19:11.212517 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:11.212107 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" event={"ID":"e9729fb9-30d8-45ce-ad35-9e881630030a","Type":"ContainerStarted","Data":"f4438a541d052deb82e01be0d9f1c16e4c95b83f874b816b2d3ec86424707c1a"} Oct 30 20:19:11.256158 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:11.256090 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" podStartSLOduration=2.256069615 podStartE2EDuration="2.256069615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:19:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:19:11.252897252 +0000 UTC m=+925.786169850" watchObservedRunningTime="2026-10-30 20:19:11.256069615 +0000 UTC m=+925.789342209" Oct 30 20:19:12.181109 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:12.181078 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:12.182898 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:12.182875 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body= Oct 30 20:19:12.183001 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:12.182951 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" podUID="e9729fb9-30d8-45ce-ad35-9e881630030a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" Oct 30 20:19:13.180656 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:13.180621 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body= Oct 30 20:19:13.181058 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:13.180671 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" podUID="e9729fb9-30d8-45ce-ad35-9e881630030a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" Oct 30 20:19:14.185723 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:14.182093 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body= Oct 30 20:19:14.185723 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:14.182154 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" podUID="e9729fb9-30d8-45ce-ad35-9e881630030a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" Oct 30 20:19:15.181061 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:15.181028 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body= Oct 30 20:19:15.181247 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:15.181090 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" podUID="e9729fb9-30d8-45ce-ad35-9e881630030a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" Oct 30 20:19:16.180862 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:16.180828 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body= Oct 30 20:19:16.181394 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:16.180898 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" podUID="e9729fb9-30d8-45ce-ad35-9e881630030a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" Oct 30 20:19:17.180312 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:17.180272 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body= Oct 30 20:19:17.180532 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:17.180364 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" podUID="e9729fb9-30d8-45ce-ad35-9e881630030a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" Oct 30 20:19:18.414542 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:18.414493 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:18.415027 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:18.414903 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:18.416059 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:18.416039 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:19:24.982796 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:24.982717 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm"] Oct 30 20:19:24.987165 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:24.987144 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.002677 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.002641 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm"] Oct 30 20:19:25.115145 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.115114 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-workload-certs\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.115321 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.115154 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-workload-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.115321 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.115181 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-podinfo\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.115321 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.115284 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-token\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.115477 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.115438 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-envoy\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.115477 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.115459 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae1473f0-1f82-4e44-9a44-a76562d7a880-istiod-ca-cert\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.115543 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.115491 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-data\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.115543 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.115529 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-credential-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.115613 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.115583 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2jhl\" (UniqueName: \"kubernetes.io/projected/ae1473f0-1f82-4e44-9a44-a76562d7a880-kube-api-access-l2jhl\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.216935 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.216898 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-workload-certs\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.217127 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.216945 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-workload-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.217127 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.216976 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-podinfo\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.217127 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.217003 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-token\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.217307 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.217126 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-envoy\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.217307 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.217157 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae1473f0-1f82-4e44-9a44-a76562d7a880-istiod-ca-cert\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.217307 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.217206 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-data\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.217307 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.217254 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-credential-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.217307 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.217300 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2jhl\" (UniqueName: \"kubernetes.io/projected/ae1473f0-1f82-4e44-9a44-a76562d7a880-kube-api-access-l2jhl\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.217548 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.217299 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-workload-certs\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.217699 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.217668 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-data\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.217699 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.217688 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-credential-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.217843 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.217788 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-workload-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.218047 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.218024 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae1473f0-1f82-4e44-9a44-a76562d7a880-istiod-ca-cert\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.219478 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.219449 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-envoy\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.219673 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.219652 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-podinfo\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.232164 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.232141 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-token\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.233549 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.233502 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2jhl\" (UniqueName: \"kubernetes.io/projected/ae1473f0-1f82-4e44-9a44-a76562d7a880-kube-api-access-l2jhl\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.304719 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.304689 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:25.593165 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.593143 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm"] Oct 30 20:19:25.594646 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:19:25.594618 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae1473f0_1f82_4e44_9a44_a76562d7a880.slice/crio-35b8ccbb657eacccad3ffe63181837111be0a6394b41a50e3e7fb4678a440ebb WatchSource:0}: Error finding container 35b8ccbb657eacccad3ffe63181837111be0a6394b41a50e3e7fb4678a440ebb: Status 404 returned error can't find the container with id 35b8ccbb657eacccad3ffe63181837111be0a6394b41a50e3e7fb4678a440ebb Oct 30 20:19:25.597102 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.597071 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:19:25.597195 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.597138 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:19:25.597195 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:25.597166 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:19:26.417886 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:26.417845 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" event={"ID":"ae1473f0-1f82-4e44-9a44-a76562d7a880","Type":"ContainerStarted","Data":"aaca2aadf21d3860094760d99f290e5c57e827581a528f50e69711b9b87fb2b3"} Oct 30 20:19:26.418361 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:26.417905 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" event={"ID":"ae1473f0-1f82-4e44-9a44-a76562d7a880","Type":"ContainerStarted","Data":"35b8ccbb657eacccad3ffe63181837111be0a6394b41a50e3e7fb4678a440ebb"} Oct 30 20:19:26.459354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:26.459189 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" podStartSLOduration=2.459169239 podStartE2EDuration="2.459169239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:19:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:19:26.456727809 +0000 UTC m=+940.990000402" watchObservedRunningTime="2026-10-30 20:19:26.459169239 +0000 UTC m=+940.992441834" Oct 30 20:19:26.777561 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:19:26.777453 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:19:27.304997 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:27.304953 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:27.306827 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:27.306799 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body= Oct 30 20:19:27.306960 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:27.306850 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" podUID="ae1473f0-1f82-4e44-9a44-a76562d7a880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" Oct 30 20:19:28.305729 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:28.305678 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body= Oct 30 20:19:28.306134 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:28.305755 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" podUID="ae1473f0-1f82-4e44-9a44-a76562d7a880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" Oct 30 20:19:29.306354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:29.305673 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body= Oct 30 20:19:29.306354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:29.305749 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" podUID="ae1473f0-1f82-4e44-9a44-a76562d7a880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" Oct 30 20:19:30.305526 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:30.305487 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body= Oct 30 20:19:30.305842 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:30.305660 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" podUID="ae1473f0-1f82-4e44-9a44-a76562d7a880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" Oct 30 20:19:31.305681 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:31.305644 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body= Oct 30 20:19:31.306194 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:31.305710 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" podUID="ae1473f0-1f82-4e44-9a44-a76562d7a880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" Oct 30 20:19:32.310473 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:32.308758 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body= Oct 30 20:19:32.310473 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:32.308863 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" podUID="ae1473f0-1f82-4e44-9a44-a76562d7a880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" Oct 30 20:19:33.352453 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:33.352421 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:33.352897 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:33.352858 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:33.353884 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:33.353865 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:19:40.104617 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.104577 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2"] Oct 30 20:19:40.109492 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.109448 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.133185 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.133155 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2"] Oct 30 20:19:40.270448 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.270408 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-data\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.270632 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.270501 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-podinfo\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.270632 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.270554 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-token\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.270741 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.270631 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-workload-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.270802 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.270743 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-workload-certs\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.270802 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.270777 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istiod-ca-cert\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.270932 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.270911 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-envoy\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.270978 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.270940 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4jxv\" (UniqueName: \"kubernetes.io/projected/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-kube-api-access-w4jxv\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.270978 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.270965 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-credential-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.374409 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.372437 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-podinfo\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.390393 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.390361 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-token\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.391293 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.391269 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-workload-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.405714 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.405680 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-workload-certs\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.405930 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.391849 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-workload-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.406610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.405933 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istiod-ca-cert\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.406764 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.406740 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istiod-ca-cert\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.406983 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.406963 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-envoy\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.407092 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.407075 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4jxv\" (UniqueName: \"kubernetes.io/projected/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-kube-api-access-w4jxv\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.407212 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.407199 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-credential-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.407408 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.407388 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-data\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.408144 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.408022 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-data\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.408312 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.406531 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-workload-certs\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.412933 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.411938 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-credential-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.422853 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.417631 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-podinfo\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.422853 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.419882 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-envoy\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.424270 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.424239 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-token\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.448231 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.447447 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4jxv\" (UniqueName: \"kubernetes.io/projected/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-kube-api-access-w4jxv\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:40.727383 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:40.727261 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:41.020511 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:41.020480 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2"] Oct 30 20:19:41.021812 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:19:41.021788 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a38bcc_0f98_4cf5_901f_e7bd47f9755b.slice/crio-80686f41ad566621ffce142270f5d577967890f5353bc909a7d5ccb1671b034f WatchSource:0}: Error finding container 80686f41ad566621ffce142270f5d577967890f5353bc909a7d5ccb1671b034f: Status 404 returned error can't find the container with id 80686f41ad566621ffce142270f5d577967890f5353bc909a7d5ccb1671b034f Oct 30 20:19:41.024268 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:41.024235 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:19:41.024340 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:41.024314 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:19:41.024388 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:41.024377 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:19:41.606283 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:41.606246 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" event={"ID":"82a38bcc-0f98-4cf5-901f-e7bd47f9755b","Type":"ContainerStarted","Data":"33c34d533e597c3edd15d81b9a57fc921410261aaecea312cc8fb178d71a2ab9"} Oct 30 20:19:41.606725 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:41.606295 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" event={"ID":"82a38bcc-0f98-4cf5-901f-e7bd47f9755b","Type":"ContainerStarted","Data":"80686f41ad566621ffce142270f5d577967890f5353bc909a7d5ccb1671b034f"} Oct 30 20:19:41.631976 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:41.631930 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" podStartSLOduration=1.6319156719999999 podStartE2EDuration="1.631915672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:19:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:19:41.629573327 +0000 UTC m=+956.162845922" watchObservedRunningTime="2026-10-30 20:19:41.631915672 +0000 UTC m=+956.165188265" Oct 30 20:19:41.728436 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:41.728395 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:42.756487 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:42.756454 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body= Oct 30 20:19:42.757042 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:42.757008 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" podUID="82a38bcc-0f98-4cf5-901f-e7bd47f9755b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" Oct 30 20:19:43.727917 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:43.727879 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body= Oct 30 20:19:43.728107 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:43.727948 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" podUID="82a38bcc-0f98-4cf5-901f-e7bd47f9755b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" Oct 30 20:19:44.753355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:44.752484 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body= Oct 30 20:19:44.753355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:44.752567 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" podUID="82a38bcc-0f98-4cf5-901f-e7bd47f9755b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" Oct 30 20:19:45.754435 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:45.754323 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body= Oct 30 20:19:45.754959 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:45.754442 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" podUID="82a38bcc-0f98-4cf5-901f-e7bd47f9755b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" Oct 30 20:19:46.750351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:46.746598 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body= Oct 30 20:19:46.750351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:46.746671 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" podUID="82a38bcc-0f98-4cf5-901f-e7bd47f9755b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" Oct 30 20:19:47.731377 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:47.731319 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body= Oct 30 20:19:47.732016 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:47.731984 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" podUID="82a38bcc-0f98-4cf5-901f-e7bd47f9755b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" Oct 30 20:19:48.797549 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:48.797514 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:48.798014 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:48.797901 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:48.799144 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:48.799120 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:19:54.937903 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:54.937627 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74"] Oct 30 20:19:54.964649 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:54.964617 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:54.983517 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:54.983485 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74"] Oct 30 20:19:55.094704 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.094672 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cd57b86-49b2-4877-957a-cb8e27992937-istio-podinfo\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.094704 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.094713 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-istio-data\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.094981 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.094729 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cd57b86-49b2-4877-957a-cb8e27992937-istiod-ca-cert\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.094981 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.094896 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-workload-certs\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.094981 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.094960 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghwkb\" (UniqueName: \"kubernetes.io/projected/9cd57b86-49b2-4877-957a-cb8e27992937-kube-api-access-ghwkb\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.095090 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.095066 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cd57b86-49b2-4877-957a-cb8e27992937-istio-token\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.095128 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.095098 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-workload-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.095128 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.095122 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-istio-envoy\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.095203 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.095182 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-credential-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.145142 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.145105 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn"] Oct 30 20:19:55.149542 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.149521 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.167187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.167155 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn"] Oct 30 20:19:55.189708 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.189625 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64"] Oct 30 20:19:55.194931 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.194909 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.196631 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.196597 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cd57b86-49b2-4877-957a-cb8e27992937-istio-token\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.196750 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.196670 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-workload-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.196750 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.196709 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-istio-envoy\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.196889 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.196767 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-credential-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.196957 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.196932 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cd57b86-49b2-4877-957a-cb8e27992937-istio-podinfo\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.197022 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.196969 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-istio-data\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.197022 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.196993 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cd57b86-49b2-4877-957a-cb8e27992937-istiod-ca-cert\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.197126 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.197039 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-workload-certs\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.197126 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.197108 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghwkb\" (UniqueName: \"kubernetes.io/projected/9cd57b86-49b2-4877-957a-cb8e27992937-kube-api-access-ghwkb\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.197300 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.197270 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-credential-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.197495 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.197440 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-istio-data\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.197583 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.197558 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-workload-certs\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.198375 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.198347 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cd57b86-49b2-4877-957a-cb8e27992937-istiod-ca-cert\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.199605 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.199586 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-workload-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.199981 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.199645 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-istio-envoy\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.199981 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.199791 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cd57b86-49b2-4877-957a-cb8e27992937-istio-podinfo\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.222918 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.222888 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cd57b86-49b2-4877-957a-cb8e27992937-istio-token\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.226159 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.226113 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghwkb\" (UniqueName: \"kubernetes.io/projected/9cd57b86-49b2-4877-957a-cb8e27992937-kube-api-access-ghwkb\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-sdh74\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.232634 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.232614 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64"] Oct 30 20:19:55.284401 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.284360 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:55.298894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.298869 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50d97c5f-9b0e-4851-b1b5-400c74b23352-istiod-ca-cert\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.299012 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.298906 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-envoy\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.299012 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.298989 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-workload-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.299121 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.299032 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-token\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.299184 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.299128 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istiod-ca-cert\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.299184 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.299153 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-workload-certs\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.299292 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.299243 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-data\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.299362 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.299312 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-workload-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.299362 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.299345 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9r8t\" (UniqueName: \"kubernetes.io/projected/50d97c5f-9b0e-4851-b1b5-400c74b23352-kube-api-access-n9r8t\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.299477 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.299377 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-podinfo\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.299477 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.299438 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-token\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.299707 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.299534 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-credential-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.299707 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.299554 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55phw\" (UniqueName: \"kubernetes.io/projected/48a25fb9-3214-4c1c-95fe-d751ad4372e4-kube-api-access-55phw\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.299707 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.299591 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-workload-certs\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.299707 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.299607 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-envoy\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.299707 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.299664 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-data\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.299707 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.299691 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-podinfo\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.299707 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.299709 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-credential-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.406369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.404346 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50d97c5f-9b0e-4851-b1b5-400c74b23352-istiod-ca-cert\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.406369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.404409 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-envoy\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.406369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.404458 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-workload-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.406369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.404492 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-token\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.406369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.404550 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istiod-ca-cert\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.406369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.404583 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-workload-certs\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.406369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.404640 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-data\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.406369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.404678 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-workload-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.406369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.404703 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9r8t\" (UniqueName: \"kubernetes.io/projected/50d97c5f-9b0e-4851-b1b5-400c74b23352-kube-api-access-n9r8t\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.406369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.404752 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-podinfo\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.406369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.404779 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-token\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.406369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.404850 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-credential-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.406369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.404874 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55phw\" (UniqueName: \"kubernetes.io/projected/48a25fb9-3214-4c1c-95fe-d751ad4372e4-kube-api-access-55phw\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.406369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.404936 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-workload-certs\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.406369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.404961 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-envoy\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.406369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.404993 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-data\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.406369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.405024 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-podinfo\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.406369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.405050 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-credential-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.406369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.405659 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-credential-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.406369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.406312 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50d97c5f-9b0e-4851-b1b5-400c74b23352-istiod-ca-cert\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.407544 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.407118 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-workload-certs\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.412391 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.407691 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-credential-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.412391 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.408185 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-workload-certs\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.412391 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.408525 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-workload-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.412391 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.409425 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istiod-ca-cert\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.412391 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.409694 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-data\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.412391 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.410564 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-data\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.412391 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.411604 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-workload-socket\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.413892 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.413830 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-envoy\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.415276 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.415225 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-podinfo\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.416036 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.416016 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-envoy\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.417387 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.417342 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-podinfo\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.420420 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.420358 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55phw\" (UniqueName: \"kubernetes.io/projected/48a25fb9-3214-4c1c-95fe-d751ad4372e4-kube-api-access-55phw\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.420778 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.420756 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-token\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.421845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.421811 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-token\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.422912 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.422891 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9r8t\" (UniqueName: \"kubernetes.io/projected/50d97c5f-9b0e-4851-b1b5-400c74b23352-kube-api-access-n9r8t\") pod \"e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.464295 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.463991 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:55.568405 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.568367 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:55.664794 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.664761 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74"] Oct 30 20:19:55.669776 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:19:55.669750 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd57b86_49b2_4877_957a_cb8e27992937.slice/crio-deaf3d47690c4dc02975c54329f81d79763770e2a9ca0c73f76ff0ad0e524b73 WatchSource:0}: Error finding container deaf3d47690c4dc02975c54329f81d79763770e2a9ca0c73f76ff0ad0e524b73: Status 404 returned error can't find the container with id deaf3d47690c4dc02975c54329f81d79763770e2a9ca0c73f76ff0ad0e524b73 Oct 30 20:19:55.672692 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.672662 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:19:55.672781 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.672726 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:19:55.672781 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.672758 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:19:55.729294 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.729214 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" event={"ID":"9cd57b86-49b2-4877-957a-cb8e27992937","Type":"ContainerStarted","Data":"deaf3d47690c4dc02975c54329f81d79763770e2a9ca0c73f76ff0ad0e524b73"} Oct 30 20:19:55.780643 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.780613 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn"] Oct 30 20:19:55.781098 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:19:55.781074 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a25fb9_3214_4c1c_95fe_d751ad4372e4.slice/crio-3690c8288137f977cc2d68d5e7f2ea0106d46c7110c1567b528d65dde0ca9b80 WatchSource:0}: Error finding container 3690c8288137f977cc2d68d5e7f2ea0106d46c7110c1567b528d65dde0ca9b80: Status 404 returned error can't find the container with id 3690c8288137f977cc2d68d5e7f2ea0106d46c7110c1567b528d65dde0ca9b80 Oct 30 20:19:55.784579 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.784526 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:19:55.784741 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.784605 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:19:55.784741 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.784646 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:19:55.869743 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.869718 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64"] Oct 30 20:19:55.871252 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:19:55.871225 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d97c5f_9b0e_4851_b1b5_400c74b23352.slice/crio-33c2c13eb439b11acb99a2c337aacd9287d2e23ce941f00294a62a1ebe142b0b WatchSource:0}: Error finding container 33c2c13eb439b11acb99a2c337aacd9287d2e23ce941f00294a62a1ebe142b0b: Status 404 returned error can't find the container with id 33c2c13eb439b11acb99a2c337aacd9287d2e23ce941f00294a62a1ebe142b0b Oct 30 20:19:55.873773 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.873741 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:19:55.873859 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.873804 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:19:55.873859 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:55.873838 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:19:56.774666 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:19:56.774584 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:19:56.813268 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:56.813230 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" event={"ID":"50d97c5f-9b0e-4851-b1b5-400c74b23352","Type":"ContainerStarted","Data":"7ff3e0cd535e3e9bc506d13542a819d0236d1f9992c4ecc9ae9b766b7d2037f7"} Oct 30 20:19:56.813491 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:56.813309 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" event={"ID":"50d97c5f-9b0e-4851-b1b5-400c74b23352","Type":"ContainerStarted","Data":"33c2c13eb439b11acb99a2c337aacd9287d2e23ce941f00294a62a1ebe142b0b"} Oct 30 20:19:56.815855 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:56.815832 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" event={"ID":"9cd57b86-49b2-4877-957a-cb8e27992937","Type":"ContainerStarted","Data":"9ab65249dfff427ddb60be74cb14ce1e972bd876367cb99f97529f963ff74f43"} Oct 30 20:19:56.817309 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:56.817288 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" event={"ID":"48a25fb9-3214-4c1c-95fe-d751ad4372e4","Type":"ContainerStarted","Data":"f7b43e46b3d8299ae04cd481136ed1d5e4f9c08105486b4a20ef4690179b79ea"} Oct 30 20:19:56.817502 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:56.817484 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" event={"ID":"48a25fb9-3214-4c1c-95fe-d751ad4372e4","Type":"ContainerStarted","Data":"3690c8288137f977cc2d68d5e7f2ea0106d46c7110c1567b528d65dde0ca9b80"} Oct 30 20:19:56.870350 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:56.866479 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" podStartSLOduration=1.8664587350000001 podStartE2EDuration="1.866458735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:19:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:19:56.84983448 +0000 UTC m=+971.383107075" watchObservedRunningTime="2026-10-30 20:19:56.866458735 +0000 UTC m=+971.399731330" Oct 30 20:19:56.912627 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:56.912564 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" podStartSLOduration=1.9125423590000001 podStartE2EDuration="1.912542359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:19:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:19:56.908369846 +0000 UTC m=+971.441642439" watchObservedRunningTime="2026-10-30 20:19:56.912542359 +0000 UTC m=+971.445814955" Oct 30 20:19:56.975403 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:56.975301 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" podStartSLOduration=2.97526737 podStartE2EDuration="2.97526737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:19:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:19:56.957210431 +0000 UTC m=+971.490483028" watchObservedRunningTime="2026-10-30 20:19:56.97526737 +0000 UTC m=+971.508539965" Oct 30 20:19:57.287545 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:57.287507 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:19:57.289661 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:57.289632 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body= Oct 30 20:19:57.289923 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:57.289883 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" podUID="9cd57b86-49b2-4877-957a-cb8e27992937" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" Oct 30 20:19:57.469968 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:57.469938 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:19:57.471322 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:57.471292 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Oct 30 20:19:57.471568 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:57.471541 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" podUID="48a25fb9-3214-4c1c-95fe-d751ad4372e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Oct 30 20:19:57.572894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:57.572852 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:19:57.573213 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:57.573036 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body= Oct 30 20:19:57.573426 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:57.573398 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" podUID="50d97c5f-9b0e-4851-b1b5-400c74b23352" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" Oct 30 20:19:58.291893 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:58.291853 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body= Oct 30 20:19:58.292559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:58.292524 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" podUID="9cd57b86-49b2-4877-957a-cb8e27992937" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" Oct 30 20:19:58.466356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:58.465597 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Oct 30 20:19:58.466356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:58.465763 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" podUID="48a25fb9-3214-4c1c-95fe-d751ad4372e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Oct 30 20:19:58.587099 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:58.587063 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body= Oct 30 20:19:58.587458 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:58.587425 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" podUID="50d97c5f-9b0e-4851-b1b5-400c74b23352" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" Oct 30 20:19:59.290354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:59.289756 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body= Oct 30 20:19:59.290354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:59.289834 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" podUID="9cd57b86-49b2-4877-957a-cb8e27992937" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" Oct 30 20:19:59.478356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:59.465664 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Oct 30 20:19:59.478356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:59.465735 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" podUID="48a25fb9-3214-4c1c-95fe-d751ad4372e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Oct 30 20:19:59.594354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:59.593844 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body= Oct 30 20:19:59.594354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:19:59.593905 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" podUID="50d97c5f-9b0e-4851-b1b5-400c74b23352" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" Oct 30 20:20:00.293188 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:00.292726 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body= Oct 30 20:20:00.293188 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:00.292789 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" podUID="9cd57b86-49b2-4877-957a-cb8e27992937" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" Oct 30 20:20:00.473356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:00.468898 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Oct 30 20:20:00.473356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:00.468957 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" podUID="48a25fb9-3214-4c1c-95fe-d751ad4372e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Oct 30 20:20:00.576355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:00.569846 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body= Oct 30 20:20:00.576355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:00.569924 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" podUID="50d97c5f-9b0e-4851-b1b5-400c74b23352" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" Oct 30 20:20:01.285941 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:01.285885 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body= Oct 30 20:20:01.286226 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:01.286198 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" podUID="9cd57b86-49b2-4877-957a-cb8e27992937" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" Oct 30 20:20:01.482356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:01.471120 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Oct 30 20:20:01.482356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:01.471207 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" podUID="48a25fb9-3214-4c1c-95fe-d751ad4372e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Oct 30 20:20:01.577353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:01.571532 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body= Oct 30 20:20:01.577353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:01.571593 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" podUID="50d97c5f-9b0e-4851-b1b5-400c74b23352" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" Oct 30 20:20:02.285765 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:02.285721 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body= Oct 30 20:20:02.285970 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:02.285785 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" podUID="9cd57b86-49b2-4877-957a-cb8e27992937" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" Oct 30 20:20:02.465437 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:02.465394 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Oct 30 20:20:02.465621 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:02.465459 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" podUID="48a25fb9-3214-4c1c-95fe-d751ad4372e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Oct 30 20:20:02.568886 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:02.568850 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body= Oct 30 20:20:02.569103 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:02.568915 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" podUID="50d97c5f-9b0e-4851-b1b5-400c74b23352" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" Oct 30 20:20:03.304352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:03.298962 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body= Oct 30 20:20:03.304352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:03.299021 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" podUID="9cd57b86-49b2-4877-957a-cb8e27992937" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" Oct 30 20:20:03.466722 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:03.466678 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Oct 30 20:20:03.467035 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:03.466999 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" podUID="48a25fb9-3214-4c1c-95fe-d751ad4372e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Oct 30 20:20:03.576357 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:03.572666 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body= Oct 30 20:20:03.576357 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:03.572732 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" podUID="50d97c5f-9b0e-4851-b1b5-400c74b23352" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" Oct 30 20:20:05.288034 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:05.287464 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:20:05.288034 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:05.287530 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" podUID="9cd57b86-49b2-4877-957a-cb8e27992937" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:05.541409 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:05.540908 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:20:05.547360 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:05.543929 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:20:05.575355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:05.549736 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:05.605352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:05.579565 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:20:05.608791 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:05.608755 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:20:05.609018 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:05.608994 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" podUID="48a25fb9-3214-4c1c-95fe-d751ad4372e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:05.644459 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:05.644413 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:05.674518 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:05.674481 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:20:05.674781 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:05.674755 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" podUID="50d97c5f-9b0e-4851-b1b5-400c74b23352" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:05.894376 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:05.894282 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:06.653354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:06.638478 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:06.653354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:06.639081 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:20:06.679809 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:06.679755 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:20:06.682723 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:06.682680 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" podUID="48a25fb9-3214-4c1c-95fe-d751ad4372e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:06.716236 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:06.716172 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:06.728052 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:06.728012 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:20:06.758356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:06.750546 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:20:06.758356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:06.750632 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" podUID="50d97c5f-9b0e-4851-b1b5-400c74b23352" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:06.860039 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:06.860000 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:20:07.015299 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:07.015205 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:20:07.051866 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:07.051836 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:20:07.266944 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:07.265666 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:20:07.469363 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:07.451273 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded" Oct 30 20:20:07.638767 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:07.638722 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:07.706361 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:07.704881 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:20:07.706361 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:07.704995 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:20:07.888490 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:07.865369 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:08.022578 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:08.022490 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:20:08.023241 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:08.023217 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:20:08.380176 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:08.380146 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:20:08.381813 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:08.381783 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:20:22.005353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:22.004550 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded" Oct 30 20:20:22.395001 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:22.394952 5078 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:22.587507 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:22.587457 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:22.643299 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:22.587794 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded" Oct 30 20:20:23.060355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:23.060239 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:23.060944 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:23.060399 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:20:23.060944 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:23.060444 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" podUID="48a25fb9-3214-4c1c-95fe-d751ad4372e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:23.060944 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:23.060817 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:20:23.152906 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:23.152876 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:20:24.995095 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:24.995058 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98"] Oct 30 20:20:25.000892 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.000865 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.019432 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.019405 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98"] Oct 30 20:20:25.175034 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.174978 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7"] Oct 30 20:20:25.182089 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.182064 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.192832 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.192797 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7"] Oct 30 20:20:25.256064 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.255966 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8debf693-923a-42c5-9811-1ccfd37cca82-istio-podinfo\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.256064 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.256040 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8debf693-923a-42c5-9811-1ccfd37cca82-istio-token\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.256272 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.256175 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-istio-envoy\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.256272 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.256218 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn5sh\" (UniqueName: \"kubernetes.io/projected/8debf693-923a-42c5-9811-1ccfd37cca82-kube-api-access-vn5sh\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.256399 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.256290 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-istio-data\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.256399 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.256381 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8debf693-923a-42c5-9811-1ccfd37cca82-istiod-ca-cert\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.256486 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.256438 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-workload-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.256486 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.256456 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-credential-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.256609 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.256588 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-workload-certs\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.358501 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.358450 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8debf693-923a-42c5-9811-1ccfd37cca82-istiod-ca-cert\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.358501 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.358515 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-workload-certs\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.358776 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.358535 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6beb222b-b89e-4518-aea1-692285cc2951-istio-token\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.358776 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.358575 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-workload-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.358776 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.358594 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-credential-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.358776 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.358711 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-workload-certs\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.358776 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.358743 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r59f\" (UniqueName: \"kubernetes.io/projected/6beb222b-b89e-4518-aea1-692285cc2951-kube-api-access-5r59f\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.359084 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.358787 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8debf693-923a-42c5-9811-1ccfd37cca82-istio-podinfo\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.359084 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.358885 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6beb222b-b89e-4518-aea1-692285cc2951-istiod-ca-cert\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.359084 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.358946 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8debf693-923a-42c5-9811-1ccfd37cca82-istio-token\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.359084 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.358996 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-credential-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.359084 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.359032 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-istio-envoy\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.359084 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.359053 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-workload-socket\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.359084 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.359081 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-workload-certs\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.359455 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.359091 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-credential-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.359455 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.359149 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-istio-data\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.359455 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.359194 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn5sh\" (UniqueName: \"kubernetes.io/projected/8debf693-923a-42c5-9811-1ccfd37cca82-kube-api-access-vn5sh\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.359455 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.359226 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-workload-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.359455 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.359295 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6beb222b-b89e-4518-aea1-692285cc2951-istio-podinfo\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.359455 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.359325 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-istio-envoy\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.359455 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.359319 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8debf693-923a-42c5-9811-1ccfd37cca82-istiod-ca-cert\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.359455 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.359446 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-istio-data\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.359832 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.359764 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-istio-data\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.361726 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.361700 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-istio-envoy\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.361875 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.361857 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8debf693-923a-42c5-9811-1ccfd37cca82-istio-podinfo\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.371853 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.371832 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8debf693-923a-42c5-9811-1ccfd37cca82-istio-token\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.371965 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.371949 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn5sh\" (UniqueName: \"kubernetes.io/projected/8debf693-923a-42c5-9811-1ccfd37cca82-kube-api-access-vn5sh\") pod \"e2e-worker-w2-909519-openshift-default-665577cd95-7zc98\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.461120 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.461084 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r59f\" (UniqueName: \"kubernetes.io/projected/6beb222b-b89e-4518-aea1-692285cc2951-kube-api-access-5r59f\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.461314 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.461157 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6beb222b-b89e-4518-aea1-692285cc2951-istiod-ca-cert\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.461314 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.461209 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-credential-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.461314 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.461245 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-istio-data\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.461314 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.461272 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-workload-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.461314 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.461309 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6beb222b-b89e-4518-aea1-692285cc2951-istio-podinfo\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.461610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.461351 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-istio-envoy\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.461610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.461477 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-workload-certs\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.461610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.461508 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6beb222b-b89e-4518-aea1-692285cc2951-istio-token\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.461764 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.461695 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-workload-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.461847 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.461824 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-credential-socket\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.461918 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.461872 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-istio-data\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.462068 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.462045 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6beb222b-b89e-4518-aea1-692285cc2951-istiod-ca-cert\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.462126 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.462066 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-workload-certs\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.463894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.463868 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-istio-envoy\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.464048 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.464019 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6beb222b-b89e-4518-aea1-692285cc2951-istio-podinfo\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.474667 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.474635 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6beb222b-b89e-4518-aea1-692285cc2951-istio-token\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.477734 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.477706 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r59f\" (UniqueName: \"kubernetes.io/projected/6beb222b-b89e-4518-aea1-692285cc2951-kube-api-access-5r59f\") pod \"e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.502871 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.502844 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:25.620344 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.620295 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:25.792643 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.792619 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7"] Oct 30 20:20:25.793361 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:20:25.793299 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6beb222b_b89e_4518_aea1_692285cc2951.slice/crio-0641dc22486d3c344a7894f7eb30294fe06279c678c2f1ba62bdbf756f32d531 WatchSource:0}: Error finding container 0641dc22486d3c344a7894f7eb30294fe06279c678c2f1ba62bdbf756f32d531: Status 404 returned error can't find the container with id 0641dc22486d3c344a7894f7eb30294fe06279c678c2f1ba62bdbf756f32d531 Oct 30 20:20:25.795773 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.795741 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:20:25.795854 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.795807 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:20:25.795854 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.795836 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:20:25.957351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.947893 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98"] Oct 30 20:20:25.982354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.970580 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:20:25.982354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.970679 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:20:25.982354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:25.970723 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:20:26.194268 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:26.193963 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" event={"ID":"8debf693-923a-42c5-9811-1ccfd37cca82","Type":"ContainerStarted","Data":"b6b0a3aa14670fdcdfefceea3f2767ae599534728cdbd0ad6b2a9325e1e7e897"} Oct 30 20:20:26.194268 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:26.194044 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" event={"ID":"8debf693-923a-42c5-9811-1ccfd37cca82","Type":"ContainerStarted","Data":"d2d2f7d86444725324af9e90de3a48b8b65f4e954ad4b5b9a53daa9f84a1e17c"} Oct 30 20:20:26.196049 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:26.196004 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" event={"ID":"6beb222b-b89e-4518-aea1-692285cc2951","Type":"ContainerStarted","Data":"86216c7652977261d5c2162168871fc6f7bcaf9b456185475e000ea10005a203"} Oct 30 20:20:26.196194 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:26.196074 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" event={"ID":"6beb222b-b89e-4518-aea1-692285cc2951","Type":"ContainerStarted","Data":"0641dc22486d3c344a7894f7eb30294fe06279c678c2f1ba62bdbf756f32d531"} Oct 30 20:20:26.223712 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:26.223651 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" podStartSLOduration=2.223633267 podStartE2EDuration="2.223633267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:20:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:20:26.219463856 +0000 UTC m=+1000.752736460" watchObservedRunningTime="2026-10-30 20:20:26.223633267 +0000 UTC m=+1000.756905862" Oct 30 20:20:26.246814 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:26.246755 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" podStartSLOduration=1.246738871 podStartE2EDuration="1.246738871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:20:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:20:26.246408267 +0000 UTC m=+1000.779680860" watchObservedRunningTime="2026-10-30 20:20:26.246738871 +0000 UTC m=+1000.780011467" Oct 30 20:20:26.503682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:26.503648 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:26.504890 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:26.504864 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Oct 30 20:20:26.504996 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:26.504913 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" podUID="6beb222b-b89e-4518-aea1-692285cc2951" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Oct 30 20:20:26.621754 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:26.621420 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:26.700325 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:20:26.700288 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:20:27.503362 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:27.503303 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Oct 30 20:20:27.504095 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:27.503805 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" podUID="6beb222b-b89e-4518-aea1-692285cc2951" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Oct 30 20:20:27.622828 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:27.622652 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Oct 30 20:20:27.622828 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:27.622705 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" podUID="8debf693-923a-42c5-9811-1ccfd37cca82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Oct 30 20:20:28.503812 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:28.503771 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Oct 30 20:20:28.504214 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:28.503842 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" podUID="6beb222b-b89e-4518-aea1-692285cc2951" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Oct 30 20:20:28.621007 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:28.620965 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Oct 30 20:20:28.621208 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:28.621022 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" podUID="8debf693-923a-42c5-9811-1ccfd37cca82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Oct 30 20:20:29.504130 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:29.504097 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Oct 30 20:20:29.504574 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:29.504149 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" podUID="6beb222b-b89e-4518-aea1-692285cc2951" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Oct 30 20:20:29.621654 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:29.621618 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Oct 30 20:20:29.621825 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:29.621663 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" podUID="8debf693-923a-42c5-9811-1ccfd37cca82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Oct 30 20:20:30.503489 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:30.503450 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Oct 30 20:20:30.503668 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:30.503510 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" podUID="6beb222b-b89e-4518-aea1-692285cc2951" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Oct 30 20:20:30.620679 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:30.620648 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Oct 30 20:20:30.621078 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:30.620702 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" podUID="8debf693-923a-42c5-9811-1ccfd37cca82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Oct 30 20:20:31.510853 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:31.510800 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Oct 30 20:20:31.511113 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:31.510915 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" podUID="6beb222b-b89e-4518-aea1-692285cc2951" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Oct 30 20:20:31.629512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:31.623758 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Oct 30 20:20:31.629512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:31.623818 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" podUID="8debf693-923a-42c5-9811-1ccfd37cca82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Oct 30 20:20:32.392982 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:32.392920 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:32.507365 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:32.504695 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Oct 30 20:20:32.507365 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:32.504769 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" podUID="6beb222b-b89e-4518-aea1-692285cc2951" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Oct 30 20:20:32.637351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:32.627433 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Oct 30 20:20:32.637351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:32.627513 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" podUID="8debf693-923a-42c5-9811-1ccfd37cca82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Oct 30 20:20:33.168151 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:33.168091 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:33.414363 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:33.401444 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:33.432813 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:33.415073 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:20:33.502378 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:33.494715 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:33.532402 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:33.512010 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Oct 30 20:20:33.532402 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:33.512093 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" podUID="6beb222b-b89e-4518-aea1-692285cc2951" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Oct 30 20:20:33.940415 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:33.744793 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Oct 30 20:20:33.971356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:33.970895 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" podUID="8debf693-923a-42c5-9811-1ccfd37cca82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Oct 30 20:20:34.174715 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:34.174666 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:34.247151 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:34.247059 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:20:34.384438 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:34.247754 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:20:34.472357 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:34.384418 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" podUID="62edb9f6-a9af-4488-849b-6c9115b79513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:34.622792 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:34.427465 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:20:34.633354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:34.629687 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" podUID="ae1473f0-1f82-4e44-9a44-a76562d7a880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:34.633354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:34.521435 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded" Oct 30 20:20:34.659386 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:34.427646 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:34.730364 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:34.483970 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:20:34.768358 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:34.743464 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" podUID="e9729fb9-30d8-45ce-ad35-9e881630030a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:34.869721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:34.733701 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:20:34.880441 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:34.627610 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Oct 30 20:20:34.903546 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:34.736486 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Oct 30 20:20:34.903546 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:34.894377 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" podUID="8debf693-923a-42c5-9811-1ccfd37cca82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Oct 30 20:20:34.903546 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:34.890341 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" podUID="6beb222b-b89e-4518-aea1-692285cc2951" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Oct 30 20:20:35.046960 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:35.039522 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:20:35.046960 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:35.039632 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" podUID="179c807f-ec84-47b4-ba09-51354cbcff6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:35.199858 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:35.199736 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:35.535914 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:35.535819 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Oct 30 20:20:35.536182 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:35.536147 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" podUID="6beb222b-b89e-4518-aea1-692285cc2951" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Oct 30 20:20:35.730492 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:35.693505 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded" Oct 30 20:20:35.730492 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:35.706506 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded" Oct 30 20:20:35.876354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:35.876248 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Oct 30 20:20:35.876354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:35.876310 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" podUID="8debf693-923a-42c5-9811-1ccfd37cca82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Oct 30 20:20:35.900355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:35.881067 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:20:35.900355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:35.881131 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" podUID="9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:36.219416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:36.219301 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:36.509272 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:36.509167 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Oct 30 20:20:36.514164 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:36.514127 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" podUID="6beb222b-b89e-4518-aea1-692285cc2951" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Oct 30 20:20:36.593582 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:36.593543 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:20:36.593863 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:36.593833 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" podUID="9cd57b86-49b2-4877-957a-cb8e27992937" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:36.643365 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:36.642470 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Oct 30 20:20:36.643365 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:36.642535 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" podUID="8debf693-923a-42c5-9811-1ccfd37cca82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Oct 30 20:20:36.694517 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:36.694445 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:36.710349 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:36.709407 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:36.910767 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:36.910634 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:20:36.911214 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:36.911187 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:20:36.959262 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:36.958342 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:20:37.503675 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:37.503637 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Oct 30 20:20:37.504191 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:37.503718 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" podUID="6beb222b-b89e-4518-aea1-692285cc2951" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Oct 30 20:20:37.637350 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:37.630716 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Oct 30 20:20:37.637350 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:37.630776 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" podUID="8debf693-923a-42c5-9811-1ccfd37cca82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Oct 30 20:20:38.772814 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:38.772779 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:38.774524 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:38.774494 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:38.775514 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:38.775497 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:20:39.545514 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:39.545475 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:20:39.545807 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:39.545772 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" podUID="6beb222b-b89e-4518-aea1-692285cc2951" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:40.175597 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:40.175566 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:40.176436 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:40.176384 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:40.178867 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:40.178839 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:20:46.259504 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:46.259453 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:46.677511 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:46.677460 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:46.715514 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:46.715458 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded" Oct 30 20:20:47.302390 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:47.298401 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded" Oct 30 20:20:47.326354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:47.315040 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:20:47.747365 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:47.692925 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:47.747365 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:47.716418 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:47.978360 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:47.960918 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:20:47.997987 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:47.997886 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:20:48.368513 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:48.368466 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:48.798406 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:48.784373 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded" Oct 30 20:20:48.798406 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:48.784709 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded" Oct 30 20:20:48.922917 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:48.922879 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:20:49.370929 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:49.370898 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:20:49.422820 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:49.422781 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:20:49.423121 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:49.423074 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" podUID="62edb9f6-a9af-4488-849b-6c9115b79513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:49.507580 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:49.507543 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:20:49.507852 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:49.507822 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" podUID="e9729fb9-30d8-45ce-ad35-9e881630030a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:49.547863 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:49.547823 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:20:49.548152 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:49.548122 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" podUID="ae1473f0-1f82-4e44-9a44-a76562d7a880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:20:49.742272 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:20:49.742189 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:20:56.699781 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:20:56.699701 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:21:02.798354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:02.790451 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded" Oct 30 20:21:03.428354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:03.427427 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:03.809352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:03.807135 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:03.809352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:03.807894 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:21:04.189504 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:04.189396 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:21:04.190218 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:04.189758 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" podUID="62edb9f6-a9af-4488-849b-6c9115b79513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:04.495896 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:04.479871 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:21:04.819444 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:04.812850 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:21:04.819444 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:04.812940 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" podUID="179c807f-ec84-47b4-ba09-51354cbcff6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:04.877354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:04.860600 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:21:04.877354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:04.860681 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" podUID="82a38bcc-0f98-4cf5-901f-e7bd47f9755b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:04.958765 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:04.956449 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded" Oct 30 20:21:19.388355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:19.387441 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:19.433286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:19.433238 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded" Oct 30 20:21:19.852351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:19.851676 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:21:19.852351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:19.851790 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" podUID="82a38bcc-0f98-4cf5-901f-e7bd47f9755b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:19.898351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:19.898139 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:21:19.898351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:19.898227 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" podUID="179c807f-ec84-47b4-ba09-51354cbcff6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:19.928735 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:19.928688 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:20.414355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:20.398495 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:20.414355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:20.399041 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:21:20.437353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:20.433842 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:20.455421 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:20.442586 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:21:20.964359 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:20.956671 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded" Oct 30 20:21:20.994161 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:20.994132 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:21:21.108125 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:21.108096 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:21:21.132541 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:21.132091 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:21:21.149224 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:21.149189 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:21:26.701813 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:21:26.701773 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:21:31.129353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:31.128592 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded" Oct 30 20:21:31.796367 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:31.794804 5078 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/health\": context deadline exceeded" Oct 30 20:21:32.138506 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:32.138456 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded" Oct 30 20:21:32.231271 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:32.176556 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:32.231701 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:32.225451 5078 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:32.287356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:32.273436 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:32.287356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:32.274543 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:21:33.232192 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:33.232137 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:33.250844 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:33.236876 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:21:33.262766 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:33.250302 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded" Oct 30 20:21:33.262766 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:33.261864 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:21:33.353380 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:33.314512 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:34.226464 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:34.226429 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:21:34.234353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:34.230494 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" podUID="62edb9f6-a9af-4488-849b-6c9115b79513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:34.261458 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:34.245951 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:34.288365 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:34.262027 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded" Oct 30 20:21:34.433353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:34.346908 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:34.630357 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:34.610066 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:21:34.630357 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:34.610135 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" podUID="e9729fb9-30d8-45ce-ad35-9e881630030a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:34.630357 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:34.612816 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:21:34.630357 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:34.612866 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" podUID="ae1473f0-1f82-4e44-9a44-a76562d7a880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:34.825354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:34.824912 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:21:34.825354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:34.824978 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" podUID="179c807f-ec84-47b4-ba09-51354cbcff6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:34.880232 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:34.880192 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:21:34.880573 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:34.880503 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" podUID="82a38bcc-0f98-4cf5-901f-e7bd47f9755b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:35.269523 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:35.269411 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:35.466355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:35.465426 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:35.476615 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:35.469412 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:35.782828 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:35.782786 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:21:35.783118 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:35.783088 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" podUID="9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:35.942614 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:35.942570 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:21:35.983610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:35.982410 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:21:36.107445 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:36.107416 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:21:51.313360 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:51.312439 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:51.470517 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:51.469420 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded" Oct 30 20:21:51.476461 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:51.475404 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:51.793438 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:51.793315 5078 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/health\": context deadline exceeded" Oct 30 20:21:52.219519 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:52.219460 5078 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:52.343354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:52.330418 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded" Oct 30 20:21:52.369680 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:52.347704 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:21:52.566857 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:52.474459 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:52.566857 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:52.497934 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:21:53.041416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:53.023953 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:21:53.041416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:53.024037 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" podUID="48a25fb9-3214-4c1c-95fe-d751ad4372e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:53.341056 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:53.341014 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded" Oct 30 20:21:53.507278 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:53.478487 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded" Oct 30 20:21:53.546382 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:53.507932 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded" Oct 30 20:21:53.700841 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:53.700744 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:21:53.701101 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:53.701074 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" podUID="50d97c5f-9b0e-4851-b1b5-400c74b23352" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:54.408352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:54.376587 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:54.480482 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:54.480434 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded" Oct 30 20:21:54.501369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:54.481526 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:21:54.616364 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:54.604710 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:54.678457 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:54.648896 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:21:54.686463 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:54.686413 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" podUID="ca42f8ad-24a9-4bec-9fcf-48582787f1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:54.953537 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:54.895772 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:21:54.953537 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:54.936494 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" podUID="8debf693-923a-42c5-9811-1ccfd37cca82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:55.382464 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:55.382412 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded" Oct 30 20:21:55.536407 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:55.536356 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded" Oct 30 20:21:55.869899 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:55.869837 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded" Oct 30 20:21:56.320386 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:56.320346 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:21:56.321738 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:56.321687 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" podUID="6beb222b-b89e-4518-aea1-692285cc2951" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:56.526643 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:56.435460 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:21:56.553162 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:56.553114 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded" Oct 30 20:21:56.568872 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:56.568839 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:21:56.779735 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:56.779647 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:21:56.876822 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:21:56.876791 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:21:56.942092 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:21:56.942054 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:22:09.558151 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.558116 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6"] Oct 30 20:22:09.562818 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.562796 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.574490 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.574464 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6"] Oct 30 20:22:09.592536 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.592509 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g"] Oct 30 20:22:09.602537 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.602506 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g"] Oct 30 20:22:09.602733 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.602625 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.758365 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.758313 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-credential-socket\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.758653 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.758620 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-podinfo\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.758750 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.758660 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-token\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.758792 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.758747 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-workload-certs\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.758832 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.758822 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-credential-socket\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.758868 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.758853 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pft8\" (UniqueName: \"kubernetes.io/projected/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-kube-api-access-7pft8\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.758984 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.758972 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istiod-ca-cert\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.759108 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.759085 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-data\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.759178 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.759162 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k8d8\" (UniqueName: \"kubernetes.io/projected/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-kube-api-access-6k8d8\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.759395 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.759366 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istiod-ca-cert\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.759487 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.759468 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-data\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.759534 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.759518 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-workload-certs\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.759579 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.759564 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-token\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.759618 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.759603 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-envoy\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.759654 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.759647 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-workload-socket\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.759748 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.759735 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-podinfo\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.759828 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.759809 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-workload-socket\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.759878 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.759863 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-envoy\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.859880 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.859787 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn"] Oct 30 20:22:09.863038 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.863000 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-envoy\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.863201 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.863097 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-credential-socket\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.863201 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.863129 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-podinfo\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.863201 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.863159 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-token\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.863201 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.863196 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-workload-certs\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.863490 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.863243 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-credential-socket\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.863490 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.863284 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pft8\" (UniqueName: \"kubernetes.io/projected/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-kube-api-access-7pft8\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.863490 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.863404 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istiod-ca-cert\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.863490 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.863432 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-data\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.863490 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.863470 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k8d8\" (UniqueName: \"kubernetes.io/projected/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-kube-api-access-6k8d8\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.863758 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.863511 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istiod-ca-cert\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.863758 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.863601 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-data\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.863758 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.863641 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-workload-certs\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.863758 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.863665 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-token\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.863758 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.863722 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-envoy\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.864036 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.863796 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-workload-socket\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.864036 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.863840 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-podinfo\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.864036 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.863872 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-workload-socket\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.864991 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.864967 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-workload-socket\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.867458 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.867438 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istiod-ca-cert\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.867594 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.866008 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istiod-ca-cert\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.868224 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.866889 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-workload-socket\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.868577 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.867421 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-credential-socket\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.868704 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.865381 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-data\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.868799 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.867950 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-workload-certs\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.868884 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.868293 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-workload-certs\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.868965 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.868534 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-credential-socket\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.869054 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.869028 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-data\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.875552 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.872697 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:09.875552 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.873297 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-podinfo\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.875552 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.873569 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-envoy\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.878797 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.878606 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-envoy\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.882253 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.882225 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k8d8\" (UniqueName: \"kubernetes.io/projected/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-kube-api-access-6k8d8\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.882456 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.882439 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pft8\" (UniqueName: \"kubernetes.io/projected/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-kube-api-access-7pft8\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.886766 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.886740 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-token\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.889115 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.889088 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn"] Oct 30 20:22:09.889423 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.889379 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-token\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:09.889871 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.889846 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-podinfo\") pod \"e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:09.899171 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.899146 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv"] Oct 30 20:22:09.905126 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.905085 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:09.917245 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.917164 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv"] Oct 30 20:22:09.928404 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:09.927944 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:10.020937 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.020894 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw"] Oct 30 20:22:10.026896 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.026862 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.051043 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.049399 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw"] Oct 30 20:22:10.069483 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.069436 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6024242-56b5-4456-af29-35653c018f04-istio-token\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.069667 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.069530 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-workload-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.069667 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.069574 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-podinfo\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.069667 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.069612 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-credential-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.069667 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.069646 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df86ddea-3b6d-43e0-b478-21743945b4a6-istiod-ca-cert\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.069941 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.069680 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6024242-56b5-4456-af29-35653c018f04-istio-podinfo\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.069941 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.069707 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-envoy\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.069941 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.069747 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-workload-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.069941 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.069777 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-istio-data\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.069941 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.069813 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-workload-certs\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.069941 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.069860 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-data\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.069941 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.069895 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c27m8\" (UniqueName: \"kubernetes.io/projected/df86ddea-3b6d-43e0-b478-21743945b4a6-kube-api-access-c27m8\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.070300 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.069959 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-workload-certs\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.070300 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.069994 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-token\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.070300 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.070025 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6024242-56b5-4456-af29-35653c018f04-istiod-ca-cert\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.070300 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.070074 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-istio-envoy\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.070300 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.070184 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7b9f\" (UniqueName: \"kubernetes.io/projected/a6024242-56b5-4456-af29-35653c018f04-kube-api-access-j7b9f\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.070300 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.070250 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-credential-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.172051 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.171954 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istiod-ca-cert\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.172051 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.172005 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-workload-certs\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.172051 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.172029 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-token\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.172466 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.172118 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6024242-56b5-4456-af29-35653c018f04-istiod-ca-cert\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.172466 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.172177 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-istio-envoy\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.172466 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.172289 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7b9f\" (UniqueName: \"kubernetes.io/projected/a6024242-56b5-4456-af29-35653c018f04-kube-api-access-j7b9f\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.172466 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.172383 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-workload-certs\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.172466 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.172419 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-credential-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.172732 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.172511 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6024242-56b5-4456-af29-35653c018f04-istio-token\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.172732 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.172607 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-workload-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.172732 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.172614 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-workload-certs\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.172732 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.172671 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-podinfo\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.172732 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.172717 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-credential-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.173004 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.172758 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-envoy\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.173004 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.172787 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df86ddea-3b6d-43e0-b478-21743945b4a6-istiod-ca-cert\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.173004 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.172821 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-credential-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.173004 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.172839 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-token\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.173004 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.172879 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-workload-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.173004 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.172929 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6024242-56b5-4456-af29-35653c018f04-istio-podinfo\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.173293 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.173007 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6024242-56b5-4456-af29-35653c018f04-istiod-ca-cert\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.173293 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.173074 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-credential-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.173293 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.173091 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-envoy\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.173293 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.173130 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s7dd\" (UniqueName: \"kubernetes.io/projected/f398ea35-32fa-425c-9e05-a3fd41ba99ba-kube-api-access-4s7dd\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.173293 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.173161 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-credential-socket\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.173293 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.173286 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-workload-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.173616 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.173324 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-istio-data\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.173616 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.173398 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-data\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.173616 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.173426 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-podinfo\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.173616 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.173465 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-workload-certs\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.173616 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.173503 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-workload-socket\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.173616 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.173546 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-data\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.173616 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.173584 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c27m8\" (UniqueName: \"kubernetes.io/projected/df86ddea-3b6d-43e0-b478-21743945b4a6-kube-api-access-c27m8\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.174033 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.173620 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-istio-data\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.174033 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.173644 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-workload-socket\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.174033 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.173647 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df86ddea-3b6d-43e0-b478-21743945b4a6-istiod-ca-cert\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.174033 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.173967 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-workload-certs\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.174033 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.174018 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-data\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.174902 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.174883 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-istio-envoy\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.177076 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.177050 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-envoy\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.177184 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.177120 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6024242-56b5-4456-af29-35653c018f04-istio-podinfo\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.177342 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.177308 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-podinfo\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.181573 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.181551 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:10.188129 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.188103 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-token\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.190266 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.190213 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c27m8\" (UniqueName: \"kubernetes.io/projected/df86ddea-3b6d-43e0-b478-21743945b4a6-kube-api-access-c27m8\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.190428 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.190413 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6024242-56b5-4456-af29-35653c018f04-istio-token\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.199985 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.191282 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7b9f\" (UniqueName: \"kubernetes.io/projected/a6024242-56b5-4456-af29-35653c018f04-kube-api-access-j7b9f\") pod \"e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.258674 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.258625 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:10.264356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.259149 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:10.331258 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.319242 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istiod-ca-cert\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.342427 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.332565 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istiod-ca-cert\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.357413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.342873 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-workload-certs\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.357413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.343073 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-envoy\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.357413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.343110 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-token\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.357413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.343151 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s7dd\" (UniqueName: \"kubernetes.io/projected/f398ea35-32fa-425c-9e05-a3fd41ba99ba-kube-api-access-4s7dd\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.357413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.343177 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-credential-socket\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.357413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.343226 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-data\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.357413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.343250 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-podinfo\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.357413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.343301 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-workload-socket\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.357413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.343864 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-workload-socket\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.357413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.344111 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-workload-certs\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.364221 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.358589 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-credential-socket\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.364221 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.363765 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-data\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.381740 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.381660 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-envoy\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.429410 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.425966 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s7dd\" (UniqueName: \"kubernetes.io/projected/f398ea35-32fa-425c-9e05-a3fd41ba99ba-kube-api-access-4s7dd\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.435272 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.435237 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g"] Oct 30 20:22:10.447363 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.445321 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-podinfo\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.447363 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.446503 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:22:10.447363 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.446594 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:22:10.447363 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.446630 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:22:10.447770 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.447721 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-token\") pod \"e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.664636 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.664383 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:10.766845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.765035 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" event={"ID":"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc","Type":"ContainerStarted","Data":"3313cc107786bdaff2f6e0034bca3b9e7adb0adfd4b0222c6ccd16ec634e35ac"} Oct 30 20:22:10.766845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.765098 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" event={"ID":"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc","Type":"ContainerStarted","Data":"ef5ec5e3bf4e001a5f4807c0d793adea1918ded0bee6983aab99a4dfd0446fdf"} Oct 30 20:22:10.783843 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:22:10.783622 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcda848d_8ba6_4040_8ad7_f38ba20bf2df.slice/crio-84cb8e2ac2d88db39d8f3d119f6e1b4d1daefc1f5d0bcb45a3c09bb33a4e3f36 WatchSource:0}: Error finding container 84cb8e2ac2d88db39d8f3d119f6e1b4d1daefc1f5d0bcb45a3c09bb33a4e3f36: Status 404 returned error can't find the container with id 84cb8e2ac2d88db39d8f3d119f6e1b4d1daefc1f5d0bcb45a3c09bb33a4e3f36 Oct 30 20:22:10.788092 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.787580 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6"] Oct 30 20:22:10.790987 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.789813 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:22:10.790987 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.789900 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:22:10.790987 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.789947 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:22:10.812358 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.811433 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podStartSLOduration=1.81141204 podStartE2EDuration="1.81141204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:22:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:22:10.799929543 +0000 UTC m=+1105.333202140" watchObservedRunningTime="2026-10-30 20:22:10.81141204 +0000 UTC m=+1105.344684634" Oct 30 20:22:10.898147 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:22:10.898106 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6024242_56b5_4456_af29_35653c018f04.slice/crio-6bc6e7578fcecb32b3ad53e1bb66c9d2c6b150940b665bff4037e5c831028727 WatchSource:0}: Error finding container 6bc6e7578fcecb32b3ad53e1bb66c9d2c6b150940b665bff4037e5c831028727: Status 404 returned error can't find the container with id 6bc6e7578fcecb32b3ad53e1bb66c9d2c6b150940b665bff4037e5c831028727 Oct 30 20:22:10.899728 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.899698 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv"] Oct 30 20:22:10.902139 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.901478 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:22:10.902139 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.901559 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:22:10.902139 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.901626 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:22:10.922511 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.922424 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn"] Oct 30 20:22:10.924966 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:22:10.924923 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf86ddea_3b6d_43e0_b478_21743945b4a6.slice/crio-29270c697ecc3d3c9937ac46a3ff26f716d2ab8320aba1814836b134ccfc4cfc WatchSource:0}: Error finding container 29270c697ecc3d3c9937ac46a3ff26f716d2ab8320aba1814836b134ccfc4cfc: Status 404 returned error can't find the container with id 29270c697ecc3d3c9937ac46a3ff26f716d2ab8320aba1814836b134ccfc4cfc Oct 30 20:22:10.929083 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.929061 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:10.931610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.931573 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:22:10.931716 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.931675 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:22:10.931789 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.931737 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:22:10.999920 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:10.999878 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw"] Oct 30 20:22:11.032126 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:11.025241 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:22:11.032126 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:11.025346 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:22:11.032126 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:11.025390 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:22:11.904115 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:11.904073 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" event={"ID":"f398ea35-32fa-425c-9e05-a3fd41ba99ba","Type":"ContainerStarted","Data":"a9dd23ca6f60b482f604ed1bace4c6e1cf2a5a577a0722c3970f8ea7c4a5e8d5"} Oct 30 20:22:11.904786 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:11.904736 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" event={"ID":"f398ea35-32fa-425c-9e05-a3fd41ba99ba","Type":"ContainerStarted","Data":"c8a7f4bb35e85804416c7e6274c13d284e4db048805f1e165b79dc5860a49759"} Oct 30 20:22:12.011355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:11.982215 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" podStartSLOduration=2.982188945 podStartE2EDuration="2.982188945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:22:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:22:11.961449497 +0000 UTC m=+1106.494722092" watchObservedRunningTime="2026-10-30 20:22:11.982188945 +0000 UTC m=+1106.515461540" Oct 30 20:22:12.023359 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:11.988105 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Oct 30 20:22:12.023673 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.023637 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Oct 30 20:22:12.023826 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.005100 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" event={"ID":"a6024242-56b5-4456-af29-35653c018f04","Type":"ContainerStarted","Data":"6e361b28a291bd5515a077140ce2913a01b6ae5aa02110d73f8e02686d541d32"} Oct 30 20:22:12.023972 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.023952 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" event={"ID":"a6024242-56b5-4456-af29-35653c018f04","Type":"ContainerStarted","Data":"6bc6e7578fcecb32b3ad53e1bb66c9d2c6b150940b665bff4037e5c831028727"} Oct 30 20:22:12.084449 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.084398 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" event={"ID":"bcda848d-8ba6-4040-8ad7-f38ba20bf2df","Type":"ContainerStarted","Data":"81e940d14e1045ceacef695dc249aea455c42c6c5a46a7da3a8afd265a404b54"} Oct 30 20:22:12.134356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.107458 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" event={"ID":"bcda848d-8ba6-4040-8ad7-f38ba20bf2df","Type":"ContainerStarted","Data":"84cb8e2ac2d88db39d8f3d119f6e1b4d1daefc1f5d0bcb45a3c09bb33a4e3f36"} Oct 30 20:22:12.151355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.147910 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" event={"ID":"df86ddea-3b6d-43e0-b478-21743945b4a6","Type":"ContainerStarted","Data":"33fa3809d4e3ea7cd55797bb9a03796bd05a5566cd4dffa88c80fb7e3fcfd286"} Oct 30 20:22:12.227411 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.211458 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" event={"ID":"df86ddea-3b6d-43e0-b478-21743945b4a6","Type":"ContainerStarted","Data":"29270c697ecc3d3c9937ac46a3ff26f716d2ab8320aba1814836b134ccfc4cfc"} Oct 30 20:22:12.358488 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.300596 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Oct 30 20:22:12.358807 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.358769 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Oct 30 20:22:12.436360 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.319024 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Oct 30 20:22:12.436360 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.384482 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Oct 30 20:22:12.526413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.349317 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:12.526413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.498299 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:12.526413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.498584 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:12.526413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.498760 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Oct 30 20:22:12.526413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.504744 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Oct 30 20:22:12.526413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.519105 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:12.731529 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.700462 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded" Oct 30 20:22:12.798407 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.755409 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:12.938356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.836506 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:12.977413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.945452 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body= Oct 30 20:22:12.977413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.945534 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" Oct 30 20:22:12.977413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.973271 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Oct 30 20:22:12.977413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:12.973365 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Oct 30 20:22:13.371438 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:13.371372 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" podStartSLOduration=4.371348405 podStartE2EDuration="4.371348405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:22:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:22:12.5198985 +0000 UTC m=+1107.053171091" watchObservedRunningTime="2026-10-30 20:22:13.371348405 +0000 UTC m=+1107.904620999" Oct 30 20:22:13.378421 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:13.377493 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" podStartSLOduration=4.377478064 podStartE2EDuration="4.377478064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:22:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:22:12.866213762 +0000 UTC m=+1107.399486349" watchObservedRunningTime="2026-10-30 20:22:13.377478064 +0000 UTC m=+1107.910750660" Oct 30 20:22:13.454392 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:13.446776 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Oct 30 20:22:13.454392 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:13.446835 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Oct 30 20:22:13.454392 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:13.446920 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Oct 30 20:22:13.454392 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:13.446941 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Oct 30 20:22:13.454392 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:13.446995 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Oct 30 20:22:13.454392 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:13.447015 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Oct 30 20:22:13.454392 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:13.452112 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk"] Oct 30 20:22:13.530768 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:13.525838 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:13.605276 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:13.605241 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6"] Oct 30 20:22:13.608513 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:13.608488 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:22:13.861356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:13.836745 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" podStartSLOduration=4.836721355 podStartE2EDuration="4.836721355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:22:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:22:13.433467846 +0000 UTC m=+1107.966740432" watchObservedRunningTime="2026-10-30 20:22:13.836721355 +0000 UTC m=+1108.369993949" Oct 30 20:22:13.918357 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:13.842447 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body= Oct 30 20:22:13.918357 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:13.916490 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" Oct 30 20:22:13.918357 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:13.867430 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:13.918357 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:13.867423 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:14.101120 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:14.101077 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Oct 30 20:22:14.101748 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:14.101695 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Oct 30 20:22:14.195418 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:14.195036 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Oct 30 20:22:14.195418 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:14.195101 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Oct 30 20:22:14.302356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:14.298503 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Oct 30 20:22:14.302991 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:14.302952 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Oct 30 20:22:14.327524 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:14.327478 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Oct 30 20:22:14.327842 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:14.327792 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Oct 30 20:22:14.430640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:14.430605 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:22:14.430906 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:14.430888 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:22:14.663415 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:14.546087 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:14.711202 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:14.675035 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body= Oct 30 20:22:14.711494 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:14.711462 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" Oct 30 20:22:14.935428 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:14.928778 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Oct 30 20:22:14.960355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:14.935658 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Oct 30 20:22:15.150355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:15.125495 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:15.151004 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:15.150957 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:15.230411 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:15.218391 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Oct 30 20:22:15.230411 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:15.218460 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Oct 30 20:22:15.316363 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:15.292997 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Oct 30 20:22:15.451511 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:15.451458 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Oct 30 20:22:15.476771 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:15.474694 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Oct 30 20:22:15.484409 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:15.480396 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Oct 30 20:22:15.675119 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:15.675080 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body= Oct 30 20:22:15.675399 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:15.675372 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" Oct 30 20:22:15.717356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:15.716257 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:16.042357 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:16.017470 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Oct 30 20:22:16.042690 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:16.042651 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Oct 30 20:22:16.170484 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:16.170434 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded" Oct 30 20:22:16.200149 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:16.173457 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:16.225356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:16.214285 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Oct 30 20:22:16.225356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:16.214362 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Oct 30 20:22:16.260570 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:16.260520 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Oct 30 20:22:16.260786 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:16.260589 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Oct 30 20:22:16.294552 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:16.294451 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Oct 30 20:22:16.302416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:16.298402 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Oct 30 20:22:16.768390 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:16.749428 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded" Oct 30 20:22:17.281356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:17.226591 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body= Oct 30 20:22:17.281356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:17.281055 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" Oct 30 20:22:17.335477 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:17.331074 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:17.435450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:17.428021 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Oct 30 20:22:17.435450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:17.428098 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Oct 30 20:22:17.592355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:17.577653 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:17.931740 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:17.931565 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded" Oct 30 20:22:18.005375 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:17.983394 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Oct 30 20:22:18.005375 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:17.983457 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Oct 30 20:22:18.005375 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:17.983797 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Oct 30 20:22:18.005375 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:17.983844 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Oct 30 20:22:18.296411 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:18.273390 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Oct 30 20:22:18.296411 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:18.273456 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Oct 30 20:22:18.540353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:18.494201 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Oct 30 20:22:18.651357 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:18.640758 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Oct 30 20:22:18.651709 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:18.519003 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded" Oct 30 20:22:18.656353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:18.652773 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Oct 30 20:22:18.660353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:18.656653 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Oct 30 20:22:18.693479 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:18.542310 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body= Oct 30 20:22:18.696474 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:18.693761 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" Oct 30 20:22:18.696769 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:18.626568 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Oct 30 20:22:18.696968 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:18.696931 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Oct 30 20:22:18.727884 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:18.727836 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:18.947614 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:18.947511 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:19.166359 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:22:19.161906 5078 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.332s" Oct 30 20:22:19.193456 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.193419 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body= Oct 30 20:22:19.193716 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.193689 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" Oct 30 20:22:19.263519 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.263413 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7"] Oct 30 20:22:19.288354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.280220 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Oct 30 20:22:19.352443 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.352399 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Oct 30 20:22:19.353071 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.287667 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Oct 30 20:22:19.353220 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.353188 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Oct 30 20:22:19.353341 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.323192 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Oct 30 20:22:19.353462 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.353443 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Oct 30 20:22:19.367355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.359393 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl"] Oct 30 20:22:19.393682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.393644 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Oct 30 20:22:19.396498 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.396464 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Oct 30 20:22:19.527672 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.527566 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:22:19.527962 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.527913 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" podUID="e9729fb9-30d8-45ce-ad35-9e881630030a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:19.551354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.548826 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:22:19.551354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.548893 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" podUID="ae1473f0-1f82-4e44-9a44-a76562d7a880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:19.745227 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.745171 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded" Oct 30 20:22:19.807487 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.767744 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body= Oct 30 20:22:19.807487 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.792846 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" Oct 30 20:22:19.807487 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.778711 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded" Oct 30 20:22:19.822758 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.815483 5078 patch_prober.go:29] interesting pod/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:22:19.848846 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.848817 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:22:19.849403 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.849381 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" podUID="62edb9f6-a9af-4488-849b-6c9115b79513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:19.878365 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.848789 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" podUID="179c807f-ec84-47b4-ba09-51354cbcff6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:19.944665 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.940569 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Oct 30 20:22:19.944665 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.940811 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Oct 30 20:22:19.968356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:19.967161 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:20.225413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:20.199159 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Oct 30 20:22:20.225413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:20.199221 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Oct 30 20:22:20.267366 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:20.267210 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Oct 30 20:22:20.267366 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:20.267272 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Oct 30 20:22:20.280382 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:20.268079 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Oct 30 20:22:20.280382 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:20.268123 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Oct 30 20:22:20.689351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:20.689298 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body= Oct 30 20:22:20.689970 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:20.689929 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" Oct 30 20:22:20.840854 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:20.840813 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:22:20.841155 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:20.841121 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" podUID="9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:20.864127 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:20.842880 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded" Oct 30 20:22:20.908318 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:20.882380 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded" Oct 30 20:22:20.947684 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:20.947484 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Oct 30 20:22:20.947684 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:20.947552 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Oct 30 20:22:20.970353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:20.970289 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:21.722894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:21.720727 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Oct 30 20:22:21.722894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:21.720792 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Oct 30 20:22:21.722894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:21.721588 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body= Oct 30 20:22:21.722894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:21.721628 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" Oct 30 20:22:21.722894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:21.721702 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Oct 30 20:22:21.722894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:21.721723 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Oct 30 20:22:21.722894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:21.721782 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Oct 30 20:22:21.722894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:21.721802 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Oct 30 20:22:21.821846 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:21.819858 5078 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:21.917613 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:21.917568 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded" Oct 30 20:22:21.918294 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:21.918254 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:21.965450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:21.942692 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Oct 30 20:22:21.965450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:21.942755 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Oct 30 20:22:21.992410 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:21.971564 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:22.288879 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:22.285600 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Oct 30 20:22:22.288879 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:22.285664 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Oct 30 20:22:22.288879 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:22.287461 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Oct 30 20:22:22.288879 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:22.287509 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Oct 30 20:22:22.288879 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:22.287583 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Oct 30 20:22:22.288879 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:22.287606 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Oct 30 20:22:22.672352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:22.671715 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body= Oct 30 20:22:22.672352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:22.671778 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" Oct 30 20:22:22.920355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:22.919583 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:22.942410 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:22.938477 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:22.970009 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:22.969957 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Oct 30 20:22:22.970391 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:22.970357 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Oct 30 20:22:22.978450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:22.978406 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:23.198970 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:23.198875 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Oct 30 20:22:23.199238 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:23.199204 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Oct 30 20:22:23.300582 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:23.300528 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Oct 30 20:22:23.300924 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:23.300877 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Oct 30 20:22:23.334168 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:23.334119 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Oct 30 20:22:23.334467 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:23.334440 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Oct 30 20:22:23.790774 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:23.790723 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body= Oct 30 20:22:23.819355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:23.791051 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" Oct 30 20:22:23.952414 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:23.932797 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:23.980357 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:23.956725 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Oct 30 20:22:23.980357 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:23.956829 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Oct 30 20:22:23.980357 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:23.977280 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:24.016454 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:24.014262 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded" Oct 30 20:22:24.389364 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:24.349639 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7" podUID="cc623b5b-8385-4b36-82b7-4939ae2bf727" containerName="payload-processing" containerID="cri-o://ec09b333a624c226cf268b77dcf505469e467984d527ce5b047972347606550e" gracePeriod=25 Oct 30 20:22:24.702406 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:24.516481 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl" podUID="9f0b2906-f246-4b28-b48a-f50456e27840" containerName="payload-pre-processing" containerID="cri-o://01e2787fdbd597930cc58125f027258cb2e3b0bbc27bccd56d573da642a8976e" gracePeriod=25 Oct 30 20:22:24.769264 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:24.769220 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Oct 30 20:22:24.769594 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:24.769546 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Oct 30 20:22:24.873288 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:22:24.873248 5078 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.282s" Oct 30 20:22:24.980387 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:24.960473 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body= Oct 30 20:22:25.260435 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:25.259899 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" Oct 30 20:22:25.260435 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:25.084453 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded" Oct 30 20:22:25.264381 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:25.084391 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:25.264381 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:25.260908 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:25.264381 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:25.260960 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:25.264381 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:25.086130 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Oct 30 20:22:25.264381 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:25.262852 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Oct 30 20:22:25.264381 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:25.086037 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded" Oct 30 20:22:25.293354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:25.086192 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Oct 30 20:22:25.293354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:25.287099 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Oct 30 20:22:25.293354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:25.289506 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Oct 30 20:22:25.293354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:25.289560 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Oct 30 20:22:25.293354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:25.290475 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:25.293354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:25.291017 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Oct 30 20:22:25.293354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:25.291061 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Oct 30 20:22:25.318368 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:25.315466 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Oct 30 20:22:25.318368 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:25.315536 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Oct 30 20:22:25.341360 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:25.338723 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded" Oct 30 20:22:25.957351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:25.956722 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Oct 30 20:22:25.957351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:25.956800 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Oct 30 20:22:26.089489 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:26.071321 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:26.089489 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:26.083519 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Oct 30 20:22:26.089489 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:26.083600 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Oct 30 20:22:26.095679 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:26.090945 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body= Oct 30 20:22:26.095679 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:26.091006 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" Oct 30 20:22:26.135180 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:26.132439 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t" podUID="99fc63f4-6234-44b4-9627-031cc95991ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:26.313070 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:26.312677 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Oct 30 20:22:26.313070 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:26.312952 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Oct 30 20:22:26.414248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:26.414197 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:26.428628 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:26.428583 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded" Oct 30 20:22:26.431694 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:26.429511 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded" Oct 30 20:22:26.431694 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:26.428780 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Oct 30 20:22:26.431694 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:26.430674 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Oct 30 20:22:26.431694 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:26.429472 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Oct 30 20:22:26.431694 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:26.430909 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Oct 30 20:22:26.692085 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:26.691988 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body= Oct 30 20:22:26.692356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:26.692303 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" Oct 30 20:22:26.965871 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:26.965775 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Oct 30 20:22:26.966528 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:26.966490 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Oct 30 20:22:27.023402 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:22:27.023306 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:22:27.208364 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:27.206552 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Oct 30 20:22:27.208364 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:27.206614 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Oct 30 20:22:27.261593 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:27.261495 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Oct 30 20:22:27.261872 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:27.261828 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Oct 30 20:22:27.262430 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:27.262228 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Oct 30 20:22:27.262607 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:27.262585 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Oct 30 20:22:27.418473 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:27.418425 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded" Oct 30 20:22:27.431538 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:27.431494 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:27.432104 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:27.431749 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded" Oct 30 20:22:27.687355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:27.671486 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body= Oct 30 20:22:27.689610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:27.689569 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" Oct 30 20:22:28.149485 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:28.107250 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Oct 30 20:22:28.149485 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:28.107311 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Oct 30 20:22:28.184801 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:28.184765 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Oct 30 20:22:28.185098 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:28.185066 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Oct 30 20:22:28.262144 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:28.262099 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Oct 30 20:22:28.262789 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:28.262740 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Oct 30 20:22:28.263162 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:28.263138 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Oct 30 20:22:28.263393 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:28.263372 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Oct 30 20:22:28.425155 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:28.425049 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded" Oct 30 20:22:28.439483 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:28.439424 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:28.459100 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:28.459054 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:28.683760 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:28.683649 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:22:28.684635 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:28.684593 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body= Oct 30 20:22:28.684849 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:28.684821 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" Oct 30 20:22:28.771974 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:28.768789 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:22:28.899177 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:28.899144 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:22:28.933959 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:28.933863 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Oct 30 20:22:28.934262 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:28.934216 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Oct 30 20:22:29.185059 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:29.184966 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Oct 30 20:22:29.185308 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:29.185276 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Oct 30 20:22:29.260610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:29.260566 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Oct 30 20:22:29.260820 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:29.260633 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Oct 30 20:22:29.261001 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:29.260978 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Oct 30 20:22:29.261091 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:29.261013 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Oct 30 20:22:29.933398 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:29.930186 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Oct 30 20:22:29.933398 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:29.930244 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Oct 30 20:22:30.182347 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:30.182298 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Oct 30 20:22:30.182529 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:30.182371 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Oct 30 20:22:30.265136 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:30.265039 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:30.266910 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:30.266880 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:30.268241 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:30.268219 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:30.268902 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:30.268886 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:30.599542 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:30.599478 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl"] Oct 30 20:22:30.766356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:30.765439 5078 patch_prober.go:29] interesting pod/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:22:30.766356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:30.765503 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:30.875476 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:30.875394 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:30.879080 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:30.879059 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:31.017234 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:31.017197 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:31.018963 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:31.018937 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:22:31.186431 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:31.186348 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:31.187365 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:31.187339 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:22:31.654927 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:31.654883 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7" podUID="cc623b5b-8385-4b36-82b7-4939ae2bf727" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 30 20:22:31.655129 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:31.654942 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl" podUID="9f0b2906-f246-4b28-b48a-f50456e27840" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 30 20:22:33.090236 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:33.088766 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" containerID="cri-o://17544bc46a7b03a1ca7e7f4cc211962866d194017ff475f0f51ccb070482311c" gracePeriod=41 Oct 30 20:22:33.628485 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:33.628434 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:33.640814 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:33.638399 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:33.662356 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:33.642605 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": dial tcp 10.132.0.75:8000: connect: connection refused" Oct 30 20:22:33.718951 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:33.718917 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:22:33.759709 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:33.759663 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:34.249463 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:34.249422 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:22:34.274468 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:34.274415 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" podUID="62edb9f6-a9af-4488-849b-6c9115b79513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:34.401555 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:34.401518 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:22:34.401815 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:34.401782 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" podUID="ae1473f0-1f82-4e44-9a44-a76562d7a880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:34.467094 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:34.467039 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:22:34.467428 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:34.467395 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" podUID="e9729fb9-30d8-45ce-ad35-9e881630030a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:34.634408 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:34.634131 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:34.638351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:34.634681 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:22:34.638351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:34.635978 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": dial tcp 10.132.0.75:8000: connect: connection refused" Oct 30 20:22:34.838387 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:34.810125 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:34.854354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:34.848642 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:22:35.421999 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:35.421957 5078 generic.go:356] "Generic (PLEG): container finished" podID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerID="17544bc46a7b03a1ca7e7f4cc211962866d194017ff475f0f51ccb070482311c" exitCode=0 Oct 30 20:22:35.422716 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:35.422686 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" event={"ID":"33f80c7b-4092-4406-aa02-3a25d9e8501a","Type":"ContainerDied","Data":"17544bc46a7b03a1ca7e7f4cc211962866d194017ff475f0f51ccb070482311c"} Oct 30 20:22:35.644489 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:35.640828 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:35.693412 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:35.693369 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": dial tcp 10.132.0.75:8000: connect: connection refused" Oct 30 20:22:35.754353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:35.750615 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:22:35.754353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:35.750694 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" podUID="9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:35.845386 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:35.823210 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" containerID="cri-o://493cdd4f98e3f5a37472f47b4ea3c859483bd09717bb2baeff1c3c73f39ac6f8" gracePeriod=38 Oct 30 20:22:35.859375 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:35.846144 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:36.060382 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:36.028401 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct"] Oct 30 20:22:36.060382 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:36.028649 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" podUID="2bc6c031-5ab7-4ff5-8c4a-13286258090f" containerName="maas-api" containerID="cri-o://b7bbf16cf8668307dcbde2893fbe0386eef1d8fb006d9b65d80e4ac599bbe15f" gracePeriod=30 Oct 30 20:22:36.661858 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:36.654715 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:36.675117 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:36.675084 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": dial tcp 10.132.0.77:8000: connect: connection refused" Oct 30 20:22:36.737352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:36.734544 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": dial tcp 10.132.0.75:8000: connect: connection refused" Oct 30 20:22:36.906045 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:36.875038 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:36.937300 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:36.923442 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:22:36.937300 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:36.923516 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" podUID="9cd57b86-49b2-4877-957a-cb8e27992937" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:37.705665 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:37.681208 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:22:37.985119 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:37.972993 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": dial tcp 10.132.0.77:8000: connect: connection refused" Oct 30 20:22:38.607350 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:38.606720 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" podUID="2bc6c031-5ab7-4ff5-8c4a-13286258090f" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.66:8443/health\": dial tcp 10.132.0.66:8443: connect: connection refused" Oct 30 20:22:38.637353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:38.634161 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": dial tcp 10.132.0.77:8000: connect: connection refused" Oct 30 20:22:38.680359 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:38.680250 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 20:22:39.036407 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.035568 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:22:39.093620 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.093568 5078 generic.go:356] "Generic (PLEG): container finished" podID="2bc6c031-5ab7-4ff5-8c4a-13286258090f" containerID="b7bbf16cf8668307dcbde2893fbe0386eef1d8fb006d9b65d80e4ac599bbe15f" exitCode=0 Oct 30 20:22:39.101815 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.101782 5078 generic.go:356] "Generic (PLEG): container finished" podID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerID="493cdd4f98e3f5a37472f47b4ea3c859483bd09717bb2baeff1c3c73f39ac6f8" exitCode=0 Oct 30 20:22:39.295206 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.294679 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/33f80c7b-4092-4406-aa02-3a25d9e8501a-tls-certs\" (UniqueName: \"kubernetes.io/secret/33f80c7b-4092-4406-aa02-3a25d9e8501a-tls-certs\") pod \"33f80c7b-4092-4406-aa02-3a25d9e8501a\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " Oct 30 20:22:39.296150 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.296126 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-model-cache\") pod \"33f80c7b-4092-4406-aa02-3a25d9e8501a\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " Oct 30 20:22:39.301604 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.301561 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-home\" (UniqueName: \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-home\") pod \"33f80c7b-4092-4406-aa02-3a25d9e8501a\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " Oct 30 20:22:39.318101 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.318075 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-dshm\") pod \"33f80c7b-4092-4406-aa02-3a25d9e8501a\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " Oct 30 20:22:39.318484 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.318458 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33f80c7b-4092-4406-aa02-3a25d9e8501a-kube-api-access-xvp6v\" (UniqueName: \"kubernetes.io/projected/33f80c7b-4092-4406-aa02-3a25d9e8501a-kube-api-access-xvp6v\") pod \"33f80c7b-4092-4406-aa02-3a25d9e8501a\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " Oct 30 20:22:39.400809 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.380355 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-tmp-dir\") pod \"33f80c7b-4092-4406-aa02-3a25d9e8501a\" (UID: \"33f80c7b-4092-4406-aa02-3a25d9e8501a\") " Oct 30 20:22:39.400809 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:22:39.352901 5078 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.64s" Oct 30 20:22:39.400809 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.381443 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" event={"ID":"33f80c7b-4092-4406-aa02-3a25d9e8501a","Type":"ContainerDied","Data":"a858be2c015d142d0f8cad5d207aa3e212a9311a71df64373b78d72a2a0d495d"} Oct 30 20:22:39.400809 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.381475 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" event={"ID":"2bc6c031-5ab7-4ff5-8c4a-13286258090f","Type":"ContainerDied","Data":"b7bbf16cf8668307dcbde2893fbe0386eef1d8fb006d9b65d80e4ac599bbe15f"} Oct 30 20:22:39.400809 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.381500 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" event={"ID":"49a87331-7606-4e95-8d8c-b8f1ad754a9a","Type":"ContainerDied","Data":"493cdd4f98e3f5a37472f47b4ea3c859483bd09717bb2baeff1c3c73f39ac6f8"} Oct 30 20:22:39.400809 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.381530 5078 scope.go:122] "RemoveContainer" containerID="17544bc46a7b03a1ca7e7f4cc211962866d194017ff475f0f51ccb070482311c" Oct 30 20:22:39.400809 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.317724 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-model-cache" pod "33f80c7b-4092-4406-aa02-3a25d9e8501a" (UID: "33f80c7b-4092-4406-aa02-3a25d9e8501a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:39.400809 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.317936 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-home" pod "33f80c7b-4092-4406-aa02-3a25d9e8501a" (UID: "33f80c7b-4092-4406-aa02-3a25d9e8501a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:39.440709 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.415480 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-tmp-dir" pod "33f80c7b-4092-4406-aa02-3a25d9e8501a" (UID: "33f80c7b-4092-4406-aa02-3a25d9e8501a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:39.488830 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.488795 5078 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-home\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:39.489046 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.489029 5078 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-tmp-dir\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:39.489164 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.489149 5078 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-model-cache\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:39.504372 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.501856 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33f80c7b-4092-4406-aa02-3a25d9e8501a-tls-certs" pod "33f80c7b-4092-4406-aa02-3a25d9e8501a" (UID: "33f80c7b-4092-4406-aa02-3a25d9e8501a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:22:39.519381 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.518962 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33f80c7b-4092-4406-aa02-3a25d9e8501a-kube-api-access-xvp6v" pod "33f80c7b-4092-4406-aa02-3a25d9e8501a" (UID: "33f80c7b-4092-4406-aa02-3a25d9e8501a"). InnerVolumeSpecName "kube-api-access-xvp6v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:39.524834 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.524801 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-dshm" pod "33f80c7b-4092-4406-aa02-3a25d9e8501a" (UID: "33f80c7b-4092-4406-aa02-3a25d9e8501a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:39.572677 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.544785 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": dial tcp 10.132.0.77:8000: connect: connection refused" Oct 30 20:22:39.591659 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.591621 5078 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33f80c7b-4092-4406-aa02-3a25d9e8501a-tls-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:39.609945 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.591884 5078 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33f80c7b-4092-4406-aa02-3a25d9e8501a-dshm\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:39.609945 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.591917 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvp6v\" (UniqueName: \"kubernetes.io/projected/33f80c7b-4092-4406-aa02-3a25d9e8501a-kube-api-access-xvp6v\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:39.842874 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.842844 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" Oct 30 20:22:39.849283 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.849254 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:22:40.000027 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:39.999992 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/49a87331-7606-4e95-8d8c-b8f1ad754a9a-tls-certs\" (UniqueName: \"kubernetes.io/secret/49a87331-7606-4e95-8d8c-b8f1ad754a9a-tls-certs\") pod \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " Oct 30 20:22:40.000246 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.000082 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-model-cache\") pod \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " Oct 30 20:22:40.000246 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.000128 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/49a87331-7606-4e95-8d8c-b8f1ad754a9a-kube-api-access-snk68\" (UniqueName: \"kubernetes.io/projected/49a87331-7606-4e95-8d8c-b8f1ad754a9a-kube-api-access-snk68\") pod \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " Oct 30 20:22:40.000246 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.000231 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2bc6c031-5ab7-4ff5-8c4a-13286258090f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bc6c031-5ab7-4ff5-8c4a-13286258090f-maas-api-tls\") pod \"2bc6c031-5ab7-4ff5-8c4a-13286258090f\" (UID: \"2bc6c031-5ab7-4ff5-8c4a-13286258090f\") " Oct 30 20:22:40.000458 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.000286 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2bc6c031-5ab7-4ff5-8c4a-13286258090f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bc6c031-5ab7-4ff5-8c4a-13286258090f-metrics-certs\") pod \"2bc6c031-5ab7-4ff5-8c4a-13286258090f\" (UID: \"2bc6c031-5ab7-4ff5-8c4a-13286258090f\") " Oct 30 20:22:40.000458 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.000375 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-tmp-dir\") pod \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " Oct 30 20:22:40.000458 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.000419 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2bc6c031-5ab7-4ff5-8c4a-13286258090f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bc6c031-5ab7-4ff5-8c4a-13286258090f-openshift-service-ca\") pod \"2bc6c031-5ab7-4ff5-8c4a-13286258090f\" (UID: \"2bc6c031-5ab7-4ff5-8c4a-13286258090f\") " Oct 30 20:22:40.000458 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.000415 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-model-cache" pod "49a87331-7606-4e95-8d8c-b8f1ad754a9a" (UID: "49a87331-7606-4e95-8d8c-b8f1ad754a9a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:40.000730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.000477 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-home\" (UniqueName: \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-home\") pod \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " Oct 30 20:22:40.000730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.000571 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2bc6c031-5ab7-4ff5-8c4a-13286258090f-kube-api-access-vsm9b\" (UniqueName: \"kubernetes.io/projected/2bc6c031-5ab7-4ff5-8c4a-13286258090f-kube-api-access-vsm9b\") pod \"2bc6c031-5ab7-4ff5-8c4a-13286258090f\" (UID: \"2bc6c031-5ab7-4ff5-8c4a-13286258090f\") " Oct 30 20:22:40.000730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.000621 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-dshm\") pod \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\" (UID: \"49a87331-7606-4e95-8d8c-b8f1ad754a9a\") " Oct 30 20:22:40.000730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.000680 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-tmp-dir" pod "49a87331-7606-4e95-8d8c-b8f1ad754a9a" (UID: "49a87331-7606-4e95-8d8c-b8f1ad754a9a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:40.000925 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.000782 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bc6c031-5ab7-4ff5-8c4a-13286258090f-openshift-service-ca" pod "2bc6c031-5ab7-4ff5-8c4a-13286258090f" (UID: "2bc6c031-5ab7-4ff5-8c4a-13286258090f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:22:40.000925 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.000791 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-home" pod "49a87331-7606-4e95-8d8c-b8f1ad754a9a" (UID: "49a87331-7606-4e95-8d8c-b8f1ad754a9a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:40.001417 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.001390 5078 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-tmp-dir\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:40.001417 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.001419 5078 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bc6c031-5ab7-4ff5-8c4a-13286258090f-openshift-service-ca\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:40.001615 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.001435 5078 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-home\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:40.001615 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.001452 5078 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-model-cache\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:40.003046 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.003022 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49a87331-7606-4e95-8d8c-b8f1ad754a9a-tls-certs" pod "49a87331-7606-4e95-8d8c-b8f1ad754a9a" (UID: "49a87331-7606-4e95-8d8c-b8f1ad754a9a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:22:40.003046 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.003026 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49a87331-7606-4e95-8d8c-b8f1ad754a9a-kube-api-access-snk68" pod "49a87331-7606-4e95-8d8c-b8f1ad754a9a" (UID: "49a87331-7606-4e95-8d8c-b8f1ad754a9a"). InnerVolumeSpecName "kube-api-access-snk68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:40.003175 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.003080 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bc6c031-5ab7-4ff5-8c4a-13286258090f-kube-api-access-vsm9b" pod "2bc6c031-5ab7-4ff5-8c4a-13286258090f" (UID: "2bc6c031-5ab7-4ff5-8c4a-13286258090f"). InnerVolumeSpecName "kube-api-access-vsm9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:40.003175 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.003101 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bc6c031-5ab7-4ff5-8c4a-13286258090f-maas-api-tls" pod "2bc6c031-5ab7-4ff5-8c4a-13286258090f" (UID: "2bc6c031-5ab7-4ff5-8c4a-13286258090f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:22:40.003360 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.003312 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-dshm" pod "49a87331-7606-4e95-8d8c-b8f1ad754a9a" (UID: "49a87331-7606-4e95-8d8c-b8f1ad754a9a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:40.003360 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.003318 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bc6c031-5ab7-4ff5-8c4a-13286258090f-metrics-certs" pod "2bc6c031-5ab7-4ff5-8c4a-13286258090f" (UID: "2bc6c031-5ab7-4ff5-8c4a-13286258090f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:22:40.102924 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.102846 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsm9b\" (UniqueName: \"kubernetes.io/projected/2bc6c031-5ab7-4ff5-8c4a-13286258090f-kube-api-access-vsm9b\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:40.102924 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.102873 5078 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49a87331-7606-4e95-8d8c-b8f1ad754a9a-dshm\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:40.102924 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.102886 5078 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49a87331-7606-4e95-8d8c-b8f1ad754a9a-tls-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:40.102924 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.102895 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snk68\" (UniqueName: \"kubernetes.io/projected/49a87331-7606-4e95-8d8c-b8f1ad754a9a-kube-api-access-snk68\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:40.102924 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.102904 5078 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bc6c031-5ab7-4ff5-8c4a-13286258090f-maas-api-tls\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:40.102924 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.102914 5078 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2bc6c031-5ab7-4ff5-8c4a-13286258090f-metrics-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:40.109858 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.109834 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6" Oct 30 20:22:40.111290 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.111259 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" Oct 30 20:22:40.111428 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.111301 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct" event={"ID":"2bc6c031-5ab7-4ff5-8c4a-13286258090f","Type":"ContainerDied","Data":"5d5656cea780f6709232e8a87042a0d319297382a4d2a0f00ef00d622e233afa"} Oct 30 20:22:40.111428 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.111406 5078 scope.go:122] "RemoveContainer" containerID="b7bbf16cf8668307dcbde2893fbe0386eef1d8fb006d9b65d80e4ac599bbe15f" Oct 30 20:22:40.117570 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.117552 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" Oct 30 20:22:40.117652 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.117568 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk" event={"ID":"49a87331-7606-4e95-8d8c-b8f1ad754a9a","Type":"ContainerDied","Data":"3e315dbf38680ae6810b3daa9ea41acf93e3946b3266ecaf1b8bb08c886a9603"} Oct 30 20:22:40.128026 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.128009 5078 scope.go:122] "RemoveContainer" containerID="493cdd4f98e3f5a37472f47b4ea3c859483bd09717bb2baeff1c3c73f39ac6f8" Oct 30 20:22:40.135229 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.134324 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6"] Oct 30 20:22:40.140208 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.140180 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-44135b/distinct-w5-44135b-kserve-7586946495-d2tw6"] Oct 30 20:22:40.159067 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.159044 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct"] Oct 30 20:22:40.162688 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.162664 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-44135b-7487856c4b-dv9ct"] Oct 30 20:22:40.176561 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.176534 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk"] Oct 30 20:22:40.180581 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:40.180557 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-44135b/distinct-2-w5-44135b-kserve-5b99bb96b4-xdmvk"] Oct 30 20:22:41.262870 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:41.262832 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7"] Oct 30 20:22:41.263522 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:41.263103 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" podUID="f8cf8036-fa67-45ef-a16f-fa7041a61305" containerName="istio-proxy" containerID="cri-o://ab059bd8bc094bc33a5bc4ee2ba6aeccb96f8dafb336693693361dca7037f03a" gracePeriod=30 Oct 30 20:22:41.280031 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:41.279993 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv"] Oct 30 20:22:41.280288 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:41.280257 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" containerID="cri-o://6e361b28a291bd5515a077140ce2913a01b6ae5aa02110d73f8e02686d541d32" gracePeriod=30 Oct 30 20:22:41.283959 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:41.283925 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq"] Oct 30 20:22:41.285067 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:41.284392 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" podUID="6b463b25-8a3d-4b36-9925-5358b34f0c4c" containerName="istio-proxy" containerID="cri-o://827c121433535c10c59eb988b6ab6633dd7b921db9085db3fdc0db911a1eda4c" gracePeriod=30 Oct 30 20:22:41.290388 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:41.290354 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn"] Oct 30 20:22:41.290589 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:41.290566 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" containerID="cri-o://33fa3809d4e3ea7cd55797bb9a03796bd05a5566cd4dffa88c80fb7e3fcfd286" gracePeriod=30 Oct 30 20:22:41.654840 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:41.642491 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2bc6c031-5ab7-4ff5-8c4a-13286258090f" path="/var/lib/kubelet/pods/2bc6c031-5ab7-4ff5-8c4a-13286258090f/volumes" Oct 30 20:22:41.654840 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:41.643506 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" path="/var/lib/kubelet/pods/33f80c7b-4092-4406-aa02-3a25d9e8501a/volumes" Oct 30 20:22:41.654840 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:41.644414 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" path="/var/lib/kubelet/pods/49a87331-7606-4e95-8d8c-b8f1ad754a9a/volumes" Oct 30 20:22:41.658002 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:41.657948 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7" podUID="cc623b5b-8385-4b36-82b7-4939ae2bf727" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 30 20:22:41.659287 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:41.659240 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl" podUID="9f0b2906-f246-4b28-b48a-f50456e27840" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 30 20:22:41.835781 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:41.835744 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p"] Oct 30 20:22:41.836007 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:41.835980 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" podUID="1e445c74-350f-49be-b2fa-40f6ff72c2d5" containerName="maas-api" containerID="cri-o://ecb0cbe68662d48b66f766807858e65ab1630db854f4703f7b96ec06c34d56b5" gracePeriod=30 Oct 30 20:22:42.470103 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:42.470070 5078 generic.go:356] "Generic (PLEG): container finished" podID="1e445c74-350f-49be-b2fa-40f6ff72c2d5" containerID="ecb0cbe68662d48b66f766807858e65ab1630db854f4703f7b96ec06c34d56b5" exitCode=0 Oct 30 20:22:42.475578 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:42.470136 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" event={"ID":"1e445c74-350f-49be-b2fa-40f6ff72c2d5","Type":"ContainerDied","Data":"ecb0cbe68662d48b66f766807858e65ab1630db854f4703f7b96ec06c34d56b5"} Oct 30 20:22:42.509691 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:42.509662 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" Oct 30 20:22:42.563290 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:42.563257 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1e445c74-350f-49be-b2fa-40f6ff72c2d5-kube-api-access-j9l85\" (UniqueName: \"kubernetes.io/projected/1e445c74-350f-49be-b2fa-40f6ff72c2d5-kube-api-access-j9l85\") pod \"1e445c74-350f-49be-b2fa-40f6ff72c2d5\" (UID: \"1e445c74-350f-49be-b2fa-40f6ff72c2d5\") " Oct 30 20:22:42.563495 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:42.563397 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1e445c74-350f-49be-b2fa-40f6ff72c2d5-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e445c74-350f-49be-b2fa-40f6ff72c2d5-maas-api-tls\") pod \"1e445c74-350f-49be-b2fa-40f6ff72c2d5\" (UID: \"1e445c74-350f-49be-b2fa-40f6ff72c2d5\") " Oct 30 20:22:42.563700 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:42.563674 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1e445c74-350f-49be-b2fa-40f6ff72c2d5-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e445c74-350f-49be-b2fa-40f6ff72c2d5-openshift-service-ca\") pod \"1e445c74-350f-49be-b2fa-40f6ff72c2d5\" (UID: \"1e445c74-350f-49be-b2fa-40f6ff72c2d5\") " Oct 30 20:22:42.563804 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:42.563748 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1e445c74-350f-49be-b2fa-40f6ff72c2d5-metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e445c74-350f-49be-b2fa-40f6ff72c2d5-metrics-certs\") pod \"1e445c74-350f-49be-b2fa-40f6ff72c2d5\" (UID: \"1e445c74-350f-49be-b2fa-40f6ff72c2d5\") " Oct 30 20:22:42.564135 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:42.564060 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e445c74-350f-49be-b2fa-40f6ff72c2d5-openshift-service-ca" pod "1e445c74-350f-49be-b2fa-40f6ff72c2d5" (UID: "1e445c74-350f-49be-b2fa-40f6ff72c2d5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:22:42.564429 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:42.564390 5078 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e445c74-350f-49be-b2fa-40f6ff72c2d5-openshift-service-ca\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:42.566246 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:42.566220 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e445c74-350f-49be-b2fa-40f6ff72c2d5-maas-api-tls" pod "1e445c74-350f-49be-b2fa-40f6ff72c2d5" (UID: "1e445c74-350f-49be-b2fa-40f6ff72c2d5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:22:42.566444 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:42.566277 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e445c74-350f-49be-b2fa-40f6ff72c2d5-kube-api-access-j9l85" pod "1e445c74-350f-49be-b2fa-40f6ff72c2d5" (UID: "1e445c74-350f-49be-b2fa-40f6ff72c2d5"). InnerVolumeSpecName "kube-api-access-j9l85". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:42.566885 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:42.566865 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e445c74-350f-49be-b2fa-40f6ff72c2d5-metrics-certs" pod "1e445c74-350f-49be-b2fa-40f6ff72c2d5" (UID: "1e445c74-350f-49be-b2fa-40f6ff72c2d5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:22:42.666920 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:42.666828 5078 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e445c74-350f-49be-b2fa-40f6ff72c2d5-maas-api-tls\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:42.666920 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:42.666871 5078 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e445c74-350f-49be-b2fa-40f6ff72c2d5-metrics-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:42.666920 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:42.666889 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9l85\" (UniqueName: \"kubernetes.io/projected/1e445c74-350f-49be-b2fa-40f6ff72c2d5-kube-api-access-j9l85\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:43.478603 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:43.478571 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" Oct 30 20:22:43.479111 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:43.478602 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p" event={"ID":"1e445c74-350f-49be-b2fa-40f6ff72c2d5","Type":"ContainerDied","Data":"0a7ef848942421586d7427d0db7f11ebb896ce862ab6b4e0c75ad244a37fa868"} Oct 30 20:22:43.479111 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:43.478675 5078 scope.go:122] "RemoveContainer" containerID="ecb0cbe68662d48b66f766807858e65ab1630db854f4703f7b96ec06c34d56b5" Oct 30 20:22:43.519123 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:43.519078 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p"] Oct 30 20:22:43.525817 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:43.525761 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-75e734-75978cbbcc-fq79p"] Oct 30 20:22:43.604523 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:43.604488 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1e445c74-350f-49be-b2fa-40f6ff72c2d5" path="/var/lib/kubelet/pods/1e445c74-350f-49be-b2fa-40f6ff72c2d5/volumes" Oct 30 20:22:44.891473 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:44.891443 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7" Oct 30 20:22:44.952667 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:44.952624 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg"] Oct 30 20:22:44.952899 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:44.952873 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" podUID="e8433528-266c-4508-a35b-d7345ef1bbd7" containerName="maas-api" containerID="cri-o://a62c8d65efb6fd2966c947ffa11caaabeb0c46444ce59cf66df2b0a7b689508f" gracePeriod=30 Oct 30 20:22:45.010893 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.010860 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cc623b5b-8385-4b36-82b7-4939ae2bf727-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc623b5b-8385-4b36-82b7-4939ae2bf727-plugins-config-volume\") pod \"cc623b5b-8385-4b36-82b7-4939ae2bf727\" (UID: \"cc623b5b-8385-4b36-82b7-4939ae2bf727\") " Oct 30 20:22:45.011084 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.010951 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc623b5b-8385-4b36-82b7-4939ae2bf727-kube-api-access-b4j76\" (UniqueName: \"kubernetes.io/projected/cc623b5b-8385-4b36-82b7-4939ae2bf727-kube-api-access-b4j76\") pod \"cc623b5b-8385-4b36-82b7-4939ae2bf727\" (UID: \"cc623b5b-8385-4b36-82b7-4939ae2bf727\") " Oct 30 20:22:45.011300 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.011274 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc623b5b-8385-4b36-82b7-4939ae2bf727-plugins-config-volume" pod "cc623b5b-8385-4b36-82b7-4939ae2bf727" (UID: "cc623b5b-8385-4b36-82b7-4939ae2bf727"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:22:45.011728 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.011709 5078 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc623b5b-8385-4b36-82b7-4939ae2bf727-plugins-config-volume\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:45.013433 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.013399 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc623b5b-8385-4b36-82b7-4939ae2bf727-kube-api-access-b4j76" pod "cc623b5b-8385-4b36-82b7-4939ae2bf727" (UID: "cc623b5b-8385-4b36-82b7-4939ae2bf727"). InnerVolumeSpecName "kube-api-access-b4j76". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:45.113381 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.113263 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4j76\" (UniqueName: \"kubernetes.io/projected/cc623b5b-8385-4b36-82b7-4939ae2bf727-kube-api-access-b4j76\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:45.444426 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.443420 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 20:22:45.444426 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.443478 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 20:22:45.444426 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.443574 5078 patch_prober.go:29] interesting pod/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 20:22:45.444426 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.443592 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 20:22:45.535837 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.535794 5078 generic.go:356] "Generic (PLEG): container finished" podID="e8433528-266c-4508-a35b-d7345ef1bbd7" containerID="a62c8d65efb6fd2966c947ffa11caaabeb0c46444ce59cf66df2b0a7b689508f" exitCode=0 Oct 30 20:22:45.536061 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.536036 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" event={"ID":"e8433528-266c-4508-a35b-d7345ef1bbd7","Type":"ContainerDied","Data":"a62c8d65efb6fd2966c947ffa11caaabeb0c46444ce59cf66df2b0a7b689508f"} Oct 30 20:22:45.538497 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.538464 5078 generic.go:356] "Generic (PLEG): container finished" podID="cc623b5b-8385-4b36-82b7-4939ae2bf727" containerID="ec09b333a624c226cf268b77dcf505469e467984d527ce5b047972347606550e" exitCode=0 Oct 30 20:22:45.538635 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.538594 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7" event={"ID":"cc623b5b-8385-4b36-82b7-4939ae2bf727","Type":"ContainerDied","Data":"ec09b333a624c226cf268b77dcf505469e467984d527ce5b047972347606550e"} Oct 30 20:22:45.538706 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.538648 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7" event={"ID":"cc623b5b-8385-4b36-82b7-4939ae2bf727","Type":"ContainerDied","Data":"015d2b9805c0f55384ff656475305fcf6e0d6e2c6c140a7a3716911d74899725"} Oct 30 20:22:45.538706 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.538683 5078 scope.go:122] "RemoveContainer" containerID="ec09b333a624c226cf268b77dcf505469e467984d527ce5b047972347606550e" Oct 30 20:22:45.538886 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.538869 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7" Oct 30 20:22:45.758093 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.752196 5078 scope.go:122] "RemoveContainer" containerID="ec09b333a624c226cf268b77dcf505469e467984d527ce5b047972347606550e" Oct 30 20:22:45.759605 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.759570 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" Oct 30 20:22:45.789519 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:22:45.780511 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec09b333a624c226cf268b77dcf505469e467984d527ce5b047972347606550e\": container with ID starting with ec09b333a624c226cf268b77dcf505469e467984d527ce5b047972347606550e not found: ID does not exist" containerID="ec09b333a624c226cf268b77dcf505469e467984d527ce5b047972347606550e" Oct 30 20:22:45.789519 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.780569 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec09b333a624c226cf268b77dcf505469e467984d527ce5b047972347606550e"} err="failed to get container status \"ec09b333a624c226cf268b77dcf505469e467984d527ce5b047972347606550e\": rpc error: code = NotFound desc = could not find container \"ec09b333a624c226cf268b77dcf505469e467984d527ce5b047972347606550e\": container with ID starting with ec09b333a624c226cf268b77dcf505469e467984d527ce5b047972347606550e not found: ID does not exist" Oct 30 20:22:45.808197 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.808148 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" containerID="cri-o://f7d2db75a17a08431897ea422621133b719d12fe5ef8e6bc777a7e4291891614" gracePeriod=45 Oct 30 20:22:45.816910 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.816881 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7"] Oct 30 20:22:45.817145 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.817130 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-9c901b-689fc7b678-rdcq7"] Oct 30 20:22:45.849701 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.849672 5078 scope.go:122] "RemoveContainer" containerID="a62c8d65efb6fd2966c947ffa11caaabeb0c46444ce59cf66df2b0a7b689508f" Oct 30 20:22:45.905942 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.905905 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e8433528-266c-4508-a35b-d7345ef1bbd7-metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8433528-266c-4508-a35b-d7345ef1bbd7-metrics-certs\") pod \"e8433528-266c-4508-a35b-d7345ef1bbd7\" (UID: \"e8433528-266c-4508-a35b-d7345ef1bbd7\") " Oct 30 20:22:45.906416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.906019 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e8433528-266c-4508-a35b-d7345ef1bbd7-kube-api-access-dbn28\" (UniqueName: \"kubernetes.io/projected/e8433528-266c-4508-a35b-d7345ef1bbd7-kube-api-access-dbn28\") pod \"e8433528-266c-4508-a35b-d7345ef1bbd7\" (UID: \"e8433528-266c-4508-a35b-d7345ef1bbd7\") " Oct 30 20:22:45.906416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.906055 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e8433528-266c-4508-a35b-d7345ef1bbd7-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8433528-266c-4508-a35b-d7345ef1bbd7-openshift-service-ca\") pod \"e8433528-266c-4508-a35b-d7345ef1bbd7\" (UID: \"e8433528-266c-4508-a35b-d7345ef1bbd7\") " Oct 30 20:22:45.906416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.906208 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e8433528-266c-4508-a35b-d7345ef1bbd7-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8433528-266c-4508-a35b-d7345ef1bbd7-maas-api-tls\") pod \"e8433528-266c-4508-a35b-d7345ef1bbd7\" (UID: \"e8433528-266c-4508-a35b-d7345ef1bbd7\") " Oct 30 20:22:45.906575 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.906510 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8433528-266c-4508-a35b-d7345ef1bbd7-openshift-service-ca" pod "e8433528-266c-4508-a35b-d7345ef1bbd7" (UID: "e8433528-266c-4508-a35b-d7345ef1bbd7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:22:45.908153 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.908124 5078 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8433528-266c-4508-a35b-d7345ef1bbd7-openshift-service-ca\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:45.910385 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.910355 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8433528-266c-4508-a35b-d7345ef1bbd7-metrics-certs" pod "e8433528-266c-4508-a35b-d7345ef1bbd7" (UID: "e8433528-266c-4508-a35b-d7345ef1bbd7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:22:45.910496 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.910354 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8433528-266c-4508-a35b-d7345ef1bbd7-maas-api-tls" pod "e8433528-266c-4508-a35b-d7345ef1bbd7" (UID: "e8433528-266c-4508-a35b-d7345ef1bbd7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:22:45.910496 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:45.910357 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8433528-266c-4508-a35b-d7345ef1bbd7-kube-api-access-dbn28" pod "e8433528-266c-4508-a35b-d7345ef1bbd7" (UID: "e8433528-266c-4508-a35b-d7345ef1bbd7"). InnerVolumeSpecName "kube-api-access-dbn28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:46.009916 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.009887 5078 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8433528-266c-4508-a35b-d7345ef1bbd7-maas-api-tls\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.010033 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.009918 5078 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8433528-266c-4508-a35b-d7345ef1bbd7-metrics-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.010033 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.009936 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbn28\" (UniqueName: \"kubernetes.io/projected/e8433528-266c-4508-a35b-d7345ef1bbd7-kube-api-access-dbn28\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.133565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.133529 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:22:46.149746 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.149714 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl" Oct 30 20:22:46.212832 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.212750 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-tmp-dir\") pod \"a0f5a46d-0671-46de-b229-4449baf28a99\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " Oct 30 20:22:46.212987 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.212897 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f0b2906-f246-4b28-b48a-f50456e27840-kube-api-access-fqw98\" (UniqueName: \"kubernetes.io/projected/9f0b2906-f246-4b28-b48a-f50456e27840-kube-api-access-fqw98\") pod \"9f0b2906-f246-4b28-b48a-f50456e27840\" (UID: \"9f0b2906-f246-4b28-b48a-f50456e27840\") " Oct 30 20:22:46.212987 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.212940 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0f5a46d-0671-46de-b229-4449baf28a99-kube-api-access-xzfkf\" (UniqueName: \"kubernetes.io/projected/a0f5a46d-0671-46de-b229-4449baf28a99-kube-api-access-xzfkf\") pod \"a0f5a46d-0671-46de-b229-4449baf28a99\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " Oct 30 20:22:46.213076 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.213030 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9f0b2906-f246-4b28-b48a-f50456e27840-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f0b2906-f246-4b28-b48a-f50456e27840-plugins-config-volume\") pod \"9f0b2906-f246-4b28-b48a-f50456e27840\" (UID: \"9f0b2906-f246-4b28-b48a-f50456e27840\") " Oct 30 20:22:46.213076 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.213070 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-model-cache\") pod \"a0f5a46d-0671-46de-b229-4449baf28a99\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " Oct 30 20:22:46.213218 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.213191 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a0f5a46d-0671-46de-b229-4449baf28a99-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0f5a46d-0671-46de-b229-4449baf28a99-tls-certs\") pod \"a0f5a46d-0671-46de-b229-4449baf28a99\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " Oct 30 20:22:46.213656 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.213299 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-dshm\") pod \"a0f5a46d-0671-46de-b229-4449baf28a99\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " Oct 30 20:22:46.213656 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.213481 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-home\" (UniqueName: \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-home\") pod \"a0f5a46d-0671-46de-b229-4449baf28a99\" (UID: \"a0f5a46d-0671-46de-b229-4449baf28a99\") " Oct 30 20:22:46.213825 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.213477 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-tmp-dir" pod "a0f5a46d-0671-46de-b229-4449baf28a99" (UID: "a0f5a46d-0671-46de-b229-4449baf28a99"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.213825 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.213692 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-home" pod "a0f5a46d-0671-46de-b229-4449baf28a99" (UID: "a0f5a46d-0671-46de-b229-4449baf28a99"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.213825 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.213752 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-model-cache" pod "a0f5a46d-0671-46de-b229-4449baf28a99" (UID: "a0f5a46d-0671-46de-b229-4449baf28a99"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.213825 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.213780 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f0b2906-f246-4b28-b48a-f50456e27840-plugins-config-volume" pod "9f0b2906-f246-4b28-b48a-f50456e27840" (UID: "9f0b2906-f246-4b28-b48a-f50456e27840"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:22:46.214057 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.214018 5078 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f0b2906-f246-4b28-b48a-f50456e27840-plugins-config-volume\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.214057 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.214043 5078 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-model-cache\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.214167 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.214057 5078 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-home\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.214167 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.214095 5078 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-tmp-dir\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.215743 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.215716 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0f5a46d-0671-46de-b229-4449baf28a99-tls-certs" pod "a0f5a46d-0671-46de-b229-4449baf28a99" (UID: "a0f5a46d-0671-46de-b229-4449baf28a99"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:22:46.215833 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.215748 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-dshm" pod "a0f5a46d-0671-46de-b229-4449baf28a99" (UID: "a0f5a46d-0671-46de-b229-4449baf28a99"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.216007 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.215989 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f0b2906-f246-4b28-b48a-f50456e27840-kube-api-access-fqw98" pod "9f0b2906-f246-4b28-b48a-f50456e27840" (UID: "9f0b2906-f246-4b28-b48a-f50456e27840"). InnerVolumeSpecName "kube-api-access-fqw98". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:46.216289 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.216261 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0f5a46d-0671-46de-b229-4449baf28a99-kube-api-access-xzfkf" pod "a0f5a46d-0671-46de-b229-4449baf28a99" (UID: "a0f5a46d-0671-46de-b229-4449baf28a99"). InnerVolumeSpecName "kube-api-access-xzfkf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:46.315817 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.315784 5078 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0f5a46d-0671-46de-b229-4449baf28a99-dshm\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.315817 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.315816 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqw98\" (UniqueName: \"kubernetes.io/projected/9f0b2906-f246-4b28-b48a-f50456e27840-kube-api-access-fqw98\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.316011 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.315826 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzfkf\" (UniqueName: \"kubernetes.io/projected/a0f5a46d-0671-46de-b229-4449baf28a99-kube-api-access-xzfkf\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.316011 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.315837 5078 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0f5a46d-0671-46de-b229-4449baf28a99-tls-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.587176 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.587142 5078 generic.go:356] "Generic (PLEG): container finished" podID="a6024242-56b5-4456-af29-35653c018f04" containerID="6e361b28a291bd5515a077140ce2913a01b6ae5aa02110d73f8e02686d541d32" exitCode=0 Oct 30 20:22:46.587430 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.587248 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" event={"ID":"a6024242-56b5-4456-af29-35653c018f04","Type":"ContainerDied","Data":"6e361b28a291bd5515a077140ce2913a01b6ae5aa02110d73f8e02686d541d32"} Oct 30 20:22:46.588865 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.588838 5078 generic.go:356] "Generic (PLEG): container finished" podID="9f0b2906-f246-4b28-b48a-f50456e27840" containerID="01e2787fdbd597930cc58125f027258cb2e3b0bbc27bccd56d573da642a8976e" exitCode=0 Oct 30 20:22:46.588979 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.588881 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl" Oct 30 20:22:46.588979 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.588921 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl" event={"ID":"9f0b2906-f246-4b28-b48a-f50456e27840","Type":"ContainerDied","Data":"01e2787fdbd597930cc58125f027258cb2e3b0bbc27bccd56d573da642a8976e"} Oct 30 20:22:46.588979 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.588970 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl" event={"ID":"9f0b2906-f246-4b28-b48a-f50456e27840","Type":"ContainerDied","Data":"d54d61b36a0f1044187bc6df2b620c5fb8877b99726d3fa8442975c3f6738241"} Oct 30 20:22:46.589135 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.589004 5078 scope.go:122] "RemoveContainer" containerID="01e2787fdbd597930cc58125f027258cb2e3b0bbc27bccd56d573da642a8976e" Oct 30 20:22:46.590990 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.590965 5078 generic.go:356] "Generic (PLEG): container finished" podID="6b463b25-8a3d-4b36-9925-5358b34f0c4c" containerID="827c121433535c10c59eb988b6ab6633dd7b921db9085db3fdc0db911a1eda4c" exitCode=0 Oct 30 20:22:46.591090 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.591038 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" event={"ID":"6b463b25-8a3d-4b36-9925-5358b34f0c4c","Type":"ContainerDied","Data":"827c121433535c10c59eb988b6ab6633dd7b921db9085db3fdc0db911a1eda4c"} Oct 30 20:22:46.592976 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.592953 5078 generic.go:356] "Generic (PLEG): container finished" podID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerID="33fa3809d4e3ea7cd55797bb9a03796bd05a5566cd4dffa88c80fb7e3fcfd286" exitCode=0 Oct 30 20:22:46.593085 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.593030 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" event={"ID":"df86ddea-3b6d-43e0-b478-21743945b4a6","Type":"ContainerDied","Data":"33fa3809d4e3ea7cd55797bb9a03796bd05a5566cd4dffa88c80fb7e3fcfd286"} Oct 30 20:22:46.594946 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.594875 5078 generic.go:356] "Generic (PLEG): container finished" podID="a0f5a46d-0671-46de-b229-4449baf28a99" containerID="f7d2db75a17a08431897ea422621133b719d12fe5ef8e6bc777a7e4291891614" exitCode=0 Oct 30 20:22:46.594946 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.594896 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" event={"ID":"a0f5a46d-0671-46de-b229-4449baf28a99","Type":"ContainerDied","Data":"f7d2db75a17a08431897ea422621133b719d12fe5ef8e6bc777a7e4291891614"} Oct 30 20:22:46.594946 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.594922 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" event={"ID":"a0f5a46d-0671-46de-b229-4449baf28a99","Type":"ContainerDied","Data":"433be835d9c188a972115269c15af985a619bb08737f47502abb15d7db0239c5"} Oct 30 20:22:46.594946 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.594935 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl" Oct 30 20:22:46.606639 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.606413 5078 scope.go:122] "RemoveContainer" containerID="01e2787fdbd597930cc58125f027258cb2e3b0bbc27bccd56d573da642a8976e" Oct 30 20:22:46.609426 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:22:46.607436 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01e2787fdbd597930cc58125f027258cb2e3b0bbc27bccd56d573da642a8976e\": container with ID starting with 01e2787fdbd597930cc58125f027258cb2e3b0bbc27bccd56d573da642a8976e not found: ID does not exist" containerID="01e2787fdbd597930cc58125f027258cb2e3b0bbc27bccd56d573da642a8976e" Oct 30 20:22:46.609426 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.607472 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e2787fdbd597930cc58125f027258cb2e3b0bbc27bccd56d573da642a8976e"} err="failed to get container status \"01e2787fdbd597930cc58125f027258cb2e3b0bbc27bccd56d573da642a8976e\": rpc error: code = NotFound desc = could not find container \"01e2787fdbd597930cc58125f027258cb2e3b0bbc27bccd56d573da642a8976e\": container with ID starting with 01e2787fdbd597930cc58125f027258cb2e3b0bbc27bccd56d573da642a8976e not found: ID does not exist" Oct 30 20:22:46.609426 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.607494 5078 scope.go:122] "RemoveContainer" containerID="f7d2db75a17a08431897ea422621133b719d12fe5ef8e6bc777a7e4291891614" Oct 30 20:22:46.610313 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.610288 5078 generic.go:356] "Generic (PLEG): container finished" podID="f8cf8036-fa67-45ef-a16f-fa7041a61305" containerID="ab059bd8bc094bc33a5bc4ee2ba6aeccb96f8dafb336693693361dca7037f03a" exitCode=0 Oct 30 20:22:46.610687 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.610447 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" Oct 30 20:22:46.610820 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.610785 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" event={"ID":"f8cf8036-fa67-45ef-a16f-fa7041a61305","Type":"ContainerDied","Data":"ab059bd8bc094bc33a5bc4ee2ba6aeccb96f8dafb336693693361dca7037f03a"} Oct 30 20:22:46.611214 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.611193 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg" event={"ID":"e8433528-266c-4508-a35b-d7345ef1bbd7","Type":"ContainerDied","Data":"efbbda386dcf732915dd96412e4e34dbd2d865bad66c37a248b7d7ec92ea290f"} Oct 30 20:22:46.613768 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.613696 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:22:46.623106 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.623081 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f8cf8036-fa67-45ef-a16f-fa7041a61305-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8cf8036-fa67-45ef-a16f-fa7041a61305-istiod-ca-cert\") pod \"f8cf8036-fa67-45ef-a16f-fa7041a61305\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " Oct 30 20:22:46.623222 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.623164 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-envoy\") pod \"f8cf8036-fa67-45ef-a16f-fa7041a61305\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " Oct 30 20:22:46.623292 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.623252 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-credential-socket\") pod \"f8cf8036-fa67-45ef-a16f-fa7041a61305\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " Oct 30 20:22:46.623366 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.623301 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-workload-certs\") pod \"f8cf8036-fa67-45ef-a16f-fa7041a61305\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " Oct 30 20:22:46.623492 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.623460 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-token\" (UniqueName: \"kubernetes.io/projected/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-token\") pod \"f8cf8036-fa67-45ef-a16f-fa7041a61305\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " Oct 30 20:22:46.623573 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.623486 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8cf8036-fa67-45ef-a16f-fa7041a61305-istiod-ca-cert" pod "f8cf8036-fa67-45ef-a16f-fa7041a61305" (UID: "f8cf8036-fa67-45ef-a16f-fa7041a61305"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:22:46.623573 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.623526 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-workload-socket\") pod \"f8cf8036-fa67-45ef-a16f-fa7041a61305\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " Oct 30 20:22:46.623682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.623596 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-data\") pod \"f8cf8036-fa67-45ef-a16f-fa7041a61305\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " Oct 30 20:22:46.623682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.623650 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-podinfo\") pod \"f8cf8036-fa67-45ef-a16f-fa7041a61305\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " Oct 30 20:22:46.623783 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.623693 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f8cf8036-fa67-45ef-a16f-fa7041a61305-kube-api-access-sqcmp\" (UniqueName: \"kubernetes.io/projected/f8cf8036-fa67-45ef-a16f-fa7041a61305-kube-api-access-sqcmp\") pod \"f8cf8036-fa67-45ef-a16f-fa7041a61305\" (UID: \"f8cf8036-fa67-45ef-a16f-fa7041a61305\") " Oct 30 20:22:46.623841 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.623793 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-credential-socket" pod "f8cf8036-fa67-45ef-a16f-fa7041a61305" (UID: "f8cf8036-fa67-45ef-a16f-fa7041a61305"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.625994 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.624379 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.625994 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.624403 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8cf8036-fa67-45ef-a16f-fa7041a61305-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.625994 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.624813 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-data" pod "f8cf8036-fa67-45ef-a16f-fa7041a61305" (UID: "f8cf8036-fa67-45ef-a16f-fa7041a61305"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.625994 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.625123 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-workload-certs" pod "f8cf8036-fa67-45ef-a16f-fa7041a61305" (UID: "f8cf8036-fa67-45ef-a16f-fa7041a61305"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.626457 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.626424 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-workload-socket" pod "f8cf8036-fa67-45ef-a16f-fa7041a61305" (UID: "f8cf8036-fa67-45ef-a16f-fa7041a61305"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.627901 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.627386 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-envoy" pod "f8cf8036-fa67-45ef-a16f-fa7041a61305" (UID: "f8cf8036-fa67-45ef-a16f-fa7041a61305"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.633828 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.633787 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-token" pod "f8cf8036-fa67-45ef-a16f-fa7041a61305" (UID: "f8cf8036-fa67-45ef-a16f-fa7041a61305"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:46.645246 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.645209 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8cf8036-fa67-45ef-a16f-fa7041a61305-kube-api-access-sqcmp" pod "f8cf8036-fa67-45ef-a16f-fa7041a61305" (UID: "f8cf8036-fa67-45ef-a16f-fa7041a61305"). InnerVolumeSpecName "kube-api-access-sqcmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:46.647006 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.646977 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-podinfo" pod "f8cf8036-fa67-45ef-a16f-fa7041a61305" (UID: "f8cf8036-fa67-45ef-a16f-fa7041a61305"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:22:46.705213 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.705178 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:46.717069 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.717036 5078 scope.go:122] "RemoveContainer" containerID="f7d2db75a17a08431897ea422621133b719d12fe5ef8e6bc777a7e4291891614" Oct 30 20:22:46.717692 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:22:46.717626 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7d2db75a17a08431897ea422621133b719d12fe5ef8e6bc777a7e4291891614\": container with ID starting with f7d2db75a17a08431897ea422621133b719d12fe5ef8e6bc777a7e4291891614 not found: ID does not exist" containerID="f7d2db75a17a08431897ea422621133b719d12fe5ef8e6bc777a7e4291891614" Oct 30 20:22:46.717692 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.717666 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7d2db75a17a08431897ea422621133b719d12fe5ef8e6bc777a7e4291891614"} err="failed to get container status \"f7d2db75a17a08431897ea422621133b719d12fe5ef8e6bc777a7e4291891614\": rpc error: code = NotFound desc = could not find container \"f7d2db75a17a08431897ea422621133b719d12fe5ef8e6bc777a7e4291891614\": container with ID starting with f7d2db75a17a08431897ea422621133b719d12fe5ef8e6bc777a7e4291891614 not found: ID does not exist" Oct 30 20:22:46.721949 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.721928 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg"] Oct 30 20:22:46.725864 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.725806 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-workload-socket\") pod \"a6024242-56b5-4456-af29-35653c018f04\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " Oct 30 20:22:46.725974 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.725912 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a6024242-56b5-4456-af29-35653c018f04-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6024242-56b5-4456-af29-35653c018f04-istiod-ca-cert\") pod \"a6024242-56b5-4456-af29-35653c018f04\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " Oct 30 20:22:46.726104 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.726086 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-credential-socket\") pod \"a6024242-56b5-4456-af29-35653c018f04\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " Oct 30 20:22:46.726178 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.726135 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a6024242-56b5-4456-af29-35653c018f04-istio-token\" (UniqueName: \"kubernetes.io/projected/a6024242-56b5-4456-af29-35653c018f04-istio-token\") pod \"a6024242-56b5-4456-af29-35653c018f04\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " Oct 30 20:22:46.726178 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.726165 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-workload-certs\") pod \"a6024242-56b5-4456-af29-35653c018f04\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " Oct 30 20:22:46.726290 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.726193 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a6024242-56b5-4456-af29-35653c018f04-kube-api-access-j7b9f\" (UniqueName: \"kubernetes.io/projected/a6024242-56b5-4456-af29-35653c018f04-kube-api-access-j7b9f\") pod \"a6024242-56b5-4456-af29-35653c018f04\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " Oct 30 20:22:46.726290 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.726242 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-istio-envoy\") pod \"a6024242-56b5-4456-af29-35653c018f04\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " Oct 30 20:22:46.726290 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.726263 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6024242-56b5-4456-af29-35653c018f04-istiod-ca-cert" pod "a6024242-56b5-4456-af29-35653c018f04" (UID: "a6024242-56b5-4456-af29-35653c018f04"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:22:46.726467 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.726324 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-istio-data\") pod \"a6024242-56b5-4456-af29-35653c018f04\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " Oct 30 20:22:46.726596 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.726576 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a6024242-56b5-4456-af29-35653c018f04-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6024242-56b5-4456-af29-35653c018f04-istio-podinfo\") pod \"a6024242-56b5-4456-af29-35653c018f04\" (UID: \"a6024242-56b5-4456-af29-35653c018f04\") " Oct 30 20:22:46.727486 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.726903 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-credential-socket" pod "a6024242-56b5-4456-af29-35653c018f04" (UID: "a6024242-56b5-4456-af29-35653c018f04"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.727486 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.727225 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-workload-certs" pod "a6024242-56b5-4456-af29-35653c018f04" (UID: "a6024242-56b5-4456-af29-35653c018f04"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.727486 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.727316 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.727486 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.727389 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.727725 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.727553 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-workload-socket" pod "a6024242-56b5-4456-af29-35653c018f04" (UID: "a6024242-56b5-4456-af29-35653c018f04"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.727725 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.727406 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.727725 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.727610 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.727725 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.727625 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.727725 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.727640 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqcmp\" (UniqueName: \"kubernetes.io/projected/f8cf8036-fa67-45ef-a16f-fa7041a61305-kube-api-access-sqcmp\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.727725 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.727657 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.727725 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.727672 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8cf8036-fa67-45ef-a16f-fa7041a61305-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.727725 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.727686 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6024242-56b5-4456-af29-35653c018f04-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.727971 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.727788 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-9c901b-5b95559db-7lvhg"] Oct 30 20:22:46.728064 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.728043 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-istio-data" pod "a6024242-56b5-4456-af29-35653c018f04" (UID: "a6024242-56b5-4456-af29-35653c018f04"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.740002 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.739938 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl"] Oct 30 20:22:46.740656 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.740614 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-istio-envoy" pod "a6024242-56b5-4456-af29-35653c018f04" (UID: "a6024242-56b5-4456-af29-35653c018f04"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.740937 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.740905 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a6024242-56b5-4456-af29-35653c018f04-istio-podinfo" pod "a6024242-56b5-4456-af29-35653c018f04" (UID: "a6024242-56b5-4456-af29-35653c018f04"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:22:46.741199 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.741158 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6024242-56b5-4456-af29-35653c018f04-kube-api-access-j7b9f" pod "a6024242-56b5-4456-af29-35653c018f04" (UID: "a6024242-56b5-4456-af29-35653c018f04"). InnerVolumeSpecName "kube-api-access-j7b9f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:46.742813 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.742779 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6024242-56b5-4456-af29-35653c018f04-istio-token" pod "a6024242-56b5-4456-af29-35653c018f04" (UID: "a6024242-56b5-4456-af29-35653c018f04"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:46.743634 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.743612 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-909519/distinct-w2-909519-kserve-6f668f5d58-qdpkl"] Oct 30 20:22:46.753951 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.753919 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:22:46.757697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.757672 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl"] Oct 30 20:22:46.759685 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.759663 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:46.762343 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.762309 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-9c901b-5844678655-zwpgl"] Oct 30 20:22:46.829220 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.829178 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-token\" (UniqueName: \"kubernetes.io/projected/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-token\") pod \"df86ddea-3b6d-43e0-b478-21743945b4a6\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " Oct 30 20:22:46.829409 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.829245 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-data\") pod \"df86ddea-3b6d-43e0-b478-21743945b4a6\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " Oct 30 20:22:46.829409 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.829275 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-workload-socket\") pod \"df86ddea-3b6d-43e0-b478-21743945b4a6\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " Oct 30 20:22:46.829409 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.829319 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-podinfo\") pod \"df86ddea-3b6d-43e0-b478-21743945b4a6\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " Oct 30 20:22:46.829409 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.829364 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-credential-socket\") pod \"df86ddea-3b6d-43e0-b478-21743945b4a6\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " Oct 30 20:22:46.829409 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.829396 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-workload-certs\") pod \"df86ddea-3b6d-43e0-b478-21743945b4a6\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " Oct 30 20:22:46.829682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.829477 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/df86ddea-3b6d-43e0-b478-21743945b4a6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df86ddea-3b6d-43e0-b478-21743945b4a6-istiod-ca-cert\") pod \"df86ddea-3b6d-43e0-b478-21743945b4a6\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " Oct 30 20:22:46.829682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.829536 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-token\" (UniqueName: \"kubernetes.io/projected/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-token\") pod \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " Oct 30 20:22:46.829682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.829609 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-workload-certs\") pod \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " Oct 30 20:22:46.829682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.829582 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-data" pod "df86ddea-3b6d-43e0-b478-21743945b4a6" (UID: "df86ddea-3b6d-43e0-b478-21743945b4a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.829682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.829643 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-envoy\") pod \"df86ddea-3b6d-43e0-b478-21743945b4a6\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " Oct 30 20:22:46.829682 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.829654 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-workload-socket" pod "df86ddea-3b6d-43e0-b478-21743945b4a6" (UID: "df86ddea-3b6d-43e0-b478-21743945b4a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.829965 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.829695 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-podinfo\") pod \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " Oct 30 20:22:46.829965 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.829763 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-credential-socket\") pod \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " Oct 30 20:22:46.829965 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.829801 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istiod-ca-cert\") pod \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " Oct 30 20:22:46.829965 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.829883 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-workload-socket\") pod \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " Oct 30 20:22:46.829965 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.829935 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df86ddea-3b6d-43e0-b478-21743945b4a6-istiod-ca-cert" pod "df86ddea-3b6d-43e0-b478-21743945b4a6" (UID: "df86ddea-3b6d-43e0-b478-21743945b4a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:22:46.829965 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.829948 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-credential-socket" pod "df86ddea-3b6d-43e0-b478-21743945b4a6" (UID: "df86ddea-3b6d-43e0-b478-21743945b4a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.831019 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.829972 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-envoy\") pod \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " Oct 30 20:22:46.831019 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.830033 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/df86ddea-3b6d-43e0-b478-21743945b4a6-kube-api-access-c27m8\" (UniqueName: \"kubernetes.io/projected/df86ddea-3b6d-43e0-b478-21743945b4a6-kube-api-access-c27m8\") pod \"df86ddea-3b6d-43e0-b478-21743945b4a6\" (UID: \"df86ddea-3b6d-43e0-b478-21743945b4a6\") " Oct 30 20:22:46.831019 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.830092 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6b463b25-8a3d-4b36-9925-5358b34f0c4c-kube-api-access-k57tk\" (UniqueName: \"kubernetes.io/projected/6b463b25-8a3d-4b36-9925-5358b34f0c4c-kube-api-access-k57tk\") pod \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " Oct 30 20:22:46.831019 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.830129 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-data\") pod \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\" (UID: \"6b463b25-8a3d-4b36-9925-5358b34f0c4c\") " Oct 30 20:22:46.831019 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.830183 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-workload-certs" pod "df86ddea-3b6d-43e0-b478-21743945b4a6" (UID: "df86ddea-3b6d-43e0-b478-21743945b4a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.831019 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.830201 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-workload-certs" pod "6b463b25-8a3d-4b36-9925-5358b34f0c4c" (UID: "6b463b25-8a3d-4b36-9925-5358b34f0c4c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.831019 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.830451 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istiod-ca-cert" pod "6b463b25-8a3d-4b36-9925-5358b34f0c4c" (UID: "6b463b25-8a3d-4b36-9925-5358b34f0c4c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:22:46.831019 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.830588 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-credential-socket" pod "6b463b25-8a3d-4b36-9925-5358b34f0c4c" (UID: "6b463b25-8a3d-4b36-9925-5358b34f0c4c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.831019 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.830676 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-data" pod "6b463b25-8a3d-4b36-9925-5358b34f0c4c" (UID: "6b463b25-8a3d-4b36-9925-5358b34f0c4c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.831721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.831380 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.831721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.831409 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.831721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.831424 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df86ddea-3b6d-43e0-b478-21743945b4a6-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.831721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.831440 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.831721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.831454 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.831721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.831468 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.831721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.831482 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6024242-56b5-4456-af29-35653c018f04-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.831721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.831497 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.831721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.831512 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7b9f\" (UniqueName: \"kubernetes.io/projected/a6024242-56b5-4456-af29-35653c018f04-kube-api-access-j7b9f\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.831721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.831527 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.831721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.831541 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6024242-56b5-4456-af29-35653c018f04-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.831721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.831554 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.831721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.831567 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.831721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.831579 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.831721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.831593 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6024242-56b5-4456-af29-35653c018f04-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.831721 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.831608 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.836568 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.836536 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-envoy" pod "6b463b25-8a3d-4b36-9925-5358b34f0c4c" (UID: "6b463b25-8a3d-4b36-9925-5358b34f0c4c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.836685 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.836585 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-podinfo" pod "6b463b25-8a3d-4b36-9925-5358b34f0c4c" (UID: "6b463b25-8a3d-4b36-9925-5358b34f0c4c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:22:46.836783 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.836762 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-workload-socket" pod "6b463b25-8a3d-4b36-9925-5358b34f0c4c" (UID: "6b463b25-8a3d-4b36-9925-5358b34f0c4c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.839237 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.839208 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df86ddea-3b6d-43e0-b478-21743945b4a6-kube-api-access-c27m8" pod "df86ddea-3b6d-43e0-b478-21743945b4a6" (UID: "df86ddea-3b6d-43e0-b478-21743945b4a6"). InnerVolumeSpecName "kube-api-access-c27m8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:46.839712 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.839689 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-token" pod "6b463b25-8a3d-4b36-9925-5358b34f0c4c" (UID: "6b463b25-8a3d-4b36-9925-5358b34f0c4c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:46.839851 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.839693 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-podinfo" pod "df86ddea-3b6d-43e0-b478-21743945b4a6" (UID: "df86ddea-3b6d-43e0-b478-21743945b4a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:22:46.839851 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.839724 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-token" pod "df86ddea-3b6d-43e0-b478-21743945b4a6" (UID: "df86ddea-3b6d-43e0-b478-21743945b4a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:46.840012 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.839988 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b463b25-8a3d-4b36-9925-5358b34f0c4c-kube-api-access-k57tk" pod "6b463b25-8a3d-4b36-9925-5358b34f0c4c" (UID: "6b463b25-8a3d-4b36-9925-5358b34f0c4c"). InnerVolumeSpecName "kube-api-access-k57tk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:46.841629 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.841589 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-envoy" pod "df86ddea-3b6d-43e0-b478-21743945b4a6" (UID: "df86ddea-3b6d-43e0-b478-21743945b4a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:46.943351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.934182 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.943351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.934220 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.943351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.934236 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.943351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.934248 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.943351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.934261 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b463b25-8a3d-4b36-9925-5358b34f0c4c-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.943351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.934274 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c27m8\" (UniqueName: \"kubernetes.io/projected/df86ddea-3b6d-43e0-b478-21743945b4a6-kube-api-access-c27m8\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.943351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.934289 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k57tk\" (UniqueName: \"kubernetes.io/projected/6b463b25-8a3d-4b36-9925-5358b34f0c4c-kube-api-access-k57tk\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.943351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.934302 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:46.943351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:46.934314 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df86ddea-3b6d-43e0-b478-21743945b4a6-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:47.638641 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:47.638580 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9f0b2906-f246-4b28-b48a-f50456e27840" path="/var/lib/kubelet/pods/9f0b2906-f246-4b28-b48a-f50456e27840/volumes" Oct 30 20:22:47.639285 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:47.639258 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" Oct 30 20:22:47.639795 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:47.639774 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" path="/var/lib/kubelet/pods/a0f5a46d-0671-46de-b229-4449baf28a99/volumes" Oct 30 20:22:47.640588 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:47.640569 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cc623b5b-8385-4b36-82b7-4939ae2bf727" path="/var/lib/kubelet/pods/cc623b5b-8385-4b36-82b7-4939ae2bf727/volumes" Oct 30 20:22:47.641598 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:47.641583 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e8433528-266c-4508-a35b-d7345ef1bbd7" path="/var/lib/kubelet/pods/e8433528-266c-4508-a35b-d7345ef1bbd7/volumes" Oct 30 20:22:47.642617 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:47.642599 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7" event={"ID":"f8cf8036-fa67-45ef-a16f-fa7041a61305","Type":"ContainerDied","Data":"82d138cc1971e7500377a89421899dc2da43f5809b194eb0f41f5be8213ae444"} Oct 30 20:22:47.642736 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:47.642725 5078 scope.go:122] "RemoveContainer" containerID="ab059bd8bc094bc33a5bc4ee2ba6aeccb96f8dafb336693693361dca7037f03a" Oct 30 20:22:47.663178 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:47.662856 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" Oct 30 20:22:47.663178 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:47.662888 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv" event={"ID":"a6024242-56b5-4456-af29-35653c018f04","Type":"ContainerDied","Data":"6bc6e7578fcecb32b3ad53e1bb66c9d2c6b150940b665bff4037e5c831028727"} Oct 30 20:22:47.670160 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:47.668295 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" event={"ID":"6b463b25-8a3d-4b36-9925-5358b34f0c4c","Type":"ContainerDied","Data":"10fe44f0e7a900103befd18a7146bb6543baae568d8f78caef4925812aa9c404"} Oct 30 20:22:47.670160 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:47.668439 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq" Oct 30 20:22:47.683073 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:47.682762 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" event={"ID":"df86ddea-3b6d-43e0-b478-21743945b4a6","Type":"ContainerDied","Data":"29270c697ecc3d3c9937ac46a3ff26f716d2ab8320aba1814836b134ccfc4cfc"} Oct 30 20:22:47.683278 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:47.682857 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn" Oct 30 20:22:47.700081 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:22:47.700038 5078 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc623b5b_8385_4b36_82b7_4939ae2bf727.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf86ddea_3b6d_43e0_b478_21743945b4a6.slice/crio-29270c697ecc3d3c9937ac46a3ff26f716d2ab8320aba1814836b134ccfc4cfc\": RecentStats: unable to find data in memory cache]" Oct 30 20:22:47.765493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:47.762882 5078 scope.go:122] "RemoveContainer" containerID="6e361b28a291bd5515a077140ce2913a01b6ae5aa02110d73f8e02686d541d32" Oct 30 20:22:47.798599 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:47.798575 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv"] Oct 30 20:22:47.814983 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:47.814951 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-b9xwv"] Oct 30 20:22:47.852409 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:47.852373 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq"] Oct 30 20:22:47.858782 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:47.858753 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-gzslq"] Oct 30 20:22:47.925982 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:47.925896 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn"] Oct 30 20:22:47.944093 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:47.944067 5078 scope.go:122] "RemoveContainer" containerID="827c121433535c10c59eb988b6ab6633dd7b921db9085db3fdc0db911a1eda4c" Oct 30 20:22:48.042860 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:48.042827 5078 scope.go:122] "RemoveContainer" containerID="33fa3809d4e3ea7cd55797bb9a03796bd05a5566cd4dffa88c80fb7e3fcfd286" Oct 30 20:22:48.092836 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:48.086218 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-zcbsn"] Oct 30 20:22:48.251637 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:48.242946 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7"] Oct 30 20:22:48.266403 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:48.264861 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-c646da-openshift-default-7b65dc6f7c-f72m7"] Oct 30 20:22:49.052850 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:49.052812 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr"] Oct 30 20:22:49.095145 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:49.095102 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" podUID="ca42f8ad-24a9-4bec-9fcf-48582787f1c9" containerName="istio-proxy" containerID="cri-o://808ed515f1446a14db628954c25d3950a58eeb62be7920ecbd6f59228fc43b49" gracePeriod=30 Oct 30 20:22:49.327386 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:49.324380 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7"] Oct 30 20:22:49.327386 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:49.324678 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" podUID="6beb222b-b89e-4518-aea1-692285cc2951" containerName="istio-proxy" containerID="cri-o://86216c7652977261d5c2162168871fc6f7bcaf9b456185475e000ea10005a203" gracePeriod=30 Oct 30 20:22:49.547355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:49.546393 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm"] Oct 30 20:22:49.547355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:49.546646 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" podUID="ae1473f0-1f82-4e44-9a44-a76562d7a880" containerName="istio-proxy" containerID="cri-o://aaca2aadf21d3860094760d99f290e5c57e827581a528f50e69711b9b87fb2b3" gracePeriod=30 Oct 30 20:22:49.707407 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:49.706715 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6b463b25-8a3d-4b36-9925-5358b34f0c4c" path="/var/lib/kubelet/pods/6b463b25-8a3d-4b36-9925-5358b34f0c4c/volumes" Oct 30 20:22:49.730643 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:49.730604 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a6024242-56b5-4456-af29-35653c018f04" path="/var/lib/kubelet/pods/a6024242-56b5-4456-af29-35653c018f04/volumes" Oct 30 20:22:49.758039 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:49.757997 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" path="/var/lib/kubelet/pods/df86ddea-3b6d-43e0-b478-21743945b4a6/volumes" Oct 30 20:22:49.841353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:49.841004 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f8cf8036-fa67-45ef-a16f-fa7041a61305" path="/var/lib/kubelet/pods/f8cf8036-fa67-45ef-a16f-fa7041a61305/volumes" Oct 30 20:22:49.841529 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:49.841506 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb"] Oct 30 20:22:49.845367 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:49.841764 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" podUID="9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" containerName="istio-proxy" containerID="cri-o://96b1c9741724402e163a667f134cfb07b1dcc35725f3d154b76b911ee3d63836" gracePeriod=30 Oct 30 20:22:50.185541 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:22:50.185499 5078 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc623b5b_8385_4b36_82b7_4939ae2bf727.slice\": RecentStats: unable to find data in memory cache]" Oct 30 20:22:52.575354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:52.572492 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2"] Oct 30 20:22:52.592200 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:52.592156 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" podUID="82a38bcc-0f98-4cf5-901f-e7bd47f9755b" containerName="istio-proxy" containerID="cri-o://33c34d533e597c3edd15d81b9a57fc921410261aaecea312cc8fb178d71a2ab9" gracePeriod=30 Oct 30 20:22:52.702128 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:52.700293 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64"] Oct 30 20:22:52.702128 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:52.700564 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" podUID="50d97c5f-9b0e-4851-b1b5-400c74b23352" containerName="istio-proxy" containerID="cri-o://7ff3e0cd535e3e9bc506d13542a819d0236d1f9992c4ecc9ae9b766b7d2037f7" gracePeriod=30 Oct 30 20:22:52.812429 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:52.812380 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk"] Oct 30 20:22:52.820881 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:52.812644 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" podUID="179c807f-ec84-47b4-ba09-51354cbcff6a" containerName="istio-proxy" containerID="cri-o://6f66c7161b977b4327b9f483d5b132db4ed309135819bcbfec8acd3352bb559b" gracePeriod=30 Oct 30 20:22:52.828279 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:52.827288 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn"] Oct 30 20:22:52.828279 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:52.827565 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" podUID="48a25fb9-3214-4c1c-95fe-d751ad4372e4" containerName="istio-proxy" containerID="cri-o://f7b43e46b3d8299ae04cd481136ed1d5e4f9c08105486b4a20ef4690179b79ea" gracePeriod=30 Oct 30 20:22:53.485512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:53.485477 5078 patch_prober.go:29] interesting pod/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 20:22:53.485658 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:53.485537 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" podUID="ca42f8ad-24a9-4bec-9fcf-48582787f1c9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 20:22:54.331925 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.331879 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l"] Oct 30 20:22:54.332436 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.332402 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" podUID="25da5733-edc7-4a62-bc21-dbe63273deed" containerName="istio-proxy" containerID="cri-o://6a69fd0727b1f9f170b5b0ecadee0ad98cce269006bbce82152d8c349947208b" gracePeriod=30 Oct 30 20:22:54.337574 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.337546 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c"] Oct 30 20:22:54.337785 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.337749 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" podUID="6de7d150-b3e9-44f2-9b6a-71e69df471a9" containerName="istio-proxy" containerID="cri-o://e2fe6d9f731b3f3e82666262385d84ceedd7c61cfe4093e3df0060b3bfdc5167" gracePeriod=30 Oct 30 20:22:54.342244 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.342217 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw"] Oct 30 20:22:54.342556 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.342456 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" containerID="cri-o://a9dd23ca6f60b482f604ed1bace4c6e1cf2a5a577a0722c3970f8ea7c4a5e8d5" gracePeriod=30 Oct 30 20:22:54.394814 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.394785 5078 generic.go:356] "Generic (PLEG): container finished" podID="ca42f8ad-24a9-4bec-9fcf-48582787f1c9" containerID="808ed515f1446a14db628954c25d3950a58eeb62be7920ecbd6f59228fc43b49" exitCode=0 Oct 30 20:22:54.394914 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.394828 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" event={"ID":"ca42f8ad-24a9-4bec-9fcf-48582787f1c9","Type":"ContainerDied","Data":"808ed515f1446a14db628954c25d3950a58eeb62be7920ecbd6f59228fc43b49"} Oct 30 20:22:54.394914 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.394881 5078 scope.go:122] "RemoveContainer" containerID="6a761981d861343f7414399ae4070e99f313534193b5c20527be54552fe42d6e" Oct 30 20:22:54.715290 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.715263 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:22:54.793408 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.793381 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:22:54.874663 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.874577 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6beb222b-b89e-4518-aea1-692285cc2951-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6beb222b-b89e-4518-aea1-692285cc2951-istio-podinfo\") pod \"6beb222b-b89e-4518-aea1-692285cc2951\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " Oct 30 20:22:54.874663 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.874639 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-kube-api-access-tx57s\" (UniqueName: \"kubernetes.io/projected/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-kube-api-access-tx57s\") pod \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " Oct 30 20:22:54.874902 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.874666 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-token\" (UniqueName: \"kubernetes.io/projected/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-token\") pod \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " Oct 30 20:22:54.874902 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.874721 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-workload-certs\") pod \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " Oct 30 20:22:54.874902 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.874776 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-credential-socket\") pod \"6beb222b-b89e-4518-aea1-692285cc2951\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " Oct 30 20:22:54.874902 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.874821 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6beb222b-b89e-4518-aea1-692285cc2951-kube-api-access-5r59f\" (UniqueName: \"kubernetes.io/projected/6beb222b-b89e-4518-aea1-692285cc2951-kube-api-access-5r59f\") pod \"6beb222b-b89e-4518-aea1-692285cc2951\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " Oct 30 20:22:54.874902 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.874873 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-workload-certs\") pod \"6beb222b-b89e-4518-aea1-692285cc2951\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " Oct 30 20:22:54.875175 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.874977 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-envoy\") pod \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " Oct 30 20:22:54.875175 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.875004 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-workload-socket\") pod \"6beb222b-b89e-4518-aea1-692285cc2951\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " Oct 30 20:22:54.875175 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.875103 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-podinfo\") pod \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " Oct 30 20:22:54.875175 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.875170 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-data\") pod \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " Oct 30 20:22:54.875409 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.875206 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6beb222b-b89e-4518-aea1-692285cc2951-istio-token\" (UniqueName: \"kubernetes.io/projected/6beb222b-b89e-4518-aea1-692285cc2951-istio-token\") pod \"6beb222b-b89e-4518-aea1-692285cc2951\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " Oct 30 20:22:54.875409 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.875250 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-credential-socket\") pod \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " Oct 30 20:22:54.875409 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.875346 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-istio-data\") pod \"6beb222b-b89e-4518-aea1-692285cc2951\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " Oct 30 20:22:54.875409 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.875384 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-istio-envoy\") pod \"6beb222b-b89e-4518-aea1-692285cc2951\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " Oct 30 20:22:54.875619 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.875439 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istiod-ca-cert\") pod \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " Oct 30 20:22:54.875619 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.875498 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-workload-socket\") pod \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\" (UID: \"ca42f8ad-24a9-4bec-9fcf-48582787f1c9\") " Oct 30 20:22:54.875619 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.875514 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-workload-socket" pod "6beb222b-b89e-4518-aea1-692285cc2951" (UID: "6beb222b-b89e-4518-aea1-692285cc2951"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:54.875619 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.875528 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6beb222b-b89e-4518-aea1-692285cc2951-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6beb222b-b89e-4518-aea1-692285cc2951-istiod-ca-cert\") pod \"6beb222b-b89e-4518-aea1-692285cc2951\" (UID: \"6beb222b-b89e-4518-aea1-692285cc2951\") " Oct 30 20:22:54.875619 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.875558 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-data" pod "ca42f8ad-24a9-4bec-9fcf-48582787f1c9" (UID: "ca42f8ad-24a9-4bec-9fcf-48582787f1c9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:54.875922 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.875703 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-workload-certs" pod "ca42f8ad-24a9-4bec-9fcf-48582787f1c9" (UID: "ca42f8ad-24a9-4bec-9fcf-48582787f1c9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:54.875922 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.875714 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-workload-certs" pod "6beb222b-b89e-4518-aea1-692285cc2951" (UID: "6beb222b-b89e-4518-aea1-692285cc2951"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:54.876422 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.876401 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:54.876512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.876424 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:54.876512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.876439 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:54.876512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.876451 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:54.877583 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.877390 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-credential-socket" pod "ca42f8ad-24a9-4bec-9fcf-48582787f1c9" (UID: "ca42f8ad-24a9-4bec-9fcf-48582787f1c9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:54.877781 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.877742 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6beb222b-b89e-4518-aea1-692285cc2951-kube-api-access-5r59f" pod "6beb222b-b89e-4518-aea1-692285cc2951" (UID: "6beb222b-b89e-4518-aea1-692285cc2951"). InnerVolumeSpecName "kube-api-access-5r59f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:54.877900 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.877864 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-credential-socket" pod "6beb222b-b89e-4518-aea1-692285cc2951" (UID: "6beb222b-b89e-4518-aea1-692285cc2951"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:54.877900 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.877884 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6beb222b-b89e-4518-aea1-692285cc2951-istio-podinfo" pod "6beb222b-b89e-4518-aea1-692285cc2951" (UID: "6beb222b-b89e-4518-aea1-692285cc2951"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:22:54.878025 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.877937 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-istio-data" pod "6beb222b-b89e-4518-aea1-692285cc2951" (UID: "6beb222b-b89e-4518-aea1-692285cc2951"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:54.878025 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.877941 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-workload-socket" pod "ca42f8ad-24a9-4bec-9fcf-48582787f1c9" (UID: "ca42f8ad-24a9-4bec-9fcf-48582787f1c9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:54.878138 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.878053 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-envoy" pod "ca42f8ad-24a9-4bec-9fcf-48582787f1c9" (UID: "ca42f8ad-24a9-4bec-9fcf-48582787f1c9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:54.878308 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.878283 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istiod-ca-cert" pod "ca42f8ad-24a9-4bec-9fcf-48582787f1c9" (UID: "ca42f8ad-24a9-4bec-9fcf-48582787f1c9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:22:54.878499 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.878478 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6beb222b-b89e-4518-aea1-692285cc2951-istiod-ca-cert" pod "6beb222b-b89e-4518-aea1-692285cc2951" (UID: "6beb222b-b89e-4518-aea1-692285cc2951"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:22:54.878596 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.878579 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-token" pod "ca42f8ad-24a9-4bec-9fcf-48582787f1c9" (UID: "ca42f8ad-24a9-4bec-9fcf-48582787f1c9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:54.878730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.878714 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-istio-envoy" pod "6beb222b-b89e-4518-aea1-692285cc2951" (UID: "6beb222b-b89e-4518-aea1-692285cc2951"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:54.878938 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.878914 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6beb222b-b89e-4518-aea1-692285cc2951-istio-token" pod "6beb222b-b89e-4518-aea1-692285cc2951" (UID: "6beb222b-b89e-4518-aea1-692285cc2951"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:54.879028 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.878976 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-podinfo" pod "ca42f8ad-24a9-4bec-9fcf-48582787f1c9" (UID: "ca42f8ad-24a9-4bec-9fcf-48582787f1c9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:22:54.879165 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.879150 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-kube-api-access-tx57s" pod "ca42f8ad-24a9-4bec-9fcf-48582787f1c9" (UID: "ca42f8ad-24a9-4bec-9fcf-48582787f1c9"). InnerVolumeSpecName "kube-api-access-tx57s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:54.977933 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.977893 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:54.977933 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.977927 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:54.977933 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.977939 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6beb222b-b89e-4518-aea1-692285cc2951-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:54.978239 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.977948 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:54.978239 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.977957 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:54.978239 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.977967 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:54.978239 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.977978 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:54.978239 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.977989 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:54.978239 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.977997 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6beb222b-b89e-4518-aea1-692285cc2951-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:54.978239 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.978005 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6beb222b-b89e-4518-aea1-692285cc2951-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:54.978239 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.978014 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx57s\" (UniqueName: \"kubernetes.io/projected/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-kube-api-access-tx57s\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:54.978239 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.978024 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca42f8ad-24a9-4bec-9fcf-48582787f1c9-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:54.978239 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.978032 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6beb222b-b89e-4518-aea1-692285cc2951-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:54.978239 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:54.978040 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5r59f\" (UniqueName: \"kubernetes.io/projected/6beb222b-b89e-4518-aea1-692285cc2951-kube-api-access-5r59f\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:55.167480 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.167451 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:22:55.282246 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.282207 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-workload-socket\") pod \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " Oct 30 20:22:55.282447 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.282322 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-data\") pod \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " Oct 30 20:22:55.282447 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.282443 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-workload-certs\") pod \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " Oct 30 20:22:55.282588 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.282472 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-token\" (UniqueName: \"kubernetes.io/projected/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-token\") pod \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " Oct 30 20:22:55.282588 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.282505 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-credential-socket\") pod \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " Oct 30 20:22:55.282588 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.282509 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-workload-socket" pod "9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" (UID: "9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:55.282588 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.282558 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-envoy\") pod \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " Oct 30 20:22:55.282800 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.282589 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istiod-ca-cert\") pod \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " Oct 30 20:22:55.282855 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.282816 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-workload-certs" pod "9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" (UID: "9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:55.282936 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.282895 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-credential-socket" pod "9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" (UID: "9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:55.283065 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.282969 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-podinfo\") pod \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " Oct 30 20:22:55.283065 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.283036 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-data" pod "9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" (UID: "9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:55.283065 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.283049 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istiod-ca-cert" pod "9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" (UID: "9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:22:55.283224 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.283052 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-kube-api-access-2dm86\" (UniqueName: \"kubernetes.io/projected/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-kube-api-access-2dm86\") pod \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\" (UID: \"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd\") " Oct 30 20:22:55.283882 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.283856 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:55.283965 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.283888 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:55.283965 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.283904 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:55.283965 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.283918 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:55.283965 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.283935 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:55.285764 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.285726 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-envoy" pod "9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" (UID: "9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:55.285867 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.285793 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-token" pod "9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" (UID: "9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:55.285867 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.285824 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-podinfo" pod "9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" (UID: "9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:22:55.285867 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.285837 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-kube-api-access-2dm86" pod "9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" (UID: "9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd"). InnerVolumeSpecName "kube-api-access-2dm86". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:55.337379 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.337317 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:22:55.385868 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.385836 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:55.385868 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.385867 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:55.386041 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.385880 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:55.386041 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.385893 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dm86\" (UniqueName: \"kubernetes.io/projected/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd-kube-api-access-2dm86\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:55.403423 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.403312 5078 generic.go:356] "Generic (PLEG): container finished" podID="9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" containerID="96b1c9741724402e163a667f134cfb07b1dcc35725f3d154b76b911ee3d63836" exitCode=0 Oct 30 20:22:55.403423 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.403375 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" Oct 30 20:22:55.403423 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.403384 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" event={"ID":"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd","Type":"ContainerDied","Data":"96b1c9741724402e163a667f134cfb07b1dcc35725f3d154b76b911ee3d63836"} Oct 30 20:22:55.403650 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.403465 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb" event={"ID":"9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd","Type":"ContainerDied","Data":"f93f424211bc872dc02d06bb526609bb5dd579c77845cedb385ccba1d3b8a638"} Oct 30 20:22:55.403650 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.403490 5078 scope.go:122] "RemoveContainer" containerID="96b1c9741724402e163a667f134cfb07b1dcc35725f3d154b76b911ee3d63836" Oct 30 20:22:55.408371 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.405534 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" Oct 30 20:22:55.408371 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.405540 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr" event={"ID":"ca42f8ad-24a9-4bec-9fcf-48582787f1c9","Type":"ContainerDied","Data":"6296148b1ab5a6dd24bd4975bb3a8ad6105181d1eb7205f9acfe93395782e900"} Oct 30 20:22:55.408371 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.407238 5078 generic.go:356] "Generic (PLEG): container finished" podID="6beb222b-b89e-4518-aea1-692285cc2951" containerID="86216c7652977261d5c2162168871fc6f7bcaf9b456185475e000ea10005a203" exitCode=0 Oct 30 20:22:55.408371 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.407368 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" event={"ID":"6beb222b-b89e-4518-aea1-692285cc2951","Type":"ContainerDied","Data":"86216c7652977261d5c2162168871fc6f7bcaf9b456185475e000ea10005a203"} Oct 30 20:22:55.408371 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.407412 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" event={"ID":"6beb222b-b89e-4518-aea1-692285cc2951","Type":"ContainerDied","Data":"0641dc22486d3c344a7894f7eb30294fe06279c678c2f1ba62bdbf756f32d531"} Oct 30 20:22:55.408371 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.407510 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7" Oct 30 20:22:55.416708 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.416382 5078 generic.go:356] "Generic (PLEG): container finished" podID="ae1473f0-1f82-4e44-9a44-a76562d7a880" containerID="aaca2aadf21d3860094760d99f290e5c57e827581a528f50e69711b9b87fb2b3" exitCode=0 Oct 30 20:22:55.416708 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.416408 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" event={"ID":"ae1473f0-1f82-4e44-9a44-a76562d7a880","Type":"ContainerDied","Data":"aaca2aadf21d3860094760d99f290e5c57e827581a528f50e69711b9b87fb2b3"} Oct 30 20:22:55.416708 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.416439 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" Oct 30 20:22:55.416708 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.416458 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm" event={"ID":"ae1473f0-1f82-4e44-9a44-a76562d7a880","Type":"ContainerDied","Data":"35b8ccbb657eacccad3ffe63181837111be0a6394b41a50e3e7fb4678a440ebb"} Oct 30 20:22:55.416708 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.416541 5078 scope.go:122] "RemoveContainer" containerID="96b1c9741724402e163a667f134cfb07b1dcc35725f3d154b76b911ee3d63836" Oct 30 20:22:55.416946 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:22:55.416806 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96b1c9741724402e163a667f134cfb07b1dcc35725f3d154b76b911ee3d63836\": container with ID starting with 96b1c9741724402e163a667f134cfb07b1dcc35725f3d154b76b911ee3d63836 not found: ID does not exist" containerID="96b1c9741724402e163a667f134cfb07b1dcc35725f3d154b76b911ee3d63836" Oct 30 20:22:55.416946 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.416833 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96b1c9741724402e163a667f134cfb07b1dcc35725f3d154b76b911ee3d63836"} err="failed to get container status \"96b1c9741724402e163a667f134cfb07b1dcc35725f3d154b76b911ee3d63836\": rpc error: code = NotFound desc = could not find container \"96b1c9741724402e163a667f134cfb07b1dcc35725f3d154b76b911ee3d63836\": container with ID starting with 96b1c9741724402e163a667f134cfb07b1dcc35725f3d154b76b911ee3d63836 not found: ID does not exist" Oct 30 20:22:55.416946 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.416849 5078 scope.go:122] "RemoveContainer" containerID="808ed515f1446a14db628954c25d3950a58eeb62be7920ecbd6f59228fc43b49" Oct 30 20:22:55.426450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.426433 5078 scope.go:122] "RemoveContainer" containerID="86216c7652977261d5c2162168871fc6f7bcaf9b456185475e000ea10005a203" Oct 30 20:22:55.435439 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.435422 5078 scope.go:122] "RemoveContainer" containerID="86216c7652977261d5c2162168871fc6f7bcaf9b456185475e000ea10005a203" Oct 30 20:22:55.435723 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:22:55.435706 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86216c7652977261d5c2162168871fc6f7bcaf9b456185475e000ea10005a203\": container with ID starting with 86216c7652977261d5c2162168871fc6f7bcaf9b456185475e000ea10005a203 not found: ID does not exist" containerID="86216c7652977261d5c2162168871fc6f7bcaf9b456185475e000ea10005a203" Oct 30 20:22:55.435777 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.435730 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86216c7652977261d5c2162168871fc6f7bcaf9b456185475e000ea10005a203"} err="failed to get container status \"86216c7652977261d5c2162168871fc6f7bcaf9b456185475e000ea10005a203\": rpc error: code = NotFound desc = could not find container \"86216c7652977261d5c2162168871fc6f7bcaf9b456185475e000ea10005a203\": container with ID starting with 86216c7652977261d5c2162168871fc6f7bcaf9b456185475e000ea10005a203 not found: ID does not exist" Oct 30 20:22:55.435777 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.435746 5078 scope.go:122] "RemoveContainer" containerID="aaca2aadf21d3860094760d99f290e5c57e827581a528f50e69711b9b87fb2b3" Oct 30 20:22:55.442503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.442478 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7"] Oct 30 20:22:55.446441 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.446422 5078 scope.go:122] "RemoveContainer" containerID="aaca2aadf21d3860094760d99f290e5c57e827581a528f50e69711b9b87fb2b3" Oct 30 20:22:55.446732 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:22:55.446711 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaca2aadf21d3860094760d99f290e5c57e827581a528f50e69711b9b87fb2b3\": container with ID starting with aaca2aadf21d3860094760d99f290e5c57e827581a528f50e69711b9b87fb2b3 not found: ID does not exist" containerID="aaca2aadf21d3860094760d99f290e5c57e827581a528f50e69711b9b87fb2b3" Oct 30 20:22:55.446812 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.446740 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaca2aadf21d3860094760d99f290e5c57e827581a528f50e69711b9b87fb2b3"} err="failed to get container status \"aaca2aadf21d3860094760d99f290e5c57e827581a528f50e69711b9b87fb2b3\": rpc error: code = NotFound desc = could not find container \"aaca2aadf21d3860094760d99f290e5c57e827581a528f50e69711b9b87fb2b3\": container with ID starting with aaca2aadf21d3860094760d99f290e5c57e827581a528f50e69711b9b87fb2b3 not found: ID does not exist" Oct 30 20:22:55.447236 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.447218 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-hhhw7"] Oct 30 20:22:55.462833 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.462811 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb"] Oct 30 20:22:55.468507 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.468486 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-lxfdb"] Oct 30 20:22:55.481009 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.480986 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr"] Oct 30 20:22:55.486548 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.486528 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-token\" (UniqueName: \"kubernetes.io/projected/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-token\") pod \"ae1473f0-1f82-4e44-9a44-a76562d7a880\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " Oct 30 20:22:55.486662 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.486575 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-credential-socket\") pod \"ae1473f0-1f82-4e44-9a44-a76562d7a880\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " Oct 30 20:22:55.486662 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.486601 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ae1473f0-1f82-4e44-9a44-a76562d7a880-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae1473f0-1f82-4e44-9a44-a76562d7a880-istiod-ca-cert\") pod \"ae1473f0-1f82-4e44-9a44-a76562d7a880\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " Oct 30 20:22:55.486781 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.486664 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-workload-socket\") pod \"ae1473f0-1f82-4e44-9a44-a76562d7a880\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " Oct 30 20:22:55.486781 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.486700 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ae1473f0-1f82-4e44-9a44-a76562d7a880-kube-api-access-l2jhl\" (UniqueName: \"kubernetes.io/projected/ae1473f0-1f82-4e44-9a44-a76562d7a880-kube-api-access-l2jhl\") pod \"ae1473f0-1f82-4e44-9a44-a76562d7a880\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " Oct 30 20:22:55.486879 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.486808 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-envoy\") pod \"ae1473f0-1f82-4e44-9a44-a76562d7a880\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " Oct 30 20:22:55.486938 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.486909 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-workload-certs\") pod \"ae1473f0-1f82-4e44-9a44-a76562d7a880\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " Oct 30 20:22:55.486992 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.486942 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-credential-socket" pod "ae1473f0-1f82-4e44-9a44-a76562d7a880" (UID: "ae1473f0-1f82-4e44-9a44-a76562d7a880"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:55.486992 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.486982 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-data\") pod \"ae1473f0-1f82-4e44-9a44-a76562d7a880\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " Oct 30 20:22:55.487100 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.487006 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-workload-socket" pod "ae1473f0-1f82-4e44-9a44-a76562d7a880" (UID: "ae1473f0-1f82-4e44-9a44-a76562d7a880"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:55.487100 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.487038 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-podinfo\") pod \"ae1473f0-1f82-4e44-9a44-a76562d7a880\" (UID: \"ae1473f0-1f82-4e44-9a44-a76562d7a880\") " Oct 30 20:22:55.487100 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.487044 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae1473f0-1f82-4e44-9a44-a76562d7a880-istiod-ca-cert" pod "ae1473f0-1f82-4e44-9a44-a76562d7a880" (UID: "ae1473f0-1f82-4e44-9a44-a76562d7a880"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:22:55.487248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.487183 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-workload-certs" pod "ae1473f0-1f82-4e44-9a44-a76562d7a880" (UID: "ae1473f0-1f82-4e44-9a44-a76562d7a880"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:55.487379 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.487315 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-data" pod "ae1473f0-1f82-4e44-9a44-a76562d7a880" (UID: "ae1473f0-1f82-4e44-9a44-a76562d7a880"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:55.487661 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.487638 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:55.487733 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.487666 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:55.487733 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.487682 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:55.487733 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.487695 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae1473f0-1f82-4e44-9a44-a76562d7a880-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:55.487733 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.487708 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:55.487952 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.487866 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-jm6nr"] Oct 30 20:22:55.489079 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.488973 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-envoy" pod "ae1473f0-1f82-4e44-9a44-a76562d7a880" (UID: "ae1473f0-1f82-4e44-9a44-a76562d7a880"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:55.489079 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.489052 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-podinfo" pod "ae1473f0-1f82-4e44-9a44-a76562d7a880" (UID: "ae1473f0-1f82-4e44-9a44-a76562d7a880"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:22:55.489202 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.489116 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-token" pod "ae1473f0-1f82-4e44-9a44-a76562d7a880" (UID: "ae1473f0-1f82-4e44-9a44-a76562d7a880"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:55.489202 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.489191 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae1473f0-1f82-4e44-9a44-a76562d7a880-kube-api-access-l2jhl" pod "ae1473f0-1f82-4e44-9a44-a76562d7a880" (UID: "ae1473f0-1f82-4e44-9a44-a76562d7a880"). InnerVolumeSpecName "kube-api-access-l2jhl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:55.587906 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.587873 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6beb222b-b89e-4518-aea1-692285cc2951" path="/var/lib/kubelet/pods/6beb222b-b89e-4518-aea1-692285cc2951/volumes" Oct 30 20:22:55.588444 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.588426 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" path="/var/lib/kubelet/pods/9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd/volumes" Oct 30 20:22:55.589141 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.589034 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ca42f8ad-24a9-4bec-9fcf-48582787f1c9" path="/var/lib/kubelet/pods/ca42f8ad-24a9-4bec-9fcf-48582787f1c9/volumes" Oct 30 20:22:55.589141 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.589096 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:55.589141 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.589119 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:55.589141 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.589138 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2jhl\" (UniqueName: \"kubernetes.io/projected/ae1473f0-1f82-4e44-9a44-a76562d7a880-kube-api-access-l2jhl\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:55.589374 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.589154 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae1473f0-1f82-4e44-9a44-a76562d7a880-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:55.738757 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.738686 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm"] Oct 30 20:22:55.744096 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:55.744065 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-44135b-openshift-default-76f454bf89-c8mvm"] Oct 30 20:22:56.701001 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:22:56.700965 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:22:57.585219 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:57.585170 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ae1473f0-1f82-4e44-9a44-a76562d7a880" path="/var/lib/kubelet/pods/ae1473f0-1f82-4e44-9a44-a76562d7a880/volumes" Oct 30 20:22:57.621519 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:57.621485 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465"] Oct 30 20:22:57.621762 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:57.621737 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" podUID="bb6d3cde-8f40-4aa2-a446-ee6a410aba52" containerName="maas-api" containerID="cri-o://05dd6ed92df6140f405042331cb81ac4973cd363c5c6dfc036440fd95a4542d4" gracePeriod=30 Oct 30 20:22:58.249596 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.248581 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" Oct 30 20:22:58.352246 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.352214 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:22:58.376809 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.376767 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-kube-api-access-rq5pg\" (UniqueName: \"kubernetes.io/projected/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-kube-api-access-rq5pg\") pod \"bb6d3cde-8f40-4aa2-a446-ee6a410aba52\" (UID: \"bb6d3cde-8f40-4aa2-a446-ee6a410aba52\") " Oct 30 20:22:58.376989 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.376851 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-maas-api-tls\") pod \"bb6d3cde-8f40-4aa2-a446-ee6a410aba52\" (UID: \"bb6d3cde-8f40-4aa2-a446-ee6a410aba52\") " Oct 30 20:22:58.376989 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.376909 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-openshift-service-ca\") pod \"bb6d3cde-8f40-4aa2-a446-ee6a410aba52\" (UID: \"bb6d3cde-8f40-4aa2-a446-ee6a410aba52\") " Oct 30 20:22:58.377129 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.377000 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-metrics-certs\") pod \"bb6d3cde-8f40-4aa2-a446-ee6a410aba52\" (UID: \"bb6d3cde-8f40-4aa2-a446-ee6a410aba52\") " Oct 30 20:22:58.377481 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.377445 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-openshift-service-ca" pod "bb6d3cde-8f40-4aa2-a446-ee6a410aba52" (UID: "bb6d3cde-8f40-4aa2-a446-ee6a410aba52"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:22:58.377660 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.377624 5078 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-openshift-service-ca\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.379783 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.379759 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-maas-api-tls" pod "bb6d3cde-8f40-4aa2-a446-ee6a410aba52" (UID: "bb6d3cde-8f40-4aa2-a446-ee6a410aba52"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:22:58.379958 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.379808 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-kube-api-access-rq5pg" pod "bb6d3cde-8f40-4aa2-a446-ee6a410aba52" (UID: "bb6d3cde-8f40-4aa2-a446-ee6a410aba52"). InnerVolumeSpecName "kube-api-access-rq5pg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:58.381849 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.381814 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-metrics-certs" pod "bb6d3cde-8f40-4aa2-a446-ee6a410aba52" (UID: "bb6d3cde-8f40-4aa2-a446-ee6a410aba52"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:22:58.446852 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.446815 5078 generic.go:356] "Generic (PLEG): container finished" podID="50d97c5f-9b0e-4851-b1b5-400c74b23352" containerID="7ff3e0cd535e3e9bc506d13542a819d0236d1f9992c4ecc9ae9b766b7d2037f7" exitCode=0 Oct 30 20:22:58.446989 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.446865 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" Oct 30 20:22:58.446989 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.446928 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" event={"ID":"50d97c5f-9b0e-4851-b1b5-400c74b23352","Type":"ContainerDied","Data":"7ff3e0cd535e3e9bc506d13542a819d0236d1f9992c4ecc9ae9b766b7d2037f7"} Oct 30 20:22:58.446989 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.446978 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64" event={"ID":"50d97c5f-9b0e-4851-b1b5-400c74b23352","Type":"ContainerDied","Data":"33c2c13eb439b11acb99a2c337aacd9287d2e23ce941f00294a62a1ebe142b0b"} Oct 30 20:22:58.447176 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.447011 5078 scope.go:122] "RemoveContainer" containerID="7ff3e0cd535e3e9bc506d13542a819d0236d1f9992c4ecc9ae9b766b7d2037f7" Oct 30 20:22:58.447506 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.447488 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:22:58.449301 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.449274 5078 generic.go:356] "Generic (PLEG): container finished" podID="82a38bcc-0f98-4cf5-901f-e7bd47f9755b" containerID="33c34d533e597c3edd15d81b9a57fc921410261aaecea312cc8fb178d71a2ab9" exitCode=0 Oct 30 20:22:58.449632 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.449323 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" event={"ID":"82a38bcc-0f98-4cf5-901f-e7bd47f9755b","Type":"ContainerDied","Data":"33c34d533e597c3edd15d81b9a57fc921410261aaecea312cc8fb178d71a2ab9"} Oct 30 20:22:58.451779 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.451761 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:22:58.451891 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.451869 5078 generic.go:356] "Generic (PLEG): container finished" podID="179c807f-ec84-47b4-ba09-51354cbcff6a" containerID="6f66c7161b977b4327b9f483d5b132db4ed309135819bcbfec8acd3352bb559b" exitCode=0 Oct 30 20:22:58.452082 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.451900 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" Oct 30 20:22:58.452171 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.451914 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" event={"ID":"179c807f-ec84-47b4-ba09-51354cbcff6a","Type":"ContainerDied","Data":"6f66c7161b977b4327b9f483d5b132db4ed309135819bcbfec8acd3352bb559b"} Oct 30 20:22:58.452321 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.452170 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk" event={"ID":"179c807f-ec84-47b4-ba09-51354cbcff6a","Type":"ContainerDied","Data":"08448d86756da6bae14f4d93e2f44e2a9a31b0719ee7eab05a72196cae38ce30"} Oct 30 20:22:58.453856 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.453834 5078 generic.go:356] "Generic (PLEG): container finished" podID="48a25fb9-3214-4c1c-95fe-d751ad4372e4" containerID="f7b43e46b3d8299ae04cd481136ed1d5e4f9c08105486b4a20ef4690179b79ea" exitCode=0 Oct 30 20:22:58.453964 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.453868 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" Oct 30 20:22:58.453964 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.453914 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn" event={"ID":"48a25fb9-3214-4c1c-95fe-d751ad4372e4","Type":"ContainerDied","Data":"f7b43e46b3d8299ae04cd481136ed1d5e4f9c08105486b4a20ef4690179b79ea"} Oct 30 20:22:58.455610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.455588 5078 generic.go:356] "Generic (PLEG): container finished" podID="bb6d3cde-8f40-4aa2-a446-ee6a410aba52" containerID="05dd6ed92df6140f405042331cb81ac4973cd363c5c6dfc036440fd95a4542d4" exitCode=0 Oct 30 20:22:58.455739 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.455624 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" Oct 30 20:22:58.455739 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.455643 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" event={"ID":"bb6d3cde-8f40-4aa2-a446-ee6a410aba52","Type":"ContainerDied","Data":"05dd6ed92df6140f405042331cb81ac4973cd363c5c6dfc036440fd95a4542d4"} Oct 30 20:22:58.455739 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.455680 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465" event={"ID":"bb6d3cde-8f40-4aa2-a446-ee6a410aba52","Type":"ContainerDied","Data":"3273bdf669323f0dac97a349d51db99b6a914ce3dff0154b2805194b99312a36"} Oct 30 20:22:58.462563 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.462543 5078 scope.go:122] "RemoveContainer" containerID="7ff3e0cd535e3e9bc506d13542a819d0236d1f9992c4ecc9ae9b766b7d2037f7" Oct 30 20:22:58.462923 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:22:58.462897 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ff3e0cd535e3e9bc506d13542a819d0236d1f9992c4ecc9ae9b766b7d2037f7\": container with ID starting with 7ff3e0cd535e3e9bc506d13542a819d0236d1f9992c4ecc9ae9b766b7d2037f7 not found: ID does not exist" containerID="7ff3e0cd535e3e9bc506d13542a819d0236d1f9992c4ecc9ae9b766b7d2037f7" Oct 30 20:22:58.463038 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.462936 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ff3e0cd535e3e9bc506d13542a819d0236d1f9992c4ecc9ae9b766b7d2037f7"} err="failed to get container status \"7ff3e0cd535e3e9bc506d13542a819d0236d1f9992c4ecc9ae9b766b7d2037f7\": rpc error: code = NotFound desc = could not find container \"7ff3e0cd535e3e9bc506d13542a819d0236d1f9992c4ecc9ae9b766b7d2037f7\": container with ID starting with 7ff3e0cd535e3e9bc506d13542a819d0236d1f9992c4ecc9ae9b766b7d2037f7 not found: ID does not exist" Oct 30 20:22:58.463038 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.462961 5078 scope.go:122] "RemoveContainer" containerID="6f66c7161b977b4327b9f483d5b132db4ed309135819bcbfec8acd3352bb559b" Oct 30 20:22:58.482128 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.482094 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-credential-socket\") pod \"50d97c5f-9b0e-4851-b1b5-400c74b23352\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " Oct 30 20:22:58.482278 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.482162 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-data\") pod \"50d97c5f-9b0e-4851-b1b5-400c74b23352\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " Oct 30 20:22:58.482278 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.482248 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-podinfo\") pod \"50d97c5f-9b0e-4851-b1b5-400c74b23352\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " Oct 30 20:22:58.482415 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.482372 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/50d97c5f-9b0e-4851-b1b5-400c74b23352-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50d97c5f-9b0e-4851-b1b5-400c74b23352-istiod-ca-cert\") pod \"50d97c5f-9b0e-4851-b1b5-400c74b23352\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " Oct 30 20:22:58.482526 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.482507 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-token\" (UniqueName: \"kubernetes.io/projected/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-token\") pod \"50d97c5f-9b0e-4851-b1b5-400c74b23352\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " Oct 30 20:22:58.482580 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.482571 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-envoy\") pod \"50d97c5f-9b0e-4851-b1b5-400c74b23352\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " Oct 30 20:22:58.482628 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.482607 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-workload-certs\") pod \"50d97c5f-9b0e-4851-b1b5-400c74b23352\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " Oct 30 20:22:58.483319 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.482645 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-workload-socket\") pod \"50d97c5f-9b0e-4851-b1b5-400c74b23352\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " Oct 30 20:22:58.483319 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.482698 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50d97c5f-9b0e-4851-b1b5-400c74b23352-kube-api-access-n9r8t\" (UniqueName: \"kubernetes.io/projected/50d97c5f-9b0e-4851-b1b5-400c74b23352-kube-api-access-n9r8t\") pod \"50d97c5f-9b0e-4851-b1b5-400c74b23352\" (UID: \"50d97c5f-9b0e-4851-b1b5-400c74b23352\") " Oct 30 20:22:58.483319 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.483270 5078 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-metrics-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.483319 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.483294 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rq5pg\" (UniqueName: \"kubernetes.io/projected/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-kube-api-access-rq5pg\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.483319 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.483310 5078 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb6d3cde-8f40-4aa2-a446-ee6a410aba52-maas-api-tls\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.484772 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.484436 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-credential-socket" pod "50d97c5f-9b0e-4851-b1b5-400c74b23352" (UID: "50d97c5f-9b0e-4851-b1b5-400c74b23352"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:58.484772 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.484495 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50d97c5f-9b0e-4851-b1b5-400c74b23352-istiod-ca-cert" pod "50d97c5f-9b0e-4851-b1b5-400c74b23352" (UID: "50d97c5f-9b0e-4851-b1b5-400c74b23352"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:22:58.484772 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.484590 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-data" pod "50d97c5f-9b0e-4851-b1b5-400c74b23352" (UID: "50d97c5f-9b0e-4851-b1b5-400c74b23352"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:58.485048 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.485025 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-workload-certs" pod "50d97c5f-9b0e-4851-b1b5-400c74b23352" (UID: "50d97c5f-9b0e-4851-b1b5-400c74b23352"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:58.485246 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.485224 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-workload-socket" pod "50d97c5f-9b0e-4851-b1b5-400c74b23352" (UID: "50d97c5f-9b0e-4851-b1b5-400c74b23352"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:58.485787 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.485766 5078 scope.go:122] "RemoveContainer" containerID="6f66c7161b977b4327b9f483d5b132db4ed309135819bcbfec8acd3352bb559b" Oct 30 20:22:58.486244 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:22:58.486217 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f66c7161b977b4327b9f483d5b132db4ed309135819bcbfec8acd3352bb559b\": container with ID starting with 6f66c7161b977b4327b9f483d5b132db4ed309135819bcbfec8acd3352bb559b not found: ID does not exist" containerID="6f66c7161b977b4327b9f483d5b132db4ed309135819bcbfec8acd3352bb559b" Oct 30 20:22:58.486321 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.486254 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f66c7161b977b4327b9f483d5b132db4ed309135819bcbfec8acd3352bb559b"} err="failed to get container status \"6f66c7161b977b4327b9f483d5b132db4ed309135819bcbfec8acd3352bb559b\": rpc error: code = NotFound desc = could not find container \"6f66c7161b977b4327b9f483d5b132db4ed309135819bcbfec8acd3352bb559b\": container with ID starting with 6f66c7161b977b4327b9f483d5b132db4ed309135819bcbfec8acd3352bb559b not found: ID does not exist" Oct 30 20:22:58.486321 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.486277 5078 scope.go:122] "RemoveContainer" containerID="f7b43e46b3d8299ae04cd481136ed1d5e4f9c08105486b4a20ef4690179b79ea" Oct 30 20:22:58.487556 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.487506 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50d97c5f-9b0e-4851-b1b5-400c74b23352-kube-api-access-n9r8t" pod "50d97c5f-9b0e-4851-b1b5-400c74b23352" (UID: "50d97c5f-9b0e-4851-b1b5-400c74b23352"). InnerVolumeSpecName "kube-api-access-n9r8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:58.491750 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.491693 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-podinfo" pod "50d97c5f-9b0e-4851-b1b5-400c74b23352" (UID: "50d97c5f-9b0e-4851-b1b5-400c74b23352"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:22:58.491986 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.491964 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-envoy" pod "50d97c5f-9b0e-4851-b1b5-400c74b23352" (UID: "50d97c5f-9b0e-4851-b1b5-400c74b23352"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:58.494078 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.494051 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-token" pod "50d97c5f-9b0e-4851-b1b5-400c74b23352" (UID: "50d97c5f-9b0e-4851-b1b5-400c74b23352"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:58.499133 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.499067 5078 scope.go:122] "RemoveContainer" containerID="05dd6ed92df6140f405042331cb81ac4973cd363c5c6dfc036440fd95a4542d4" Oct 30 20:22:58.510297 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.510237 5078 scope.go:122] "RemoveContainer" containerID="05dd6ed92df6140f405042331cb81ac4973cd363c5c6dfc036440fd95a4542d4" Oct 30 20:22:58.511361 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:22:58.510587 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05dd6ed92df6140f405042331cb81ac4973cd363c5c6dfc036440fd95a4542d4\": container with ID starting with 05dd6ed92df6140f405042331cb81ac4973cd363c5c6dfc036440fd95a4542d4 not found: ID does not exist" containerID="05dd6ed92df6140f405042331cb81ac4973cd363c5c6dfc036440fd95a4542d4" Oct 30 20:22:58.511361 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.510620 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05dd6ed92df6140f405042331cb81ac4973cd363c5c6dfc036440fd95a4542d4"} err="failed to get container status \"05dd6ed92df6140f405042331cb81ac4973cd363c5c6dfc036440fd95a4542d4\": rpc error: code = NotFound desc = could not find container \"05dd6ed92df6140f405042331cb81ac4973cd363c5c6dfc036440fd95a4542d4\": container with ID starting with 05dd6ed92df6140f405042331cb81ac4973cd363c5c6dfc036440fd95a4542d4 not found: ID does not exist" Oct 30 20:22:58.512246 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.512226 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:22:58.529383 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.529357 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465"] Oct 30 20:22:58.539009 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.538984 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-909519-7d8789995f-p9465"] Oct 30 20:22:58.583842 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.583816 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-envoy\") pod \"179c807f-ec84-47b4-ba09-51354cbcff6a\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " Oct 30 20:22:58.584011 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.583859 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-podinfo\") pod \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " Oct 30 20:22:58.584011 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.583912 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istiod-ca-cert\") pod \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " Oct 30 20:22:58.584011 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.583948 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-data\") pod \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " Oct 30 20:22:58.584188 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.584033 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-data\") pod \"179c807f-ec84-47b4-ba09-51354cbcff6a\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " Oct 30 20:22:58.584188 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.584093 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-envoy\") pod \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " Oct 30 20:22:58.584188 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.584123 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-token\" (UniqueName: \"kubernetes.io/projected/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-token\") pod \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " Oct 30 20:22:58.584188 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.584157 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-credential-socket\") pod \"179c807f-ec84-47b4-ba09-51354cbcff6a\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " Oct 30 20:22:58.584446 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.584195 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-token\" (UniqueName: \"kubernetes.io/projected/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-token\") pod \"179c807f-ec84-47b4-ba09-51354cbcff6a\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " Oct 30 20:22:58.584446 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.584293 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/179c807f-ec84-47b4-ba09-51354cbcff6a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/179c807f-ec84-47b4-ba09-51354cbcff6a-istiod-ca-cert\") pod \"179c807f-ec84-47b4-ba09-51354cbcff6a\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " Oct 30 20:22:58.584446 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.584349 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-workload-certs\") pod \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " Oct 30 20:22:58.584446 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.584384 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-workload-socket\") pod \"179c807f-ec84-47b4-ba09-51354cbcff6a\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " Oct 30 20:22:58.584446 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.584408 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istiod-ca-cert" pod "48a25fb9-3214-4c1c-95fe-d751ad4372e4" (UID: "48a25fb9-3214-4c1c-95fe-d751ad4372e4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:22:58.584446 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.584427 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/179c807f-ec84-47b4-ba09-51354cbcff6a-kube-api-access-85w2q\" (UniqueName: \"kubernetes.io/projected/179c807f-ec84-47b4-ba09-51354cbcff6a-kube-api-access-85w2q\") pod \"179c807f-ec84-47b4-ba09-51354cbcff6a\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " Oct 30 20:22:58.584746 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.584477 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-workload-certs\") pod \"179c807f-ec84-47b4-ba09-51354cbcff6a\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " Oct 30 20:22:58.584746 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.584531 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-workload-socket\") pod \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " Oct 30 20:22:58.584746 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.584584 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-podinfo\") pod \"179c807f-ec84-47b4-ba09-51354cbcff6a\" (UID: \"179c807f-ec84-47b4-ba09-51354cbcff6a\") " Oct 30 20:22:58.584746 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.584625 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-credential-socket\") pod \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " Oct 30 20:22:58.584746 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.584673 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/48a25fb9-3214-4c1c-95fe-d751ad4372e4-kube-api-access-55phw\" (UniqueName: \"kubernetes.io/projected/48a25fb9-3214-4c1c-95fe-d751ad4372e4-kube-api-access-55phw\") pod \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\" (UID: \"48a25fb9-3214-4c1c-95fe-d751ad4372e4\") " Oct 30 20:22:58.585303 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.585278 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.585427 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.585307 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.585427 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.585320 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.585427 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.585372 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.585427 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.585385 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9r8t\" (UniqueName: \"kubernetes.io/projected/50d97c5f-9b0e-4851-b1b5-400c74b23352-kube-api-access-n9r8t\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.585427 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.585399 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.585427 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.585411 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.585427 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.585424 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50d97c5f-9b0e-4851-b1b5-400c74b23352-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.586099 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.585438 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50d97c5f-9b0e-4851-b1b5-400c74b23352-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.586099 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.585473 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.586099 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.584527 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-credential-socket" pod "179c807f-ec84-47b4-ba09-51354cbcff6a" (UID: "179c807f-ec84-47b4-ba09-51354cbcff6a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:58.586099 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.584615 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-data" pod "48a25fb9-3214-4c1c-95fe-d751ad4372e4" (UID: "48a25fb9-3214-4c1c-95fe-d751ad4372e4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:58.586099 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.584721 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-workload-certs" pod "48a25fb9-3214-4c1c-95fe-d751ad4372e4" (UID: "48a25fb9-3214-4c1c-95fe-d751ad4372e4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:58.586099 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.584994 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/179c807f-ec84-47b4-ba09-51354cbcff6a-istiod-ca-cert" pod "179c807f-ec84-47b4-ba09-51354cbcff6a" (UID: "179c807f-ec84-47b4-ba09-51354cbcff6a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:22:58.586099 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.585237 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-workload-socket" pod "48a25fb9-3214-4c1c-95fe-d751ad4372e4" (UID: "48a25fb9-3214-4c1c-95fe-d751ad4372e4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:58.586099 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.585438 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-workload-socket" pod "179c807f-ec84-47b4-ba09-51354cbcff6a" (UID: "179c807f-ec84-47b4-ba09-51354cbcff6a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:58.586099 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.586061 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-workload-certs" pod "179c807f-ec84-47b4-ba09-51354cbcff6a" (UID: "179c807f-ec84-47b4-ba09-51354cbcff6a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:58.586916 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.586889 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-credential-socket" pod "48a25fb9-3214-4c1c-95fe-d751ad4372e4" (UID: "48a25fb9-3214-4c1c-95fe-d751ad4372e4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:58.587004 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.586956 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-data" pod "179c807f-ec84-47b4-ba09-51354cbcff6a" (UID: "179c807f-ec84-47b4-ba09-51354cbcff6a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:58.587915 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.587859 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-token" pod "179c807f-ec84-47b4-ba09-51354cbcff6a" (UID: "179c807f-ec84-47b4-ba09-51354cbcff6a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:58.587915 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.587882 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-podinfo" pod "48a25fb9-3214-4c1c-95fe-d751ad4372e4" (UID: "48a25fb9-3214-4c1c-95fe-d751ad4372e4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:22:58.588151 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.588003 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-envoy" pod "179c807f-ec84-47b4-ba09-51354cbcff6a" (UID: "179c807f-ec84-47b4-ba09-51354cbcff6a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:58.588216 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.588174 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48a25fb9-3214-4c1c-95fe-d751ad4372e4-kube-api-access-55phw" pod "48a25fb9-3214-4c1c-95fe-d751ad4372e4" (UID: "48a25fb9-3214-4c1c-95fe-d751ad4372e4"). InnerVolumeSpecName "kube-api-access-55phw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:58.588409 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.588384 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-envoy" pod "48a25fb9-3214-4c1c-95fe-d751ad4372e4" (UID: "48a25fb9-3214-4c1c-95fe-d751ad4372e4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:58.588598 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.588576 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-token" pod "48a25fb9-3214-4c1c-95fe-d751ad4372e4" (UID: "48a25fb9-3214-4c1c-95fe-d751ad4372e4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:58.588970 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.588941 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-podinfo" pod "179c807f-ec84-47b4-ba09-51354cbcff6a" (UID: "179c807f-ec84-47b4-ba09-51354cbcff6a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:22:58.589386 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.589362 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/179c807f-ec84-47b4-ba09-51354cbcff6a-kube-api-access-85w2q" pod "179c807f-ec84-47b4-ba09-51354cbcff6a" (UID: "179c807f-ec84-47b4-ba09-51354cbcff6a"). InnerVolumeSpecName "kube-api-access-85w2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:58.686945 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.686855 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istiod-ca-cert\") pod \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " Oct 30 20:22:58.686945 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.686910 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-credential-socket\") pod \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " Oct 30 20:22:58.686945 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.686933 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-kube-api-access-w4jxv\" (UniqueName: \"kubernetes.io/projected/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-kube-api-access-w4jxv\") pod \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " Oct 30 20:22:58.687212 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.686960 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-workload-certs\") pod \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " Oct 30 20:22:58.687212 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.687026 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-envoy\") pod \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " Oct 30 20:22:58.687212 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.687057 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-data\") pod \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " Oct 30 20:22:58.687212 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.687164 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-workload-socket\") pod \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " Oct 30 20:22:58.687443 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.687224 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-token\" (UniqueName: \"kubernetes.io/projected/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-token\") pod \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " Oct 30 20:22:58.687443 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.687271 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istiod-ca-cert" pod "82a38bcc-0f98-4cf5-901f-e7bd47f9755b" (UID: "82a38bcc-0f98-4cf5-901f-e7bd47f9755b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:22:58.687443 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.687311 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-podinfo\") pod \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\" (UID: \"82a38bcc-0f98-4cf5-901f-e7bd47f9755b\") " Oct 30 20:22:58.688096 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.687429 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-credential-socket" pod "82a38bcc-0f98-4cf5-901f-e7bd47f9755b" (UID: "82a38bcc-0f98-4cf5-901f-e7bd47f9755b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:58.688096 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.687563 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-data" pod "82a38bcc-0f98-4cf5-901f-e7bd47f9755b" (UID: "82a38bcc-0f98-4cf5-901f-e7bd47f9755b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:58.688096 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.687775 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-workload-socket" pod "82a38bcc-0f98-4cf5-901f-e7bd47f9755b" (UID: "82a38bcc-0f98-4cf5-901f-e7bd47f9755b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:58.688096 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688006 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.688096 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688030 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.688096 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688049 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.688096 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688065 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.688096 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688083 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.688096 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688099 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.688580 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688114 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.688580 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688129 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/179c807f-ec84-47b4-ba09-51354cbcff6a-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.688580 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688142 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.688580 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688157 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.688580 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688172 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.688580 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688185 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85w2q\" (UniqueName: \"kubernetes.io/projected/179c807f-ec84-47b4-ba09-51354cbcff6a-kube-api-access-85w2q\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.688580 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688199 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.688580 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688213 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.688580 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688225 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.688580 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688235 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.688580 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688243 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48a25fb9-3214-4c1c-95fe-d751ad4372e4-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.688580 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688251 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.688580 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688260 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55phw\" (UniqueName: \"kubernetes.io/projected/48a25fb9-3214-4c1c-95fe-d751ad4372e4-kube-api-access-55phw\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.688580 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688269 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/179c807f-ec84-47b4-ba09-51354cbcff6a-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.688580 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688277 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48a25fb9-3214-4c1c-95fe-d751ad4372e4-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.688580 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.688341 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-workload-certs" pod "82a38bcc-0f98-4cf5-901f-e7bd47f9755b" (UID: "82a38bcc-0f98-4cf5-901f-e7bd47f9755b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:58.689734 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.689710 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-podinfo" pod "82a38bcc-0f98-4cf5-901f-e7bd47f9755b" (UID: "82a38bcc-0f98-4cf5-901f-e7bd47f9755b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:22:58.689846 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.689828 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-token" pod "82a38bcc-0f98-4cf5-901f-e7bd47f9755b" (UID: "82a38bcc-0f98-4cf5-901f-e7bd47f9755b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:58.689889 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.689841 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-kube-api-access-w4jxv" pod "82a38bcc-0f98-4cf5-901f-e7bd47f9755b" (UID: "82a38bcc-0f98-4cf5-901f-e7bd47f9755b"). InnerVolumeSpecName "kube-api-access-w4jxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:58.689926 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.689893 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-envoy" pod "82a38bcc-0f98-4cf5-901f-e7bd47f9755b" (UID: "82a38bcc-0f98-4cf5-901f-e7bd47f9755b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:58.782116 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.782083 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64"] Oct 30 20:22:58.789436 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.789393 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.789436 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.789440 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4jxv\" (UniqueName: \"kubernetes.io/projected/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-kube-api-access-w4jxv\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.789585 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.789457 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.789585 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.789472 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.789585 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.789486 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82a38bcc-0f98-4cf5-901f-e7bd47f9755b-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:58.789907 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.789890 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-4cp64"] Oct 30 20:22:58.806507 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.806481 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk"] Oct 30 20:22:58.811989 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.811963 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-lgtkk"] Oct 30 20:22:58.830781 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.830754 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn"] Oct 30 20:22:58.841861 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:58.841839 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-xn7fn"] Oct 30 20:22:59.495810 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.495771 5078 generic.go:356] "Generic (PLEG): container finished" podID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerID="a9dd23ca6f60b482f604ed1bace4c6e1cf2a5a577a0722c3970f8ea7c4a5e8d5" exitCode=0 Oct 30 20:22:59.496423 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.496394 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" event={"ID":"f398ea35-32fa-425c-9e05-a3fd41ba99ba","Type":"ContainerDied","Data":"a9dd23ca6f60b482f604ed1bace4c6e1cf2a5a577a0722c3970f8ea7c4a5e8d5"} Oct 30 20:22:59.502511 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.502483 5078 generic.go:356] "Generic (PLEG): container finished" podID="25da5733-edc7-4a62-bc21-dbe63273deed" containerID="6a69fd0727b1f9f170b5b0ecadee0ad98cce269006bbce82152d8c349947208b" exitCode=0 Oct 30 20:22:59.502659 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.502568 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" event={"ID":"25da5733-edc7-4a62-bc21-dbe63273deed","Type":"ContainerDied","Data":"6a69fd0727b1f9f170b5b0ecadee0ad98cce269006bbce82152d8c349947208b"} Oct 30 20:22:59.502659 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.502618 5078 scope.go:122] "RemoveContainer" containerID="74f60db9863d5ea001fb375abd6651c4eee7f4bbb836337c6a22296384349cae" Oct 30 20:22:59.509463 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.509437 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" Oct 30 20:22:59.510251 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.509300 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2" event={"ID":"82a38bcc-0f98-4cf5-901f-e7bd47f9755b","Type":"ContainerDied","Data":"80686f41ad566621ffce142270f5d577967890f5353bc909a7d5ccb1671b034f"} Oct 30 20:22:59.511394 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.511373 5078 generic.go:356] "Generic (PLEG): container finished" podID="6de7d150-b3e9-44f2-9b6a-71e69df471a9" containerID="e2fe6d9f731b3f3e82666262385d84ceedd7c61cfe4093e3df0060b3bfdc5167" exitCode=0 Oct 30 20:22:59.511718 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.511695 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" event={"ID":"6de7d150-b3e9-44f2-9b6a-71e69df471a9","Type":"ContainerDied","Data":"e2fe6d9f731b3f3e82666262385d84ceedd7c61cfe4093e3df0060b3bfdc5167"} Oct 30 20:22:59.519196 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.519177 5078 scope.go:122] "RemoveContainer" containerID="33c34d533e597c3edd15d81b9a57fc921410261aaecea312cc8fb178d71a2ab9" Oct 30 20:22:59.542294 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.541809 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2"] Oct 30 20:22:59.544973 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.544948 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-75e734-openshift-default-6d7bc99d4c-dl7j2"] Oct 30 20:22:59.587791 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.587755 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="179c807f-ec84-47b4-ba09-51354cbcff6a" path="/var/lib/kubelet/pods/179c807f-ec84-47b4-ba09-51354cbcff6a/volumes" Oct 30 20:22:59.588514 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.588489 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="48a25fb9-3214-4c1c-95fe-d751ad4372e4" path="/var/lib/kubelet/pods/48a25fb9-3214-4c1c-95fe-d751ad4372e4/volumes" Oct 30 20:22:59.589494 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.589134 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="50d97c5f-9b0e-4851-b1b5-400c74b23352" path="/var/lib/kubelet/pods/50d97c5f-9b0e-4851-b1b5-400c74b23352/volumes" Oct 30 20:22:59.590430 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.590371 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="82a38bcc-0f98-4cf5-901f-e7bd47f9755b" path="/var/lib/kubelet/pods/82a38bcc-0f98-4cf5-901f-e7bd47f9755b/volumes" Oct 30 20:22:59.591010 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.590990 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bb6d3cde-8f40-4aa2-a446-ee6a410aba52" path="/var/lib/kubelet/pods/bb6d3cde-8f40-4aa2-a446-ee6a410aba52/volumes" Oct 30 20:22:59.614767 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.614744 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:22:59.690566 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.690542 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:22:59.701471 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.701442 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-credential-socket\") pod \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " Oct 30 20:22:59.701609 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.701583 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-workload-certs\") pod \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " Oct 30 20:22:59.701693 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.701677 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-workload-socket\") pod \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " Oct 30 20:22:59.701748 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.701699 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-credential-socket" pod "6de7d150-b3e9-44f2-9b6a-71e69df471a9" (UID: "6de7d150-b3e9-44f2-9b6a-71e69df471a9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:59.701748 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.701731 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-token\" (UniqueName: \"kubernetes.io/projected/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-token\") pod \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " Oct 30 20:22:59.701854 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.701771 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-envoy\") pod \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " Oct 30 20:22:59.701854 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.701799 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-data\") pod \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " Oct 30 20:22:59.701956 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.701887 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-workload-certs" pod "6de7d150-b3e9-44f2-9b6a-71e69df471a9" (UID: "6de7d150-b3e9-44f2-9b6a-71e69df471a9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:59.701956 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.701931 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-workload-socket" pod "6de7d150-b3e9-44f2-9b6a-71e69df471a9" (UID: "6de7d150-b3e9-44f2-9b6a-71e69df471a9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:59.702058 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.702004 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6de7d150-b3e9-44f2-9b6a-71e69df471a9-kube-api-access-8lj22\" (UniqueName: \"kubernetes.io/projected/6de7d150-b3e9-44f2-9b6a-71e69df471a9-kube-api-access-8lj22\") pod \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " Oct 30 20:22:59.702058 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.702022 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-data" pod "6de7d150-b3e9-44f2-9b6a-71e69df471a9" (UID: "6de7d150-b3e9-44f2-9b6a-71e69df471a9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:59.702229 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.702098 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-podinfo\") pod \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " Oct 30 20:22:59.702229 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.702158 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istiod-ca-cert\") pod \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\" (UID: \"6de7d150-b3e9-44f2-9b6a-71e69df471a9\") " Oct 30 20:22:59.702593 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.702554 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istiod-ca-cert" pod "6de7d150-b3e9-44f2-9b6a-71e69df471a9" (UID: "6de7d150-b3e9-44f2-9b6a-71e69df471a9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:22:59.702715 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.702681 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.702715 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.702696 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.702715 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.702705 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.702715 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.702713 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.703071 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.702722 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.704463 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.704439 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6de7d150-b3e9-44f2-9b6a-71e69df471a9-kube-api-access-8lj22" pod "6de7d150-b3e9-44f2-9b6a-71e69df471a9" (UID: "6de7d150-b3e9-44f2-9b6a-71e69df471a9"). InnerVolumeSpecName "kube-api-access-8lj22". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:59.704586 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.704556 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-token" pod "6de7d150-b3e9-44f2-9b6a-71e69df471a9" (UID: "6de7d150-b3e9-44f2-9b6a-71e69df471a9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:59.704696 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.704674 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-envoy" pod "6de7d150-b3e9-44f2-9b6a-71e69df471a9" (UID: "6de7d150-b3e9-44f2-9b6a-71e69df471a9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:59.704784 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.704746 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-podinfo" pod "6de7d150-b3e9-44f2-9b6a-71e69df471a9" (UID: "6de7d150-b3e9-44f2-9b6a-71e69df471a9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:22:59.724095 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.724071 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:22:59.803547 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.803515 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-data\") pod \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " Oct 30 20:22:59.803728 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.803568 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-credential-socket\") pod \"25da5733-edc7-4a62-bc21-dbe63273deed\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " Oct 30 20:22:59.803728 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.803602 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-workload-certs\") pod \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " Oct 30 20:22:59.803728 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.803631 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-podinfo\") pod \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " Oct 30 20:22:59.803728 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.803691 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istiod-ca-cert\") pod \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " Oct 30 20:22:59.803943 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.803742 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25da5733-edc7-4a62-bc21-dbe63273deed-istio-token\" (UniqueName: \"kubernetes.io/projected/25da5733-edc7-4a62-bc21-dbe63273deed-istio-token\") pod \"25da5733-edc7-4a62-bc21-dbe63273deed\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " Oct 30 20:22:59.803943 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.803782 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-token\" (UniqueName: \"kubernetes.io/projected/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-token\") pod \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " Oct 30 20:22:59.803943 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.803850 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25da5733-edc7-4a62-bc21-dbe63273deed-kube-api-access-fwbwt\" (UniqueName: \"kubernetes.io/projected/25da5733-edc7-4a62-bc21-dbe63273deed-kube-api-access-fwbwt\") pod \"25da5733-edc7-4a62-bc21-dbe63273deed\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " Oct 30 20:22:59.803943 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.803879 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-workload-certs" pod "f398ea35-32fa-425c-9e05-a3fd41ba99ba" (UID: "f398ea35-32fa-425c-9e05-a3fd41ba99ba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:59.803943 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.803877 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-credential-socket" pod "25da5733-edc7-4a62-bc21-dbe63273deed" (UID: "25da5733-edc7-4a62-bc21-dbe63273deed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:59.803943 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.803888 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-istio-data\") pod \"25da5733-edc7-4a62-bc21-dbe63273deed\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " Oct 30 20:22:59.804235 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.803957 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-credential-socket\") pod \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " Oct 30 20:22:59.804235 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.803995 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/25da5733-edc7-4a62-bc21-dbe63273deed-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25da5733-edc7-4a62-bc21-dbe63273deed-istio-podinfo\") pod \"25da5733-edc7-4a62-bc21-dbe63273deed\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " Oct 30 20:22:59.804235 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.804033 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-workload-socket\") pod \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " Oct 30 20:22:59.804235 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.804126 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-istio-data" pod "25da5733-edc7-4a62-bc21-dbe63273deed" (UID: "25da5733-edc7-4a62-bc21-dbe63273deed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:59.804235 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.804133 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f398ea35-32fa-425c-9e05-a3fd41ba99ba-kube-api-access-4s7dd\" (UniqueName: \"kubernetes.io/projected/f398ea35-32fa-425c-9e05-a3fd41ba99ba-kube-api-access-4s7dd\") pod \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " Oct 30 20:22:59.804235 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.804188 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istiod-ca-cert" pod "f398ea35-32fa-425c-9e05-a3fd41ba99ba" (UID: "f398ea35-32fa-425c-9e05-a3fd41ba99ba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:22:59.804541 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.804249 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-workload-socket\") pod \"25da5733-edc7-4a62-bc21-dbe63273deed\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " Oct 30 20:22:59.804541 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.804284 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-workload-certs\") pod \"25da5733-edc7-4a62-bc21-dbe63273deed\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " Oct 30 20:22:59.804541 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.804320 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/25da5733-edc7-4a62-bc21-dbe63273deed-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25da5733-edc7-4a62-bc21-dbe63273deed-istiod-ca-cert\") pod \"25da5733-edc7-4a62-bc21-dbe63273deed\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " Oct 30 20:22:59.804541 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.804402 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-istio-envoy\") pod \"25da5733-edc7-4a62-bc21-dbe63273deed\" (UID: \"25da5733-edc7-4a62-bc21-dbe63273deed\") " Oct 30 20:22:59.804541 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.804449 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-envoy\") pod \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\" (UID: \"f398ea35-32fa-425c-9e05-a3fd41ba99ba\") " Oct 30 20:22:59.804541 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.804475 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-data" pod "f398ea35-32fa-425c-9e05-a3fd41ba99ba" (UID: "f398ea35-32fa-425c-9e05-a3fd41ba99ba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:59.804804 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.804742 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-workload-socket" pod "f398ea35-32fa-425c-9e05-a3fd41ba99ba" (UID: "f398ea35-32fa-425c-9e05-a3fd41ba99ba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:59.804869 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.804841 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-workload-certs" pod "25da5733-edc7-4a62-bc21-dbe63273deed" (UID: "25da5733-edc7-4a62-bc21-dbe63273deed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:59.805085 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.805062 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-workload-socket" pod "25da5733-edc7-4a62-bc21-dbe63273deed" (UID: "25da5733-edc7-4a62-bc21-dbe63273deed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:59.805205 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.805118 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.805205 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.805139 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.805205 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.805155 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.805205 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.805168 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.805205 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.805190 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.805494 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.805199 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25da5733-edc7-4a62-bc21-dbe63273deed-istiod-ca-cert" pod "25da5733-edc7-4a62-bc21-dbe63273deed" (UID: "25da5733-edc7-4a62-bc21-dbe63273deed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:22:59.805494 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.805207 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.805494 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.805244 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lj22\" (UniqueName: \"kubernetes.io/projected/6de7d150-b3e9-44f2-9b6a-71e69df471a9-kube-api-access-8lj22\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.805494 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.805264 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.805494 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.805279 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.805494 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.805293 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6de7d150-b3e9-44f2-9b6a-71e69df471a9-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.805494 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.805306 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.805494 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.805375 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-credential-socket" pod "f398ea35-32fa-425c-9e05-a3fd41ba99ba" (UID: "f398ea35-32fa-425c-9e05-a3fd41ba99ba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:59.806449 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.806423 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-podinfo" pod "f398ea35-32fa-425c-9e05-a3fd41ba99ba" (UID: "f398ea35-32fa-425c-9e05-a3fd41ba99ba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:22:59.806814 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.806742 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f398ea35-32fa-425c-9e05-a3fd41ba99ba-kube-api-access-4s7dd" pod "f398ea35-32fa-425c-9e05-a3fd41ba99ba" (UID: "f398ea35-32fa-425c-9e05-a3fd41ba99ba"). InnerVolumeSpecName "kube-api-access-4s7dd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:59.806911 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.806870 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-token" pod "f398ea35-32fa-425c-9e05-a3fd41ba99ba" (UID: "f398ea35-32fa-425c-9e05-a3fd41ba99ba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:59.807590 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.807570 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-istio-envoy" pod "25da5733-edc7-4a62-bc21-dbe63273deed" (UID: "25da5733-edc7-4a62-bc21-dbe63273deed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:59.807698 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.807682 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25da5733-edc7-4a62-bc21-dbe63273deed-istio-token" pod "25da5733-edc7-4a62-bc21-dbe63273deed" (UID: "25da5733-edc7-4a62-bc21-dbe63273deed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:59.807982 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.807960 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25da5733-edc7-4a62-bc21-dbe63273deed-kube-api-access-fwbwt" pod "25da5733-edc7-4a62-bc21-dbe63273deed" (UID: "25da5733-edc7-4a62-bc21-dbe63273deed"). InnerVolumeSpecName "kube-api-access-fwbwt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:22:59.808321 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.808297 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/25da5733-edc7-4a62-bc21-dbe63273deed-istio-podinfo" pod "25da5733-edc7-4a62-bc21-dbe63273deed" (UID: "25da5733-edc7-4a62-bc21-dbe63273deed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:22:59.808413 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.808357 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-envoy" pod "f398ea35-32fa-425c-9e05-a3fd41ba99ba" (UID: "f398ea35-32fa-425c-9e05-a3fd41ba99ba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:22:59.906986 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.906906 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25da5733-edc7-4a62-bc21-dbe63273deed-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.906986 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.906936 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.906986 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.906948 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwbwt\" (UniqueName: \"kubernetes.io/projected/25da5733-edc7-4a62-bc21-dbe63273deed-kube-api-access-fwbwt\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.906986 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.906958 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.906986 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.906967 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25da5733-edc7-4a62-bc21-dbe63273deed-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.906986 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.906976 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4s7dd\" (UniqueName: \"kubernetes.io/projected/f398ea35-32fa-425c-9e05-a3fd41ba99ba-kube-api-access-4s7dd\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.906986 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.906985 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.906986 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.906993 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25da5733-edc7-4a62-bc21-dbe63273deed-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.907347 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.907001 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25da5733-edc7-4a62-bc21-dbe63273deed-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.907347 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.907011 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:22:59.907347 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:22:59.907020 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f398ea35-32fa-425c-9e05-a3fd41ba99ba-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:00.320402 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:23:00.320371 5078 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc623b5b_8385_4b36_82b7_4939ae2bf727.slice\": RecentStats: unable to find data in memory cache]" Oct 30 20:23:00.519849 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:00.519814 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" Oct 30 20:23:00.520286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:00.519847 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw" event={"ID":"f398ea35-32fa-425c-9e05-a3fd41ba99ba","Type":"ContainerDied","Data":"c8a7f4bb35e85804416c7e6274c13d284e4db048805f1e165b79dc5860a49759"} Oct 30 20:23:00.520286 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:00.519907 5078 scope.go:122] "RemoveContainer" containerID="a9dd23ca6f60b482f604ed1bace4c6e1cf2a5a577a0722c3970f8ea7c4a5e8d5" Oct 30 20:23:00.521657 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:00.521624 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" Oct 30 20:23:00.521776 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:00.521665 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l" event={"ID":"25da5733-edc7-4a62-bc21-dbe63273deed","Type":"ContainerDied","Data":"c1061d4c52fb81fe69e310f53e0c8ae768365efc7c6022d07e3d774cb57f8781"} Oct 30 20:23:00.524443 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:00.524407 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" event={"ID":"6de7d150-b3e9-44f2-9b6a-71e69df471a9","Type":"ContainerDied","Data":"ff833d485cc586887b9a63e0385ff6c422ffa774a8790953763a80de315bf96a"} Oct 30 20:23:00.524560 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:00.524441 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c" Oct 30 20:23:00.532864 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:00.532842 5078 scope.go:122] "RemoveContainer" containerID="6a69fd0727b1f9f170b5b0ecadee0ad98cce269006bbce82152d8c349947208b" Oct 30 20:23:00.542751 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:00.542732 5078 scope.go:122] "RemoveContainer" containerID="e2fe6d9f731b3f3e82666262385d84ceedd7c61cfe4093e3df0060b3bfdc5167" Oct 30 20:23:00.556065 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:00.556040 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw"] Oct 30 20:23:00.561233 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:00.561205 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-54pbw"] Oct 30 20:23:00.573879 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:00.573820 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c"] Oct 30 20:23:00.579078 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:00.579056 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-tx29c"] Oct 30 20:23:00.592009 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:00.591986 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l"] Oct 30 20:23:00.599316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:00.599295 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-9c901b-openshift-default-bc4d55965-9td2l"] Oct 30 20:23:01.585050 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:01.585017 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="25da5733-edc7-4a62-bc21-dbe63273deed" path="/var/lib/kubelet/pods/25da5733-edc7-4a62-bc21-dbe63273deed/volumes" Oct 30 20:23:01.585543 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:01.585528 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6de7d150-b3e9-44f2-9b6a-71e69df471a9" path="/var/lib/kubelet/pods/6de7d150-b3e9-44f2-9b6a-71e69df471a9/volumes" Oct 30 20:23:01.585940 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:01.585928 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" path="/var/lib/kubelet/pods/f398ea35-32fa-425c-9e05-a3fd41ba99ba/volumes" Oct 30 20:23:02.532769 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:23:02.532726 5078 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc623b5b_8385_4b36_82b7_4939ae2bf727.slice\": RecentStats: unable to find data in memory cache]" Oct 30 20:23:07.575513 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:07.575477 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg"] Oct 30 20:23:07.575990 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:07.575742 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" podUID="62edb9f6-a9af-4488-849b-6c9115b79513" containerName="istio-proxy" containerID="cri-o://463c571146c70350a65727f408bfccd4a054320e67e042e0e6042e1c3592fca5" gracePeriod=30 Oct 30 20:23:07.578166 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:07.578139 5078 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" secret="" err="secret \"e2e-worker-w2-909519-openshift-default-dockercfg-r5l5q\" not found" Oct 30 20:23:07.593748 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:07.593714 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74"] Oct 30 20:23:07.597423 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:07.597385 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" podUID="9cd57b86-49b2-4877-957a-cb8e27992937" containerName="istio-proxy" containerID="cri-o://9ab65249dfff427ddb60be74cb14ce1e972bd876367cb99f97529f963ff74f43" gracePeriod=30 Oct 30 20:23:07.598981 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:07.598948 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98"] Oct 30 20:23:07.601573 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:07.601548 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6"] Oct 30 20:23:07.601744 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:07.601724 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" podUID="e9729fb9-30d8-45ce-ad35-9e881630030a" containerName="istio-proxy" containerID="cri-o://815e9e387d5c0cda89b05d9986b3468c1b5183091005943e6cd29f19cd0959b9" gracePeriod=30 Oct 30 20:23:07.611083 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:07.611048 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" podUID="8debf693-923a-42c5-9811-1ccfd37cca82" containerName="istio-proxy" containerID="cri-o://b6b0a3aa14670fdcdfefceea3f2767ae599534728cdbd0ad6b2a9325e1e7e897" gracePeriod=30 Oct 30 20:23:08.776460 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:08.776418 5078 patch_prober.go:29] interesting pod/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 20:23:08.776840 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:08.776494 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" podUID="8debf693-923a-42c5-9811-1ccfd37cca82" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 20:23:10.388088 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:23:10.388054 5078 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc623b5b_8385_4b36_82b7_4939ae2bf727.slice\": RecentStats: unable to find data in memory cache]" Oct 30 20:23:12.941138 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:12.940789 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:23:13.019307 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.017131 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-workload-socket\") pod \"9cd57b86-49b2-4877-957a-cb8e27992937\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " Oct 30 20:23:13.019307 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.017232 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-workload-certs\") pod \"9cd57b86-49b2-4877-957a-cb8e27992937\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " Oct 30 20:23:13.019307 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.017280 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-istio-envoy\") pod \"9cd57b86-49b2-4877-957a-cb8e27992937\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " Oct 30 20:23:13.019307 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.017314 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-istio-data\") pod \"9cd57b86-49b2-4877-957a-cb8e27992937\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " Oct 30 20:23:13.019307 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.017428 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9cd57b86-49b2-4877-957a-cb8e27992937-kube-api-access-ghwkb\" (UniqueName: \"kubernetes.io/projected/9cd57b86-49b2-4877-957a-cb8e27992937-kube-api-access-ghwkb\") pod \"9cd57b86-49b2-4877-957a-cb8e27992937\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " Oct 30 20:23:13.019307 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.017461 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9cd57b86-49b2-4877-957a-cb8e27992937-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cd57b86-49b2-4877-957a-cb8e27992937-istio-podinfo\") pod \"9cd57b86-49b2-4877-957a-cb8e27992937\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " Oct 30 20:23:13.019307 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.017495 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9cd57b86-49b2-4877-957a-cb8e27992937-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cd57b86-49b2-4877-957a-cb8e27992937-istiod-ca-cert\") pod \"9cd57b86-49b2-4877-957a-cb8e27992937\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " Oct 30 20:23:13.019307 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.017547 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9cd57b86-49b2-4877-957a-cb8e27992937-istio-token\" (UniqueName: \"kubernetes.io/projected/9cd57b86-49b2-4877-957a-cb8e27992937-istio-token\") pod \"9cd57b86-49b2-4877-957a-cb8e27992937\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " Oct 30 20:23:13.019307 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.017616 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-credential-socket\") pod \"9cd57b86-49b2-4877-957a-cb8e27992937\" (UID: \"9cd57b86-49b2-4877-957a-cb8e27992937\") " Oct 30 20:23:13.036139 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.027915 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-istio-data" pod "9cd57b86-49b2-4877-957a-cb8e27992937" (UID: "9cd57b86-49b2-4877-957a-cb8e27992937"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:13.036139 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.028200 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-workload-socket" pod "9cd57b86-49b2-4877-957a-cb8e27992937" (UID: "9cd57b86-49b2-4877-957a-cb8e27992937"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:13.036139 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.028809 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-workload-certs" pod "9cd57b86-49b2-4877-957a-cb8e27992937" (UID: "9cd57b86-49b2-4877-957a-cb8e27992937"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:13.037657 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.037611 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cd57b86-49b2-4877-957a-cb8e27992937-istiod-ca-cert" pod "9cd57b86-49b2-4877-957a-cb8e27992937" (UID: "9cd57b86-49b2-4877-957a-cb8e27992937"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:23:13.044638 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.044249 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-credential-socket" pod "9cd57b86-49b2-4877-957a-cb8e27992937" (UID: "9cd57b86-49b2-4877-957a-cb8e27992937"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:13.044815 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.044770 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-istio-envoy" pod "9cd57b86-49b2-4877-957a-cb8e27992937" (UID: "9cd57b86-49b2-4877-957a-cb8e27992937"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:13.045155 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.045083 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cd57b86-49b2-4877-957a-cb8e27992937-istio-token" pod "9cd57b86-49b2-4877-957a-cb8e27992937" (UID: "9cd57b86-49b2-4877-957a-cb8e27992937"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:23:13.052854 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.052816 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9cd57b86-49b2-4877-957a-cb8e27992937-istio-podinfo" pod "9cd57b86-49b2-4877-957a-cb8e27992937" (UID: "9cd57b86-49b2-4877-957a-cb8e27992937"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:23:13.054183 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.054158 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:23:13.055215 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.055184 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cd57b86-49b2-4877-957a-cb8e27992937-kube-api-access-ghwkb" pod "9cd57b86-49b2-4877-957a-cb8e27992937" (UID: "9cd57b86-49b2-4877-957a-cb8e27992937"). InnerVolumeSpecName "kube-api-access-ghwkb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:23:13.058563 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.058542 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:23:13.062604 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.062583 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:23:13.119213 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119125 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-credential-socket\") pod \"8debf693-923a-42c5-9811-1ccfd37cca82\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " Oct 30 20:23:13.119213 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119184 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-credential-socket\") pod \"e9729fb9-30d8-45ce-ad35-9e881630030a\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " Oct 30 20:23:13.119483 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119227 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8debf693-923a-42c5-9811-1ccfd37cca82-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8debf693-923a-42c5-9811-1ccfd37cca82-istio-podinfo\") pod \"8debf693-923a-42c5-9811-1ccfd37cca82\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " Oct 30 20:23:13.119483 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119257 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8debf693-923a-42c5-9811-1ccfd37cca82-kube-api-access-vn5sh\" (UniqueName: \"kubernetes.io/projected/8debf693-923a-42c5-9811-1ccfd37cca82-kube-api-access-vn5sh\") pod \"8debf693-923a-42c5-9811-1ccfd37cca82\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " Oct 30 20:23:13.119483 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119294 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-credential-socket\") pod \"62edb9f6-a9af-4488-849b-6c9115b79513\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " Oct 30 20:23:13.119483 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119373 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-istio-data\") pod \"62edb9f6-a9af-4488-849b-6c9115b79513\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " Oct 30 20:23:13.119483 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119400 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8debf693-923a-42c5-9811-1ccfd37cca82-istio-token\" (UniqueName: \"kubernetes.io/projected/8debf693-923a-42c5-9811-1ccfd37cca82-istio-token\") pod \"8debf693-923a-42c5-9811-1ccfd37cca82\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " Oct 30 20:23:13.119483 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119417 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-credential-socket" pod "8debf693-923a-42c5-9811-1ccfd37cca82" (UID: "8debf693-923a-42c5-9811-1ccfd37cca82"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:13.119483 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119439 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-workload-certs\") pod \"e9729fb9-30d8-45ce-ad35-9e881630030a\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " Oct 30 20:23:13.119868 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119668 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-istio-envoy\") pod \"8debf693-923a-42c5-9811-1ccfd37cca82\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " Oct 30 20:23:13.119868 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119683 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-credential-socket" pod "e9729fb9-30d8-45ce-ad35-9e881630030a" (UID: "e9729fb9-30d8-45ce-ad35-9e881630030a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:13.119868 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119713 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8debf693-923a-42c5-9811-1ccfd37cca82-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8debf693-923a-42c5-9811-1ccfd37cca82-istiod-ca-cert\") pod \"8debf693-923a-42c5-9811-1ccfd37cca82\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " Oct 30 20:23:13.119868 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119724 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-workload-certs" pod "e9729fb9-30d8-45ce-ad35-9e881630030a" (UID: "e9729fb9-30d8-45ce-ad35-9e881630030a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:13.119868 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119758 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-workload-certs\") pod \"62edb9f6-a9af-4488-849b-6c9115b79513\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " Oct 30 20:23:13.119868 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119765 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-istio-data" pod "62edb9f6-a9af-4488-849b-6c9115b79513" (UID: "62edb9f6-a9af-4488-849b-6c9115b79513"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:13.119868 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119791 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-data\") pod \"e9729fb9-30d8-45ce-ad35-9e881630030a\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " Oct 30 20:23:13.119868 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119829 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/62edb9f6-a9af-4488-849b-6c9115b79513-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62edb9f6-a9af-4488-849b-6c9115b79513-istiod-ca-cert\") pod \"62edb9f6-a9af-4488-849b-6c9115b79513\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " Oct 30 20:23:13.119868 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119857 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-workload-certs\") pod \"8debf693-923a-42c5-9811-1ccfd37cca82\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " Oct 30 20:23:13.120319 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119886 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-envoy\") pod \"e9729fb9-30d8-45ce-ad35-9e881630030a\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " Oct 30 20:23:13.120319 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119920 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/62edb9f6-a9af-4488-849b-6c9115b79513-kube-api-access-jmnzl\" (UniqueName: \"kubernetes.io/projected/62edb9f6-a9af-4488-849b-6c9115b79513-kube-api-access-jmnzl\") pod \"62edb9f6-a9af-4488-849b-6c9115b79513\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " Oct 30 20:23:13.120319 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119952 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-workload-socket\") pod \"e9729fb9-30d8-45ce-ad35-9e881630030a\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " Oct 30 20:23:13.120319 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.119981 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-istio-data\") pod \"8debf693-923a-42c5-9811-1ccfd37cca82\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " Oct 30 20:23:13.120319 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.120044 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-workload-socket\") pod \"62edb9f6-a9af-4488-849b-6c9115b79513\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " Oct 30 20:23:13.120319 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.120058 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-workload-certs" pod "62edb9f6-a9af-4488-849b-6c9115b79513" (UID: "62edb9f6-a9af-4488-849b-6c9115b79513"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:13.120319 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.120068 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8debf693-923a-42c5-9811-1ccfd37cca82-istiod-ca-cert" pod "8debf693-923a-42c5-9811-1ccfd37cca82" (UID: "8debf693-923a-42c5-9811-1ccfd37cca82"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:23:13.120319 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.120094 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-istio-envoy\") pod \"62edb9f6-a9af-4488-849b-6c9115b79513\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " Oct 30 20:23:13.120319 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.120131 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e9729fb9-30d8-45ce-ad35-9e881630030a-kube-api-access-fx5ls\" (UniqueName: \"kubernetes.io/projected/e9729fb9-30d8-45ce-ad35-9e881630030a-kube-api-access-fx5ls\") pod \"e9729fb9-30d8-45ce-ad35-9e881630030a\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " Oct 30 20:23:13.120319 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.120176 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/62edb9f6-a9af-4488-849b-6c9115b79513-istio-token\" (UniqueName: \"kubernetes.io/projected/62edb9f6-a9af-4488-849b-6c9115b79513-istio-token\") pod \"62edb9f6-a9af-4488-849b-6c9115b79513\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " Oct 30 20:23:13.120319 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.120211 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-podinfo\") pod \"e9729fb9-30d8-45ce-ad35-9e881630030a\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " Oct 30 20:23:13.120319 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.120242 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/62edb9f6-a9af-4488-849b-6c9115b79513-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62edb9f6-a9af-4488-849b-6c9115b79513-istio-podinfo\") pod \"62edb9f6-a9af-4488-849b-6c9115b79513\" (UID: \"62edb9f6-a9af-4488-849b-6c9115b79513\") " Oct 30 20:23:13.120319 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.120282 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-workload-socket" pod "e9729fb9-30d8-45ce-ad35-9e881630030a" (UID: "e9729fb9-30d8-45ce-ad35-9e881630030a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:13.121307 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.120438 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-token\" (UniqueName: \"kubernetes.io/projected/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-token\") pod \"e9729fb9-30d8-45ce-ad35-9e881630030a\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " Oct 30 20:23:13.121307 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.120472 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-workload-socket\") pod \"8debf693-923a-42c5-9811-1ccfd37cca82\" (UID: \"8debf693-923a-42c5-9811-1ccfd37cca82\") " Oct 30 20:23:13.121307 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.120501 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e9729fb9-30d8-45ce-ad35-9e881630030a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9729fb9-30d8-45ce-ad35-9e881630030a-istiod-ca-cert\") pod \"e9729fb9-30d8-45ce-ad35-9e881630030a\" (UID: \"e9729fb9-30d8-45ce-ad35-9e881630030a\") " Oct 30 20:23:13.121307 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.120868 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-credential-socket" pod "62edb9f6-a9af-4488-849b-6c9115b79513" (UID: "62edb9f6-a9af-4488-849b-6c9115b79513"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:13.121307 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.121284 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62edb9f6-a9af-4488-849b-6c9115b79513-istiod-ca-cert" pod "62edb9f6-a9af-4488-849b-6c9115b79513" (UID: "62edb9f6-a9af-4488-849b-6c9115b79513"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:23:13.121600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.121564 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-data" pod "e9729fb9-30d8-45ce-ad35-9e881630030a" (UID: "e9729fb9-30d8-45ce-ad35-9e881630030a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:13.121823 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.121794 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-workload-certs" pod "8debf693-923a-42c5-9811-1ccfd37cca82" (UID: "8debf693-923a-42c5-9811-1ccfd37cca82"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:13.122875 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.122833 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-workload-socket" pod "62edb9f6-a9af-4488-849b-6c9115b79513" (UID: "62edb9f6-a9af-4488-849b-6c9115b79513"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:13.123116 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.123091 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-istio-data" pod "8debf693-923a-42c5-9811-1ccfd37cca82" (UID: "8debf693-923a-42c5-9811-1ccfd37cca82"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:13.123205 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.123115 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62edb9f6-a9af-4488-849b-6c9115b79513-kube-api-access-jmnzl" pod "62edb9f6-a9af-4488-849b-6c9115b79513" (UID: "62edb9f6-a9af-4488-849b-6c9115b79513"). InnerVolumeSpecName "kube-api-access-jmnzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:23:13.123389 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.123366 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-workload-socket" pod "8debf693-923a-42c5-9811-1ccfd37cca82" (UID: "8debf693-923a-42c5-9811-1ccfd37cca82"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:13.123475 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.123435 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8debf693-923a-42c5-9811-1ccfd37cca82-istio-podinfo" pod "8debf693-923a-42c5-9811-1ccfd37cca82" (UID: "8debf693-923a-42c5-9811-1ccfd37cca82"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.123705 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9729fb9-30d8-45ce-ad35-9e881630030a-istiod-ca-cert" pod "e9729fb9-30d8-45ce-ad35-9e881630030a" (UID: "e9729fb9-30d8-45ce-ad35-9e881630030a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.123751 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-istio-envoy" pod "8debf693-923a-42c5-9811-1ccfd37cca82" (UID: "8debf693-923a-42c5-9811-1ccfd37cca82"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124041 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124058 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124064 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8debf693-923a-42c5-9811-1ccfd37cca82-istio-token" pod "8debf693-923a-42c5-9811-1ccfd37cca82" (UID: "8debf693-923a-42c5-9811-1ccfd37cca82"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124073 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9729fb9-30d8-45ce-ad35-9e881630030a-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124087 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124102 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124116 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124133 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8debf693-923a-42c5-9811-1ccfd37cca82-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124147 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124163 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124176 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124190 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124204 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124219 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8debf693-923a-42c5-9811-1ccfd37cca82-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124233 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124250 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124265 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124282 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62edb9f6-a9af-4488-849b-6c9115b79513-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124296 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124310 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cd57b86-49b2-4877-957a-cb8e27992937-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124342 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmnzl\" (UniqueName: \"kubernetes.io/projected/62edb9f6-a9af-4488-849b-6c9115b79513-kube-api-access-jmnzl\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124359 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124372 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8debf693-923a-42c5-9811-1ccfd37cca82-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124382 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124395 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghwkb\" (UniqueName: \"kubernetes.io/projected/9cd57b86-49b2-4877-957a-cb8e27992937-kube-api-access-ghwkb\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124410 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cd57b86-49b2-4877-957a-cb8e27992937-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124425 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cd57b86-49b2-4877-957a-cb8e27992937-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124434 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cd57b86-49b2-4877-957a-cb8e27992937-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.124493 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124434 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62edb9f6-a9af-4488-849b-6c9115b79513-istio-token" pod "62edb9f6-a9af-4488-849b-6c9115b79513" (UID: "62edb9f6-a9af-4488-849b-6c9115b79513"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:23:13.125948 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.124520 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-podinfo" pod "e9729fb9-30d8-45ce-ad35-9e881630030a" (UID: "e9729fb9-30d8-45ce-ad35-9e881630030a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:23:13.125948 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.125093 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-istio-envoy" pod "62edb9f6-a9af-4488-849b-6c9115b79513" (UID: "62edb9f6-a9af-4488-849b-6c9115b79513"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:13.125948 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.125756 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9729fb9-30d8-45ce-ad35-9e881630030a-kube-api-access-fx5ls" pod "e9729fb9-30d8-45ce-ad35-9e881630030a" (UID: "e9729fb9-30d8-45ce-ad35-9e881630030a"). InnerVolumeSpecName "kube-api-access-fx5ls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:23:13.125948 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.125788 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/62edb9f6-a9af-4488-849b-6c9115b79513-istio-podinfo" pod "62edb9f6-a9af-4488-849b-6c9115b79513" (UID: "62edb9f6-a9af-4488-849b-6c9115b79513"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:23:13.126194 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.126170 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8debf693-923a-42c5-9811-1ccfd37cca82-kube-api-access-vn5sh" pod "8debf693-923a-42c5-9811-1ccfd37cca82" (UID: "8debf693-923a-42c5-9811-1ccfd37cca82"). InnerVolumeSpecName "kube-api-access-vn5sh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:23:13.126845 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.126819 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-token" pod "e9729fb9-30d8-45ce-ad35-9e881630030a" (UID: "e9729fb9-30d8-45ce-ad35-9e881630030a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:23:13.127453 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.127429 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-envoy" pod "e9729fb9-30d8-45ce-ad35-9e881630030a" (UID: "e9729fb9-30d8-45ce-ad35-9e881630030a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:13.225064 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.225031 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.225064 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.225060 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vn5sh\" (UniqueName: \"kubernetes.io/projected/8debf693-923a-42c5-9811-1ccfd37cca82-kube-api-access-vn5sh\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.225064 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.225072 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8debf693-923a-42c5-9811-1ccfd37cca82-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.225304 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.225080 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.225304 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.225088 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62edb9f6-a9af-4488-849b-6c9115b79513-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.225304 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.225097 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fx5ls\" (UniqueName: \"kubernetes.io/projected/e9729fb9-30d8-45ce-ad35-9e881630030a-kube-api-access-fx5ls\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.225304 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.225106 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62edb9f6-a9af-4488-849b-6c9115b79513-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.225304 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.225115 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9729fb9-30d8-45ce-ad35-9e881630030a-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.225304 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.225124 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62edb9f6-a9af-4488-849b-6c9115b79513-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:13.655465 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.655430 5078 generic.go:356] "Generic (PLEG): container finished" podID="e9729fb9-30d8-45ce-ad35-9e881630030a" containerID="815e9e387d5c0cda89b05d9986b3468c1b5183091005943e6cd29f19cd0959b9" exitCode=0 Oct 30 20:23:13.655604 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.655492 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" Oct 30 20:23:13.655604 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.655507 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" event={"ID":"e9729fb9-30d8-45ce-ad35-9e881630030a","Type":"ContainerDied","Data":"815e9e387d5c0cda89b05d9986b3468c1b5183091005943e6cd29f19cd0959b9"} Oct 30 20:23:13.655604 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.655558 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6" event={"ID":"e9729fb9-30d8-45ce-ad35-9e881630030a","Type":"ContainerDied","Data":"f4438a541d052deb82e01be0d9f1c16e4c95b83f874b816b2d3ec86424707c1a"} Oct 30 20:23:13.655604 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.655583 5078 scope.go:122] "RemoveContainer" containerID="815e9e387d5c0cda89b05d9986b3468c1b5183091005943e6cd29f19cd0959b9" Oct 30 20:23:13.657241 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.657214 5078 generic.go:356] "Generic (PLEG): container finished" podID="9cd57b86-49b2-4877-957a-cb8e27992937" containerID="9ab65249dfff427ddb60be74cb14ce1e972bd876367cb99f97529f963ff74f43" exitCode=0 Oct 30 20:23:13.657386 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.657258 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" Oct 30 20:23:13.657386 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.657302 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" event={"ID":"9cd57b86-49b2-4877-957a-cb8e27992937","Type":"ContainerDied","Data":"9ab65249dfff427ddb60be74cb14ce1e972bd876367cb99f97529f963ff74f43"} Oct 30 20:23:13.657522 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.657448 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74" event={"ID":"9cd57b86-49b2-4877-957a-cb8e27992937","Type":"ContainerDied","Data":"deaf3d47690c4dc02975c54329f81d79763770e2a9ca0c73f76ff0ad0e524b73"} Oct 30 20:23:13.659065 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.659041 5078 generic.go:356] "Generic (PLEG): container finished" podID="62edb9f6-a9af-4488-849b-6c9115b79513" containerID="463c571146c70350a65727f408bfccd4a054320e67e042e0e6042e1c3592fca5" exitCode=0 Oct 30 20:23:13.659190 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.659080 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" Oct 30 20:23:13.659190 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.659130 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" event={"ID":"62edb9f6-a9af-4488-849b-6c9115b79513","Type":"ContainerDied","Data":"463c571146c70350a65727f408bfccd4a054320e67e042e0e6042e1c3592fca5"} Oct 30 20:23:13.659315 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.659189 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg" event={"ID":"62edb9f6-a9af-4488-849b-6c9115b79513","Type":"ContainerDied","Data":"23a35a6db17d6129595db3c38658870751c7ec6944d0b2b640acce508ae3cd3a"} Oct 30 20:23:13.661039 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.661021 5078 generic.go:356] "Generic (PLEG): container finished" podID="8debf693-923a-42c5-9811-1ccfd37cca82" containerID="b6b0a3aa14670fdcdfefceea3f2767ae599534728cdbd0ad6b2a9325e1e7e897" exitCode=0 Oct 30 20:23:13.661145 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.661065 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" Oct 30 20:23:13.661145 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.661100 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" event={"ID":"8debf693-923a-42c5-9811-1ccfd37cca82","Type":"ContainerDied","Data":"b6b0a3aa14670fdcdfefceea3f2767ae599534728cdbd0ad6b2a9325e1e7e897"} Oct 30 20:23:13.661145 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.661129 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98" event={"ID":"8debf693-923a-42c5-9811-1ccfd37cca82","Type":"ContainerDied","Data":"d2d2f7d86444725324af9e90de3a48b8b65f4e954ad4b5b9a53daa9f84a1e17c"} Oct 30 20:23:13.667448 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.667431 5078 scope.go:122] "RemoveContainer" containerID="815e9e387d5c0cda89b05d9986b3468c1b5183091005943e6cd29f19cd0959b9" Oct 30 20:23:13.667735 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:23:13.667715 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"815e9e387d5c0cda89b05d9986b3468c1b5183091005943e6cd29f19cd0959b9\": container with ID starting with 815e9e387d5c0cda89b05d9986b3468c1b5183091005943e6cd29f19cd0959b9 not found: ID does not exist" containerID="815e9e387d5c0cda89b05d9986b3468c1b5183091005943e6cd29f19cd0959b9" Oct 30 20:23:13.667813 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.667741 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"815e9e387d5c0cda89b05d9986b3468c1b5183091005943e6cd29f19cd0959b9"} err="failed to get container status \"815e9e387d5c0cda89b05d9986b3468c1b5183091005943e6cd29f19cd0959b9\": rpc error: code = NotFound desc = could not find container \"815e9e387d5c0cda89b05d9986b3468c1b5183091005943e6cd29f19cd0959b9\": container with ID starting with 815e9e387d5c0cda89b05d9986b3468c1b5183091005943e6cd29f19cd0959b9 not found: ID does not exist" Oct 30 20:23:13.667813 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.667757 5078 scope.go:122] "RemoveContainer" containerID="9ab65249dfff427ddb60be74cb14ce1e972bd876367cb99f97529f963ff74f43" Oct 30 20:23:13.677182 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.677151 5078 scope.go:122] "RemoveContainer" containerID="9ab65249dfff427ddb60be74cb14ce1e972bd876367cb99f97529f963ff74f43" Oct 30 20:23:13.677494 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:23:13.677474 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ab65249dfff427ddb60be74cb14ce1e972bd876367cb99f97529f963ff74f43\": container with ID starting with 9ab65249dfff427ddb60be74cb14ce1e972bd876367cb99f97529f963ff74f43 not found: ID does not exist" containerID="9ab65249dfff427ddb60be74cb14ce1e972bd876367cb99f97529f963ff74f43" Oct 30 20:23:13.677572 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.677501 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ab65249dfff427ddb60be74cb14ce1e972bd876367cb99f97529f963ff74f43"} err="failed to get container status \"9ab65249dfff427ddb60be74cb14ce1e972bd876367cb99f97529f963ff74f43\": rpc error: code = NotFound desc = could not find container \"9ab65249dfff427ddb60be74cb14ce1e972bd876367cb99f97529f963ff74f43\": container with ID starting with 9ab65249dfff427ddb60be74cb14ce1e972bd876367cb99f97529f963ff74f43 not found: ID does not exist" Oct 30 20:23:13.677572 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.677518 5078 scope.go:122] "RemoveContainer" containerID="463c571146c70350a65727f408bfccd4a054320e67e042e0e6042e1c3592fca5" Oct 30 20:23:13.684833 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.684810 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6"] Oct 30 20:23:13.687110 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.687057 5078 scope.go:122] "RemoveContainer" containerID="463c571146c70350a65727f408bfccd4a054320e67e042e0e6042e1c3592fca5" Oct 30 20:23:13.688469 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:23:13.687502 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"463c571146c70350a65727f408bfccd4a054320e67e042e0e6042e1c3592fca5\": container with ID starting with 463c571146c70350a65727f408bfccd4a054320e67e042e0e6042e1c3592fca5 not found: ID does not exist" containerID="463c571146c70350a65727f408bfccd4a054320e67e042e0e6042e1c3592fca5" Oct 30 20:23:13.688469 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.687538 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"463c571146c70350a65727f408bfccd4a054320e67e042e0e6042e1c3592fca5"} err="failed to get container status \"463c571146c70350a65727f408bfccd4a054320e67e042e0e6042e1c3592fca5\": rpc error: code = NotFound desc = could not find container \"463c571146c70350a65727f408bfccd4a054320e67e042e0e6042e1c3592fca5\": container with ID starting with 463c571146c70350a65727f408bfccd4a054320e67e042e0e6042e1c3592fca5 not found: ID does not exist" Oct 30 20:23:13.688469 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.687567 5078 scope.go:122] "RemoveContainer" containerID="b6b0a3aa14670fdcdfefceea3f2767ae599534728cdbd0ad6b2a9325e1e7e897" Oct 30 20:23:13.690351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.690312 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-t65d6"] Oct 30 20:23:13.696708 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.696689 5078 scope.go:122] "RemoveContainer" containerID="b6b0a3aa14670fdcdfefceea3f2767ae599534728cdbd0ad6b2a9325e1e7e897" Oct 30 20:23:13.696998 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:23:13.696979 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6b0a3aa14670fdcdfefceea3f2767ae599534728cdbd0ad6b2a9325e1e7e897\": container with ID starting with b6b0a3aa14670fdcdfefceea3f2767ae599534728cdbd0ad6b2a9325e1e7e897 not found: ID does not exist" containerID="b6b0a3aa14670fdcdfefceea3f2767ae599534728cdbd0ad6b2a9325e1e7e897" Oct 30 20:23:13.697050 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.697005 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6b0a3aa14670fdcdfefceea3f2767ae599534728cdbd0ad6b2a9325e1e7e897"} err="failed to get container status \"b6b0a3aa14670fdcdfefceea3f2767ae599534728cdbd0ad6b2a9325e1e7e897\": rpc error: code = NotFound desc = could not find container \"b6b0a3aa14670fdcdfefceea3f2767ae599534728cdbd0ad6b2a9325e1e7e897\": container with ID starting with b6b0a3aa14670fdcdfefceea3f2767ae599534728cdbd0ad6b2a9325e1e7e897 not found: ID does not exist" Oct 30 20:23:13.703414 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.703392 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74"] Oct 30 20:23:13.709723 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.709702 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-sdh74"] Oct 30 20:23:13.722869 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.722847 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98"] Oct 30 20:23:13.730163 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.730140 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-7zc98"] Oct 30 20:23:13.743674 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.743651 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg"] Oct 30 20:23:13.748030 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:13.748012 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-909519-openshift-default-665577cd95-scbzg"] Oct 30 20:23:15.585193 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.585153 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="62edb9f6-a9af-4488-849b-6c9115b79513" path="/var/lib/kubelet/pods/62edb9f6-a9af-4488-849b-6c9115b79513/volumes" Oct 30 20:23:15.585741 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.585723 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8debf693-923a-42c5-9811-1ccfd37cca82" path="/var/lib/kubelet/pods/8debf693-923a-42c5-9811-1ccfd37cca82/volumes" Oct 30 20:23:15.586164 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.586151 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9cd57b86-49b2-4877-957a-cb8e27992937" path="/var/lib/kubelet/pods/9cd57b86-49b2-4877-957a-cb8e27992937/volumes" Oct 30 20:23:15.586941 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.586925 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e9729fb9-30d8-45ce-ad35-9e881630030a" path="/var/lib/kubelet/pods/e9729fb9-30d8-45ce-ad35-9e881630030a/volumes" Oct 30 20:23:15.825588 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.825545 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659"] Oct 30 20:23:15.826484 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826457 5078 cpu_manager.go:414] "containerMap: removing container" podUID="9f0b2906-f246-4b28-b48a-f50456e27840" containerName="payload-pre-processing" Oct 30 20:23:15.826484 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826483 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9f0b2906-f246-4b28-b48a-f50456e27840" containerName="payload-pre-processing" Oct 30 20:23:15.826697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826503 5078 cpu_manager.go:414] "containerMap: removing container" podUID="1e445c74-350f-49be-b2fa-40f6ff72c2d5" containerName="maas-api" Oct 30 20:23:15.826697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826513 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1e445c74-350f-49be-b2fa-40f6ff72c2d5" containerName="maas-api" Oct 30 20:23:15.826697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826524 5078 cpu_manager.go:414] "containerMap: removing container" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" Oct 30 20:23:15.826697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826531 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" Oct 30 20:23:15.826697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826545 5078 cpu_manager.go:414] "containerMap: removing container" podUID="6b463b25-8a3d-4b36-9925-5358b34f0c4c" containerName="istio-proxy" Oct 30 20:23:15.826697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826552 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6b463b25-8a3d-4b36-9925-5358b34f0c4c" containerName="istio-proxy" Oct 30 20:23:15.826697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826569 5078 cpu_manager.go:414] "containerMap: removing container" podUID="ca42f8ad-24a9-4bec-9fcf-48582787f1c9" containerName="istio-proxy" Oct 30 20:23:15.826697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826577 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca42f8ad-24a9-4bec-9fcf-48582787f1c9" containerName="istio-proxy" Oct 30 20:23:15.826697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826594 5078 cpu_manager.go:414] "containerMap: removing container" podUID="cc623b5b-8385-4b36-82b7-4939ae2bf727" containerName="payload-processing" Oct 30 20:23:15.826697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826602 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc623b5b-8385-4b36-82b7-4939ae2bf727" containerName="payload-processing" Oct 30 20:23:15.826697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826616 5078 cpu_manager.go:414] "containerMap: removing container" podUID="ae1473f0-1f82-4e44-9a44-a76562d7a880" containerName="istio-proxy" Oct 30 20:23:15.826697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826624 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae1473f0-1f82-4e44-9a44-a76562d7a880" containerName="istio-proxy" Oct 30 20:23:15.826697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826635 5078 cpu_manager.go:414] "containerMap: removing container" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" Oct 30 20:23:15.826697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826642 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" Oct 30 20:23:15.826697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826654 5078 cpu_manager.go:414] "containerMap: removing container" podUID="9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" containerName="istio-proxy" Oct 30 20:23:15.826697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826662 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" containerName="istio-proxy" Oct 30 20:23:15.826697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826674 5078 cpu_manager.go:414] "containerMap: removing container" podUID="82a38bcc-0f98-4cf5-901f-e7bd47f9755b" containerName="istio-proxy" Oct 30 20:23:15.826697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826681 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="82a38bcc-0f98-4cf5-901f-e7bd47f9755b" containerName="istio-proxy" Oct 30 20:23:15.826697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826696 5078 cpu_manager.go:414] "containerMap: removing container" podUID="ca42f8ad-24a9-4bec-9fcf-48582787f1c9" containerName="istio-proxy" Oct 30 20:23:15.826697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826704 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca42f8ad-24a9-4bec-9fcf-48582787f1c9" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826715 5078 cpu_manager.go:414] "containerMap: removing container" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826722 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826737 5078 cpu_manager.go:414] "containerMap: removing container" podUID="6de7d150-b3e9-44f2-9b6a-71e69df471a9" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826745 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6de7d150-b3e9-44f2-9b6a-71e69df471a9" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826760 5078 cpu_manager.go:414] "containerMap: removing container" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826767 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826778 5078 cpu_manager.go:414] "containerMap: removing container" podUID="f8cf8036-fa67-45ef-a16f-fa7041a61305" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826785 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f8cf8036-fa67-45ef-a16f-fa7041a61305" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826801 5078 cpu_manager.go:414] "containerMap: removing container" podUID="2bc6c031-5ab7-4ff5-8c4a-13286258090f" containerName="maas-api" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826808 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2bc6c031-5ab7-4ff5-8c4a-13286258090f" containerName="maas-api" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826820 5078 cpu_manager.go:414] "containerMap: removing container" podUID="50d97c5f-9b0e-4851-b1b5-400c74b23352" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826827 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50d97c5f-9b0e-4851-b1b5-400c74b23352" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826841 5078 cpu_manager.go:414] "containerMap: removing container" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826848 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826861 5078 cpu_manager.go:414] "containerMap: removing container" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826868 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826886 5078 cpu_manager.go:414] "containerMap: removing container" podUID="179c807f-ec84-47b4-ba09-51354cbcff6a" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826893 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="179c807f-ec84-47b4-ba09-51354cbcff6a" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826904 5078 cpu_manager.go:414] "containerMap: removing container" podUID="8debf693-923a-42c5-9811-1ccfd37cca82" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826911 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8debf693-923a-42c5-9811-1ccfd37cca82" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826924 5078 cpu_manager.go:414] "containerMap: removing container" podUID="e8433528-266c-4508-a35b-d7345ef1bbd7" containerName="maas-api" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826931 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e8433528-266c-4508-a35b-d7345ef1bbd7" containerName="maas-api" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826940 5078 cpu_manager.go:414] "containerMap: removing container" podUID="e9729fb9-30d8-45ce-ad35-9e881630030a" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826948 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e9729fb9-30d8-45ce-ad35-9e881630030a" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826958 5078 cpu_manager.go:414] "containerMap: removing container" podUID="48a25fb9-3214-4c1c-95fe-d751ad4372e4" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826965 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="48a25fb9-3214-4c1c-95fe-d751ad4372e4" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826978 5078 cpu_manager.go:414] "containerMap: removing container" podUID="25da5733-edc7-4a62-bc21-dbe63273deed" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.826985 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="25da5733-edc7-4a62-bc21-dbe63273deed" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827003 5078 cpu_manager.go:414] "containerMap: removing container" podUID="62edb9f6-a9af-4488-849b-6c9115b79513" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827010 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="62edb9f6-a9af-4488-849b-6c9115b79513" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827022 5078 cpu_manager.go:414] "containerMap: removing container" podUID="bb6d3cde-8f40-4aa2-a446-ee6a410aba52" containerName="maas-api" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827029 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bb6d3cde-8f40-4aa2-a446-ee6a410aba52" containerName="maas-api" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827040 5078 cpu_manager.go:414] "containerMap: removing container" podUID="9cd57b86-49b2-4877-957a-cb8e27992937" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827048 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9cd57b86-49b2-4877-957a-cb8e27992937" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827058 5078 cpu_manager.go:414] "containerMap: removing container" podUID="6beb222b-b89e-4518-aea1-692285cc2951" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827065 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6beb222b-b89e-4518-aea1-692285cc2951" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827181 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="ca42f8ad-24a9-4bec-9fcf-48582787f1c9" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827196 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="cc623b5b-8385-4b36-82b7-4939ae2bf727" containerName="payload-processing" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827208 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="ae1473f0-1f82-4e44-9a44-a76562d7a880" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827218 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="df86ddea-3b6d-43e0-b478-21743945b4a6" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827230 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="9eb5acf0-bbb2-4cf7-b212-9bd9f5b952bd" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827237 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="82a38bcc-0f98-4cf5-901f-e7bd47f9755b" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827248 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="ca42f8ad-24a9-4bec-9fcf-48582787f1c9" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827256 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="f398ea35-32fa-425c-9e05-a3fd41ba99ba" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827265 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="6de7d150-b3e9-44f2-9b6a-71e69df471a9" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827274 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="33f80c7b-4092-4406-aa02-3a25d9e8501a" containerName="main" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827284 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="f8cf8036-fa67-45ef-a16f-fa7041a61305" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827294 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="2bc6c031-5ab7-4ff5-8c4a-13286258090f" containerName="maas-api" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827304 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="50d97c5f-9b0e-4851-b1b5-400c74b23352" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827312 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="a0f5a46d-0671-46de-b229-4449baf28a99" containerName="main" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827319 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="a6024242-56b5-4456-af29-35653c018f04" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827344 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="179c807f-ec84-47b4-ba09-51354cbcff6a" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827355 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="8debf693-923a-42c5-9811-1ccfd37cca82" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827366 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="e8433528-266c-4508-a35b-d7345ef1bbd7" containerName="maas-api" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827375 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="e9729fb9-30d8-45ce-ad35-9e881630030a" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827382 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="48a25fb9-3214-4c1c-95fe-d751ad4372e4" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827390 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="25da5733-edc7-4a62-bc21-dbe63273deed" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827399 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="25da5733-edc7-4a62-bc21-dbe63273deed" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827408 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="62edb9f6-a9af-4488-849b-6c9115b79513" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827418 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="bb6d3cde-8f40-4aa2-a446-ee6a410aba52" containerName="maas-api" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827429 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="9cd57b86-49b2-4877-957a-cb8e27992937" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827437 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="6beb222b-b89e-4518-aea1-692285cc2951" containerName="istio-proxy" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827446 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="9f0b2906-f246-4b28-b48a-f50456e27840" containerName="payload-pre-processing" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827455 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="1e445c74-350f-49be-b2fa-40f6ff72c2d5" containerName="maas-api" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827464 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="49a87331-7606-4e95-8d8c-b8f1ad754a9a" containerName="main" Oct 30 20:23:15.827730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.827474 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="6b463b25-8a3d-4b36-9925-5358b34f0c4c" containerName="istio-proxy" Oct 30 20:23:15.832755 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.832731 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:15.841192 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.840852 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659"] Oct 30 20:23:15.841192 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.841020 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-124fd1\"/\"openshift-service-ca.crt\"" Oct 30 20:23:15.841192 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.841032 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-124fd1\"/\"kube-root-ca.crt\"" Oct 30 20:23:15.841192 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.841107 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-124fd1\"/\"default-dockercfg-v2g4p\"" Oct 30 20:23:15.841509 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.841238 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-124fd1\"/\"distinct-w3-124fd1-kserve-self-signed-certs\"" Oct 30 20:23:15.955930 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.955770 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-model-cache\") pod \"distinct-w3-124fd1-kserve-5895b84956-7t659\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:15.956350 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.956190 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-home\") pod \"distinct-w3-124fd1-kserve-5895b84956-7t659\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:15.956350 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.956236 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-tmp-dir\") pod \"distinct-w3-124fd1-kserve-5895b84956-7t659\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:15.956350 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.956284 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-dshm\") pod \"distinct-w3-124fd1-kserve-5895b84956-7t659\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:15.956350 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.956308 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk8px\" (UniqueName: \"kubernetes.io/projected/aad73251-93ce-400c-a351-60b67fa78cdc-kube-api-access-rk8px\") pod \"distinct-w3-124fd1-kserve-5895b84956-7t659\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:15.974392 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:15.956667 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aad73251-93ce-400c-a351-60b67fa78cdc-tls-certs\") pod \"distinct-w3-124fd1-kserve-5895b84956-7t659\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:16.077879 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:16.077849 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aad73251-93ce-400c-a351-60b67fa78cdc-tls-certs\") pod \"distinct-w3-124fd1-kserve-5895b84956-7t659\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:16.078056 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:16.077996 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-model-cache\") pod \"distinct-w3-124fd1-kserve-5895b84956-7t659\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:16.078056 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:16.078037 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-home\") pod \"distinct-w3-124fd1-kserve-5895b84956-7t659\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:16.078196 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:16.078060 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-tmp-dir\") pod \"distinct-w3-124fd1-kserve-5895b84956-7t659\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:16.078196 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:16.078101 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-dshm\") pod \"distinct-w3-124fd1-kserve-5895b84956-7t659\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:16.078196 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:16.078128 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk8px\" (UniqueName: \"kubernetes.io/projected/aad73251-93ce-400c-a351-60b67fa78cdc-kube-api-access-rk8px\") pod \"distinct-w3-124fd1-kserve-5895b84956-7t659\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:16.078478 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:16.078448 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-model-cache\") pod \"distinct-w3-124fd1-kserve-5895b84956-7t659\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:16.078600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:16.078489 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-tmp-dir\") pod \"distinct-w3-124fd1-kserve-5895b84956-7t659\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:16.078600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:16.078543 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-home\") pod \"distinct-w3-124fd1-kserve-5895b84956-7t659\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:16.080416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:16.080388 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-dshm\") pod \"distinct-w3-124fd1-kserve-5895b84956-7t659\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:16.080589 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:16.080569 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aad73251-93ce-400c-a351-60b67fa78cdc-tls-certs\") pod \"distinct-w3-124fd1-kserve-5895b84956-7t659\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:16.091243 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:16.091189 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk8px\" (UniqueName: \"kubernetes.io/projected/aad73251-93ce-400c-a351-60b67fa78cdc-kube-api-access-rk8px\") pod \"distinct-w3-124fd1-kserve-5895b84956-7t659\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:16.159812 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:16.159776 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:16.441166 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:16.441140 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659"] Oct 30 20:23:16.443192 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:23:16.443162 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaad73251_93ce_400c_a351_60b67fa78cdc.slice/crio-4e6d357fe3022f96d74e836dd1a801035c87e00c5f63de445307ced1e2b20c04 WatchSource:0}: Error finding container 4e6d357fe3022f96d74e836dd1a801035c87e00c5f63de445307ced1e2b20c04: Status 404 returned error can't find the container with id 4e6d357fe3022f96d74e836dd1a801035c87e00c5f63de445307ced1e2b20c04 Oct 30 20:23:16.695205 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:16.695096 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" event={"ID":"aad73251-93ce-400c-a351-60b67fa78cdc","Type":"ContainerStarted","Data":"dfc225e9b6a1637561798bc9ae69b241d430f9f7317410f419bdd60e06f5706d"} Oct 30 20:23:16.695205 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:16.695140 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" event={"ID":"aad73251-93ce-400c-a351-60b67fa78cdc","Type":"ContainerStarted","Data":"4e6d357fe3022f96d74e836dd1a801035c87e00c5f63de445307ced1e2b20c04"} Oct 30 20:23:16.716512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:16.716462 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" podStartSLOduration=1.716448539 podStartE2EDuration="1.716448539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:23:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:23:16.714579487 +0000 UTC m=+1171.247852084" watchObservedRunningTime="2026-10-30 20:23:16.716448539 +0000 UTC m=+1171.249721133" Oct 30 20:23:17.160894 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:17.160858 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:17.601845 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:23:17.601812 5078 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc623b5b_8385_4b36_82b7_4939ae2bf727.slice\": RecentStats: unable to find data in memory cache]" Oct 30 20:23:20.402441 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:23:20.402403 5078 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc623b5b_8385_4b36_82b7_4939ae2bf727.slice\": RecentStats: unable to find data in memory cache]" Oct 30 20:23:26.160131 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:26.160098 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:26.173424 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:26.173396 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:26.698787 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:23:26.698742 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:23:26.794635 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:26.794601 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:23:30.466397 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:23:30.466366 5078 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc623b5b_8385_4b36_82b7_4939ae2bf727.slice\": RecentStats: unable to find data in memory cache]" Oct 30 20:23:32.066290 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.066258 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws"] Oct 30 20:23:32.067158 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.067105 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" podUID="5781f3d7-e5ad-43b1-9de6-592eb80bdf39" containerName="maas-api" containerID="cri-o://e4a6a91ff57a00afbaaa5b59bbe0fcaccd565881f3ae7639221e422c2f93d432" gracePeriod=30 Oct 30 20:23:32.528186 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.528161 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" Oct 30 20:23:32.533708 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:23:32.531869 5078 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc623b5b_8385_4b36_82b7_4939ae2bf727.slice\": RecentStats: unable to find data in memory cache]" Oct 30 20:23:32.646387 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.646263 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-metrics-certs\") pod \"5781f3d7-e5ad-43b1-9de6-592eb80bdf39\" (UID: \"5781f3d7-e5ad-43b1-9de6-592eb80bdf39\") " Oct 30 20:23:32.646564 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.646412 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-openshift-service-ca\") pod \"5781f3d7-e5ad-43b1-9de6-592eb80bdf39\" (UID: \"5781f3d7-e5ad-43b1-9de6-592eb80bdf39\") " Oct 30 20:23:32.646564 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.646483 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-kube-api-access-zhzpq\" (UniqueName: \"kubernetes.io/projected/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-kube-api-access-zhzpq\") pod \"5781f3d7-e5ad-43b1-9de6-592eb80bdf39\" (UID: \"5781f3d7-e5ad-43b1-9de6-592eb80bdf39\") " Oct 30 20:23:32.646691 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.646562 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-maas-api-tls\") pod \"5781f3d7-e5ad-43b1-9de6-592eb80bdf39\" (UID: \"5781f3d7-e5ad-43b1-9de6-592eb80bdf39\") " Oct 30 20:23:32.646859 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.646807 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-openshift-service-ca" pod "5781f3d7-e5ad-43b1-9de6-592eb80bdf39" (UID: "5781f3d7-e5ad-43b1-9de6-592eb80bdf39"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:23:32.647031 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.647013 5078 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-openshift-service-ca\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:32.649743 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.649717 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-maas-api-tls" pod "5781f3d7-e5ad-43b1-9de6-592eb80bdf39" (UID: "5781f3d7-e5ad-43b1-9de6-592eb80bdf39"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:23:32.652472 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.652447 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-metrics-certs" pod "5781f3d7-e5ad-43b1-9de6-592eb80bdf39" (UID: "5781f3d7-e5ad-43b1-9de6-592eb80bdf39"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:23:32.660778 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.660749 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-kube-api-access-zhzpq" pod "5781f3d7-e5ad-43b1-9de6-592eb80bdf39" (UID: "5781f3d7-e5ad-43b1-9de6-592eb80bdf39"). InnerVolumeSpecName "kube-api-access-zhzpq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:23:32.758353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.753261 5078 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-metrics-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:32.758353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.753311 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhzpq\" (UniqueName: \"kubernetes.io/projected/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-kube-api-access-zhzpq\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:32.758353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.753347 5078 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5781f3d7-e5ad-43b1-9de6-592eb80bdf39-maas-api-tls\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:32.841000 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.840967 5078 generic.go:356] "Generic (PLEG): container finished" podID="5781f3d7-e5ad-43b1-9de6-592eb80bdf39" containerID="e4a6a91ff57a00afbaaa5b59bbe0fcaccd565881f3ae7639221e422c2f93d432" exitCode=0 Oct 30 20:23:32.841197 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.841042 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" Oct 30 20:23:32.841197 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.841061 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" event={"ID":"5781f3d7-e5ad-43b1-9de6-592eb80bdf39","Type":"ContainerDied","Data":"e4a6a91ff57a00afbaaa5b59bbe0fcaccd565881f3ae7639221e422c2f93d432"} Oct 30 20:23:32.841197 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.841127 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws" event={"ID":"5781f3d7-e5ad-43b1-9de6-592eb80bdf39","Type":"ContainerDied","Data":"af19bf1af5164ee68694a180f8d25b322f88fdc696cd107e9c4f9b5af724c26e"} Oct 30 20:23:32.841197 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.841158 5078 scope.go:122] "RemoveContainer" containerID="e4a6a91ff57a00afbaaa5b59bbe0fcaccd565881f3ae7639221e422c2f93d432" Oct 30 20:23:32.854090 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.854068 5078 scope.go:122] "RemoveContainer" containerID="e4a6a91ff57a00afbaaa5b59bbe0fcaccd565881f3ae7639221e422c2f93d432" Oct 30 20:23:32.854452 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:23:32.854425 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4a6a91ff57a00afbaaa5b59bbe0fcaccd565881f3ae7639221e422c2f93d432\": container with ID starting with e4a6a91ff57a00afbaaa5b59bbe0fcaccd565881f3ae7639221e422c2f93d432 not found: ID does not exist" containerID="e4a6a91ff57a00afbaaa5b59bbe0fcaccd565881f3ae7639221e422c2f93d432" Oct 30 20:23:32.854522 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.854465 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4a6a91ff57a00afbaaa5b59bbe0fcaccd565881f3ae7639221e422c2f93d432"} err="failed to get container status \"e4a6a91ff57a00afbaaa5b59bbe0fcaccd565881f3ae7639221e422c2f93d432\": rpc error: code = NotFound desc = could not find container \"e4a6a91ff57a00afbaaa5b59bbe0fcaccd565881f3ae7639221e422c2f93d432\": container with ID starting with e4a6a91ff57a00afbaaa5b59bbe0fcaccd565881f3ae7639221e422c2f93d432 not found: ID does not exist" Oct 30 20:23:32.871498 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.871464 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws"] Oct 30 20:23:32.875589 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:32.875564 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-5197ec-69df6694d7-j2dws"] Oct 30 20:23:33.609477 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:33.609432 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5781f3d7-e5ad-43b1-9de6-592eb80bdf39" path="/var/lib/kubelet/pods/5781f3d7-e5ad-43b1-9de6-592eb80bdf39/volumes" Oct 30 20:23:35.544259 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.544221 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt"] Oct 30 20:23:35.544890 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.544869 5078 cpu_manager.go:414] "containerMap: removing container" podUID="25da5733-edc7-4a62-bc21-dbe63273deed" containerName="istio-proxy" Oct 30 20:23:35.544965 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.544891 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="25da5733-edc7-4a62-bc21-dbe63273deed" containerName="istio-proxy" Oct 30 20:23:35.544965 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.544909 5078 cpu_manager.go:414] "containerMap: removing container" podUID="5781f3d7-e5ad-43b1-9de6-592eb80bdf39" containerName="maas-api" Oct 30 20:23:35.544965 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.544914 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5781f3d7-e5ad-43b1-9de6-592eb80bdf39" containerName="maas-api" Oct 30 20:23:35.545059 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.544994 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="5781f3d7-e5ad-43b1-9de6-592eb80bdf39" containerName="maas-api" Oct 30 20:23:35.552019 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.551992 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:35.560609 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.560588 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-124fd1\"/\"distinct-2-w3-124fd1-kserve-self-signed-certs\"" Oct 30 20:23:35.560914 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.560897 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt"] Oct 30 20:23:35.623709 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.623635 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vggkp\" (UniqueName: \"kubernetes.io/projected/dc1bdfae-b781-4575-9c79-03bb9140822a-kube-api-access-vggkp\") pod \"distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:35.623709 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.623677 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc1bdfae-b781-4575-9c79-03bb9140822a-tls-certs\") pod \"distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:35.623884 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.623743 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-dshm\") pod \"distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:35.623884 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.623805 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-model-cache\") pod \"distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:35.623884 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.623830 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-home\") pod \"distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:35.623884 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.623849 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-tmp-dir\") pod \"distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:35.725074 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.725040 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vggkp\" (UniqueName: \"kubernetes.io/projected/dc1bdfae-b781-4575-9c79-03bb9140822a-kube-api-access-vggkp\") pod \"distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:35.725566 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.725091 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc1bdfae-b781-4575-9c79-03bb9140822a-tls-certs\") pod \"distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:35.725566 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.725119 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-dshm\") pod \"distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:35.725566 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.725159 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-model-cache\") pod \"distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:35.725566 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.725184 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-home\") pod \"distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:35.725566 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.725323 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-tmp-dir\") pod \"distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:35.725877 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.725694 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-model-cache\") pod \"distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:35.725877 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.725718 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-home\") pod \"distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:35.725877 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.725781 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-tmp-dir\") pod \"distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:35.727610 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.727591 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-dshm\") pod \"distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:35.727910 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.727890 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc1bdfae-b781-4575-9c79-03bb9140822a-tls-certs\") pod \"distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:35.741497 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.741477 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vggkp\" (UniqueName: \"kubernetes.io/projected/dc1bdfae-b781-4575-9c79-03bb9140822a-kube-api-access-vggkp\") pod \"distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:35.867718 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:35.867395 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:36.200194 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:36.200168 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt"] Oct 30 20:23:36.202579 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:23:36.202549 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc1bdfae_b781_4575_9c79_03bb9140822a.slice/crio-6dc3544ddecff1e6e16fad8dbc30aa77ac36bc9327e0b7953106cf1318ee675a WatchSource:0}: Error finding container 6dc3544ddecff1e6e16fad8dbc30aa77ac36bc9327e0b7953106cf1318ee675a: Status 404 returned error can't find the container with id 6dc3544ddecff1e6e16fad8dbc30aa77ac36bc9327e0b7953106cf1318ee675a Oct 30 20:23:36.931015 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:36.930976 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" event={"ID":"dc1bdfae-b781-4575-9c79-03bb9140822a","Type":"ContainerStarted","Data":"8adb38cc36578dc4b2347a956970ba88d768c428729f670f88d3306e58d7d3cd"} Oct 30 20:23:36.931444 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:36.931026 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" event={"ID":"dc1bdfae-b781-4575-9c79-03bb9140822a","Type":"ContainerStarted","Data":"6dc3544ddecff1e6e16fad8dbc30aa77ac36bc9327e0b7953106cf1318ee675a"} Oct 30 20:23:36.965927 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:36.965870 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" podStartSLOduration=1.96585659 podStartE2EDuration="1.96585659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:23:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:23:36.962763989 +0000 UTC m=+1191.496036583" watchObservedRunningTime="2026-10-30 20:23:36.96585659 +0000 UTC m=+1191.499129184" Oct 30 20:23:37.868361 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:37.868294 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:38.030962 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:23:38.030924 5078 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc623b5b_8385_4b36_82b7_4939ae2bf727.slice\": RecentStats: unable to find data in memory cache]" Oct 30 20:23:38.031457 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:23:38.031002 5078 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc623b5b_8385_4b36_82b7_4939ae2bf727.slice\": RecentStats: unable to find data in memory cache]" Oct 30 20:23:39.818603 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:39.818568 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6"] Oct 30 20:23:39.823070 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:39.823030 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:39.848728 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:39.848695 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6"] Oct 30 20:23:39.985061 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:39.985027 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istiod-ca-cert\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:39.985061 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:39.985064 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-token\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:39.985309 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:39.985083 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-credential-socket\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:39.985309 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:39.985251 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whqd2\" (UniqueName: \"kubernetes.io/projected/f638d7bc-a31f-4e99-8c8e-a78f45642b59-kube-api-access-whqd2\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:39.985309 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:39.985283 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-podinfo\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:39.985467 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:39.985420 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-workload-certs\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:39.985508 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:39.985488 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-workload-socket\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:39.985560 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:39.985510 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-data\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:39.985560 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:39.985547 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-envoy\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:40.086870 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.086782 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-workload-certs\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:40.086870 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.086851 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-workload-socket\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:40.086870 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.086872 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-data\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:40.087173 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.086893 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-envoy\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:40.087173 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.086930 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istiod-ca-cert\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:40.087173 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.087044 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-token\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:40.087173 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.087100 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-credential-socket\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:40.087420 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.087208 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whqd2\" (UniqueName: \"kubernetes.io/projected/f638d7bc-a31f-4e99-8c8e-a78f45642b59-kube-api-access-whqd2\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:40.087420 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.087233 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-workload-certs\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:40.087420 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.087236 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-podinfo\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:40.087420 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.087272 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-workload-socket\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:40.087420 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.087315 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-data\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:40.087666 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.087558 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-credential-socket\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:40.087864 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.087839 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istiod-ca-cert\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:40.089642 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.089615 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-envoy\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:40.089965 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.089949 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-podinfo\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:40.104963 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.104928 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-token\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:40.105277 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.105253 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whqd2\" (UniqueName: \"kubernetes.io/projected/f638d7bc-a31f-4e99-8c8e-a78f45642b59-kube-api-access-whqd2\") pod \"e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:40.144190 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.144145 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:40.440238 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.440204 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6"] Oct 30 20:23:40.441909 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:23:40.441879 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf638d7bc_a31f_4e99_8c8e_a78f45642b59.slice/crio-d369da7f2ebad56fb022572ae0a3a763113900a20a7c28c20b97f01d0dd21413 WatchSource:0}: Error finding container d369da7f2ebad56fb022572ae0a3a763113900a20a7c28c20b97f01d0dd21413: Status 404 returned error can't find the container with id d369da7f2ebad56fb022572ae0a3a763113900a20a7c28c20b97f01d0dd21413 Oct 30 20:23:40.445035 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.445002 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:23:40.445135 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.445082 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:23:40.445135 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.445128 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:23:40.481780 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:23:40.481746 5078 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc623b5b_8385_4b36_82b7_4939ae2bf727.slice\": RecentStats: unable to find data in memory cache]" Oct 30 20:23:40.969970 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.967396 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" event={"ID":"f638d7bc-a31f-4e99-8c8e-a78f45642b59","Type":"ContainerStarted","Data":"11c20ba7399bfe91e3683ad33a59fbaebf9f6c946c04ba470aa1db58f647572a"} Oct 30 20:23:40.969970 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:40.967493 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" event={"ID":"f638d7bc-a31f-4e99-8c8e-a78f45642b59","Type":"ContainerStarted","Data":"d369da7f2ebad56fb022572ae0a3a763113900a20a7c28c20b97f01d0dd21413"} Oct 30 20:23:41.004410 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:41.004290 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" podStartSLOduration=2.00427428 podStartE2EDuration="2.00427428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:23:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:23:41.000698841 +0000 UTC m=+1195.533971438" watchObservedRunningTime="2026-10-30 20:23:41.00427428 +0000 UTC m=+1195.537546874" Oct 30 20:23:41.149266 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:41.149229 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:41.149689 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:41.149661 5078 patch_prober.go:29] interesting pod/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body= Oct 30 20:23:41.149863 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:41.149837 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" podUID="f638d7bc-a31f-4e99-8c8e-a78f45642b59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" Oct 30 20:23:41.658351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:41.658102 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g"] Oct 30 20:23:41.659624 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:41.659573 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" containerID="cri-o://3313cc107786bdaff2f6e0034bca3b9e7adb0adfd4b0222c6ccd16ec634e35ac" gracePeriod=30 Oct 30 20:23:41.682842 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:41.682811 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh"] Oct 30 20:23:41.683060 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:41.683036 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" podUID="8db14715-2a34-4191-8764-c9cfd82abcec" containerName="istio-proxy" containerID="cri-o://104f54fd2878b62ae351224b1c971f953a9f3949c7a875e9bb8751da8de63c3b" gracePeriod=30 Oct 30 20:23:41.712079 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:41.712049 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6"] Oct 30 20:23:41.712250 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:41.712231 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" containerID="cri-o://81e940d14e1045ceacef695dc249aea455c42c6c5a46a7da3a8afd265a404b54" gracePeriod=30 Oct 30 20:23:42.148352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:42.147648 5078 patch_prober.go:29] interesting pod/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body= Oct 30 20:23:42.148352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:42.147710 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" podUID="f638d7bc-a31f-4e99-8c8e-a78f45642b59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" Oct 30 20:23:43.153355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:43.152719 5078 patch_prober.go:29] interesting pod/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body= Oct 30 20:23:43.153355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:43.152781 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" podUID="f638d7bc-a31f-4e99-8c8e-a78f45642b59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" Oct 30 20:23:44.153772 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:44.153728 5078 patch_prober.go:29] interesting pod/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body= Oct 30 20:23:44.154263 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:44.153796 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" podUID="f638d7bc-a31f-4e99-8c8e-a78f45642b59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" Oct 30 20:23:45.146354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:45.145739 5078 patch_prober.go:29] interesting pod/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body= Oct 30 20:23:45.146354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:45.145799 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" podUID="f638d7bc-a31f-4e99-8c8e-a78f45642b59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" Oct 30 20:23:45.723790 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:45.723764 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/1.log" Oct 30 20:23:45.724903 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:45.724877 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/1.log" Oct 30 20:23:45.868304 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:45.868265 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:45.881262 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:45.881235 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:46.027418 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:46.026587 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 20:23:46.027418 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:46.026646 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 20:23:46.057802 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:46.057667 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:23:46.158352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:46.157848 5078 patch_prober.go:29] interesting pod/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body= Oct 30 20:23:46.158352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:46.157910 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" podUID="f638d7bc-a31f-4e99-8c8e-a78f45642b59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" Oct 30 20:23:46.190646 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:46.190610 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 20:23:46.191849 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:46.191790 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 20:23:46.347353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:46.343405 5078 patch_prober.go:29] interesting pod/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 20:23:46.347353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:46.343475 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" podUID="8db14715-2a34-4191-8764-c9cfd82abcec" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 20:23:47.015895 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.015859 5078 generic.go:356] "Generic (PLEG): container finished" podID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerID="3313cc107786bdaff2f6e0034bca3b9e7adb0adfd4b0222c6ccd16ec634e35ac" exitCode=0 Oct 30 20:23:47.015895 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.015895 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" event={"ID":"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc","Type":"ContainerDied","Data":"3313cc107786bdaff2f6e0034bca3b9e7adb0adfd4b0222c6ccd16ec634e35ac"} Oct 30 20:23:47.016476 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.015945 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" event={"ID":"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc","Type":"ContainerDied","Data":"ef5ec5e3bf4e001a5f4807c0d793adea1918ded0bee6983aab99a4dfd0446fdf"} Oct 30 20:23:47.016476 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.015970 5078 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef5ec5e3bf4e001a5f4807c0d793adea1918ded0bee6983aab99a4dfd0446fdf" Oct 30 20:23:47.018105 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.018080 5078 generic.go:356] "Generic (PLEG): container finished" podID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerID="81e940d14e1045ceacef695dc249aea455c42c6c5a46a7da3a8afd265a404b54" exitCode=0 Oct 30 20:23:47.018217 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.018161 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" event={"ID":"bcda848d-8ba6-4040-8ad7-f38ba20bf2df","Type":"ContainerDied","Data":"81e940d14e1045ceacef695dc249aea455c42c6c5a46a7da3a8afd265a404b54"} Oct 30 20:23:47.020237 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.020214 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:23:47.020503 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.020481 5078 generic.go:356] "Generic (PLEG): container finished" podID="8db14715-2a34-4191-8764-c9cfd82abcec" containerID="104f54fd2878b62ae351224b1c971f953a9f3949c7a875e9bb8751da8de63c3b" exitCode=0 Oct 30 20:23:47.020598 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.020543 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" event={"ID":"8db14715-2a34-4191-8764-c9cfd82abcec","Type":"ContainerDied","Data":"104f54fd2878b62ae351224b1c971f953a9f3949c7a875e9bb8751da8de63c3b"} Oct 30 20:23:47.020659 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.020600 5078 scope.go:122] "RemoveContainer" containerID="baea419920171942f788ec03adb3b6b87556171bc77445e940b9a4fd2dd0b841" Oct 30 20:23:47.122999 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.122972 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:23:47.125028 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.125011 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:23:47.144908 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.144872 5078 patch_prober.go:29] interesting pod/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body= Oct 30 20:23:47.145067 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.144931 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" podUID="f638d7bc-a31f-4e99-8c8e-a78f45642b59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" Oct 30 20:23:47.180087 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.180055 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-workload-socket\") pod \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " Oct 30 20:23:47.180087 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.180094 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-podinfo\") pod \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " Oct 30 20:23:47.180367 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.180179 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-envoy\") pod \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " Oct 30 20:23:47.180367 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.180233 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-workload-certs\") pod \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " Oct 30 20:23:47.180367 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.180266 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-data\") pod \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " Oct 30 20:23:47.180367 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.180364 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-credential-socket\") pod \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " Oct 30 20:23:47.180575 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.180376 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-workload-socket" pod "a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" (UID: "a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:47.180575 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.180392 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-kube-api-access-6k8d8\" (UniqueName: \"kubernetes.io/projected/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-kube-api-access-6k8d8\") pod \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " Oct 30 20:23:47.180575 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.180421 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-token\" (UniqueName: \"kubernetes.io/projected/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-token\") pod \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " Oct 30 20:23:47.180575 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.180453 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istiod-ca-cert\") pod \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\" (UID: \"a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc\") " Oct 30 20:23:47.180772 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.180573 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-workload-certs" pod "a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" (UID: "a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:47.181939 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.180815 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-credential-socket" pod "a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" (UID: "a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:47.181939 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.180997 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.181939 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.181017 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.181939 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.181033 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.181939 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.181122 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istiod-ca-cert" pod "a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" (UID: "a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:23:47.181939 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.181821 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-data" pod "a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" (UID: "a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:47.183226 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.183197 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-token" pod "a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" (UID: "a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:23:47.183933 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.183908 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-kube-api-access-6k8d8" pod "a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" (UID: "a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc"). InnerVolumeSpecName "kube-api-access-6k8d8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:23:47.185560 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.185531 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-podinfo" pod "a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" (UID: "a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:23:47.189685 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.189658 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-envoy" pod "a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" (UID: "a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:47.281751 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.281656 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8db14715-2a34-4191-8764-c9cfd82abcec-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8db14715-2a34-4191-8764-c9cfd82abcec-istio-podinfo\") pod \"8db14715-2a34-4191-8764-c9cfd82abcec\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " Oct 30 20:23:47.281751 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.281729 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istiod-ca-cert\") pod \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " Oct 30 20:23:47.281989 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.281869 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8db14715-2a34-4191-8764-c9cfd82abcec-kube-api-access-khtxx\" (UniqueName: \"kubernetes.io/projected/8db14715-2a34-4191-8764-c9cfd82abcec-kube-api-access-khtxx\") pod \"8db14715-2a34-4191-8764-c9cfd82abcec\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " Oct 30 20:23:47.281989 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.281920 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-credential-socket\") pod \"8db14715-2a34-4191-8764-c9cfd82abcec\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " Oct 30 20:23:47.281989 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.281975 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8db14715-2a34-4191-8764-c9cfd82abcec-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8db14715-2a34-4191-8764-c9cfd82abcec-istiod-ca-cert\") pod \"8db14715-2a34-4191-8764-c9cfd82abcec\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " Oct 30 20:23:47.282168 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.282005 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-kube-api-access-7pft8\" (UniqueName: \"kubernetes.io/projected/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-kube-api-access-7pft8\") pod \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " Oct 30 20:23:47.282168 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.282038 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-workload-certs\") pod \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " Oct 30 20:23:47.282168 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.282078 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8db14715-2a34-4191-8764-c9cfd82abcec-istio-token\" (UniqueName: \"kubernetes.io/projected/8db14715-2a34-4191-8764-c9cfd82abcec-istio-token\") pod \"8db14715-2a34-4191-8764-c9cfd82abcec\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " Oct 30 20:23:47.282168 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.282123 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-istio-envoy\") pod \"8db14715-2a34-4191-8764-c9cfd82abcec\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " Oct 30 20:23:47.282416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.282168 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-workload-socket\") pod \"8db14715-2a34-4191-8764-c9cfd82abcec\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " Oct 30 20:23:47.282416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.282175 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istiod-ca-cert" pod "bcda848d-8ba6-4040-8ad7-f38ba20bf2df" (UID: "bcda848d-8ba6-4040-8ad7-f38ba20bf2df"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:23:47.282416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.282203 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-workload-socket\") pod \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " Oct 30 20:23:47.282416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.282253 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-token\" (UniqueName: \"kubernetes.io/projected/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-token\") pod \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " Oct 30 20:23:47.282416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.282285 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-workload-certs\") pod \"8db14715-2a34-4191-8764-c9cfd82abcec\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " Oct 30 20:23:47.282416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.282406 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-envoy\") pod \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " Oct 30 20:23:47.282727 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.282454 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-istio-data\") pod \"8db14715-2a34-4191-8764-c9cfd82abcec\" (UID: \"8db14715-2a34-4191-8764-c9cfd82abcec\") " Oct 30 20:23:47.282727 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.282484 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-data\") pod \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " Oct 30 20:23:47.282727 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.282485 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-credential-socket" pod "8db14715-2a34-4191-8764-c9cfd82abcec" (UID: "8db14715-2a34-4191-8764-c9cfd82abcec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:47.282727 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.282525 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-podinfo\") pod \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " Oct 30 20:23:47.282727 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.282587 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-credential-socket\") pod \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\" (UID: \"bcda848d-8ba6-4040-8ad7-f38ba20bf2df\") " Oct 30 20:23:47.282727 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.282598 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8db14715-2a34-4191-8764-c9cfd82abcec-istiod-ca-cert" pod "8db14715-2a34-4191-8764-c9cfd82abcec" (UID: "8db14715-2a34-4191-8764-c9cfd82abcec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:23:47.282727 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.282696 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-workload-socket" pod "bcda848d-8ba6-4040-8ad7-f38ba20bf2df" (UID: "bcda848d-8ba6-4040-8ad7-f38ba20bf2df"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:47.283110 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.283083 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.283175 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.283110 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.283175 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.283125 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.283175 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.283142 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.283175 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.283155 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8db14715-2a34-4191-8764-c9cfd82abcec-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.283175 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.283170 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k8d8\" (UniqueName: \"kubernetes.io/projected/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-kube-api-access-6k8d8\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.283442 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.283185 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.283442 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.283199 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.283442 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.283212 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.283442 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.283227 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.283442 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.283179 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-workload-socket" pod "8db14715-2a34-4191-8764-c9cfd82abcec" (UID: "8db14715-2a34-4191-8764-c9cfd82abcec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:47.283442 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.283190 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-workload-certs" pod "bcda848d-8ba6-4040-8ad7-f38ba20bf2df" (UID: "bcda848d-8ba6-4040-8ad7-f38ba20bf2df"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:47.283442 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.283374 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-istio-data" pod "8db14715-2a34-4191-8764-c9cfd82abcec" (UID: "8db14715-2a34-4191-8764-c9cfd82abcec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:47.283811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.283540 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-credential-socket" pod "bcda848d-8ba6-4040-8ad7-f38ba20bf2df" (UID: "bcda848d-8ba6-4040-8ad7-f38ba20bf2df"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:47.284263 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.284227 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-workload-certs" pod "8db14715-2a34-4191-8764-c9cfd82abcec" (UID: "8db14715-2a34-4191-8764-c9cfd82abcec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:47.284708 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.284680 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-data" pod "bcda848d-8ba6-4040-8ad7-f38ba20bf2df" (UID: "bcda848d-8ba6-4040-8ad7-f38ba20bf2df"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:47.287351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.287292 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-istio-envoy" pod "8db14715-2a34-4191-8764-c9cfd82abcec" (UID: "8db14715-2a34-4191-8764-c9cfd82abcec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:47.287351 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.287288 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8db14715-2a34-4191-8764-c9cfd82abcec-istio-podinfo" pod "8db14715-2a34-4191-8764-c9cfd82abcec" (UID: "8db14715-2a34-4191-8764-c9cfd82abcec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:23:47.287510 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.287377 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8db14715-2a34-4191-8764-c9cfd82abcec-kube-api-access-khtxx" pod "8db14715-2a34-4191-8764-c9cfd82abcec" (UID: "8db14715-2a34-4191-8764-c9cfd82abcec"). InnerVolumeSpecName "kube-api-access-khtxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:23:47.287510 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.287379 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-podinfo" pod "bcda848d-8ba6-4040-8ad7-f38ba20bf2df" (UID: "bcda848d-8ba6-4040-8ad7-f38ba20bf2df"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:23:47.287510 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.287420 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-kube-api-access-7pft8" pod "bcda848d-8ba6-4040-8ad7-f38ba20bf2df" (UID: "bcda848d-8ba6-4040-8ad7-f38ba20bf2df"). InnerVolumeSpecName "kube-api-access-7pft8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:23:47.288305 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.288277 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8db14715-2a34-4191-8764-c9cfd82abcec-istio-token" pod "8db14715-2a34-4191-8764-c9cfd82abcec" (UID: "8db14715-2a34-4191-8764-c9cfd82abcec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:23:47.288574 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.288554 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-envoy" pod "bcda848d-8ba6-4040-8ad7-f38ba20bf2df" (UID: "bcda848d-8ba6-4040-8ad7-f38ba20bf2df"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:23:47.288704 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.288688 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-token" pod "bcda848d-8ba6-4040-8ad7-f38ba20bf2df" (UID: "bcda848d-8ba6-4040-8ad7-f38ba20bf2df"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:23:47.384922 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.384887 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.384922 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.384924 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.385125 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.384939 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.385125 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.384956 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.385125 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.384969 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.385125 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.384994 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.385125 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.385008 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.385125 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.385022 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.385125 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.385036 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8db14715-2a34-4191-8764-c9cfd82abcec-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.385125 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.385053 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khtxx\" (UniqueName: \"kubernetes.io/projected/8db14715-2a34-4191-8764-c9cfd82abcec-kube-api-access-khtxx\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.385125 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.385067 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pft8\" (UniqueName: \"kubernetes.io/projected/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-kube-api-access-7pft8\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.385125 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.385081 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcda848d-8ba6-4040-8ad7-f38ba20bf2df-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.385125 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.385095 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8db14715-2a34-4191-8764-c9cfd82abcec-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:47.385125 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:47.385111 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8db14715-2a34-4191-8764-c9cfd82abcec-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:23:48.036579 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:48.036503 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" Oct 30 20:23:48.036579 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:48.036520 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6" event={"ID":"bcda848d-8ba6-4040-8ad7-f38ba20bf2df","Type":"ContainerDied","Data":"84cb8e2ac2d88db39d8f3d119f6e1b4d1daefc1f5d0bcb45a3c09bb33a4e3f36"} Oct 30 20:23:48.037075 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:48.036603 5078 scope.go:122] "RemoveContainer" containerID="81e940d14e1045ceacef695dc249aea455c42c6c5a46a7da3a8afd265a404b54" Oct 30 20:23:48.038988 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:48.038965 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g" Oct 30 20:23:48.039660 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:48.039517 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" Oct 30 20:23:48.039938 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:48.039917 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh" event={"ID":"8db14715-2a34-4191-8764-c9cfd82abcec","Type":"ContainerDied","Data":"0808873b57f7c14c332d6047c3a3557d6125baafd06a7c63b6d46efe637a8438"} Oct 30 20:23:48.049661 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:48.049640 5078 scope.go:122] "RemoveContainer" containerID="104f54fd2878b62ae351224b1c971f953a9f3949c7a875e9bb8751da8de63c3b" Oct 30 20:23:48.071407 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:48.066831 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6"] Oct 30 20:23:48.075154 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:48.075126 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-44kb6"] Oct 30 20:23:48.097057 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:48.097029 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh"] Oct 30 20:23:48.099142 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:48.099120 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-7tjhh"] Oct 30 20:23:48.106302 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:48.106281 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g"] Oct 30 20:23:48.111886 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:48.111866 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-5197ec-openshift-default-7b9b67ff59-h7z6g"] Oct 30 20:23:48.148667 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:48.148646 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:48.149083 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:48.149062 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:48.149628 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:48.149612 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:23:49.584839 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:49.584810 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8db14715-2a34-4191-8764-c9cfd82abcec" path="/var/lib/kubelet/pods/8db14715-2a34-4191-8764-c9cfd82abcec/volumes" Oct 30 20:23:49.585411 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:49.585394 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" path="/var/lib/kubelet/pods/a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc/volumes" Oct 30 20:23:49.585866 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:49.585853 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" path="/var/lib/kubelet/pods/bcda848d-8ba6-4040-8ad7-f38ba20bf2df/volumes" Oct 30 20:23:55.919358 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:55.919260 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt"] Oct 30 20:23:55.926098 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:23:55.925814 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659"] Oct 30 20:23:56.698727 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:23:56.698691 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:24:10.941309 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:10.941264 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" podUID="dc1bdfae-b781-4575-9c79-03bb9140822a" containerName="main" containerID="cri-o://8adb38cc36578dc4b2347a956970ba88d768c428729f670f88d3306e58d7d3cd" gracePeriod=45 Oct 30 20:24:10.947107 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:10.947041 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" podUID="aad73251-93ce-400c-a351-60b67fa78cdc" containerName="main" containerID="cri-o://dfc225e9b6a1637561798bc9ae69b241d430f9f7317410f419bdd60e06f5706d" gracePeriod=45 Oct 30 20:24:11.006727 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.006688 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" podUID="dc1bdfae-b781-4575-9c79-03bb9140822a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": dial tcp 10.132.0.95:8000: connect: connection refused" Oct 30 20:24:11.199129 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.199031 5078 generic.go:356] "Generic (PLEG): container finished" podID="dc1bdfae-b781-4575-9c79-03bb9140822a" containerID="8adb38cc36578dc4b2347a956970ba88d768c428729f670f88d3306e58d7d3cd" exitCode=0 Oct 30 20:24:11.199288 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.199197 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" event={"ID":"dc1bdfae-b781-4575-9c79-03bb9140822a","Type":"ContainerDied","Data":"8adb38cc36578dc4b2347a956970ba88d768c428729f670f88d3306e58d7d3cd"} Oct 30 20:24:11.204654 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.204626 5078 generic.go:356] "Generic (PLEG): container finished" podID="aad73251-93ce-400c-a351-60b67fa78cdc" containerID="dfc225e9b6a1637561798bc9ae69b241d430f9f7317410f419bdd60e06f5706d" exitCode=0 Oct 30 20:24:11.204776 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.204733 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" event={"ID":"aad73251-93ce-400c-a351-60b67fa78cdc","Type":"ContainerDied","Data":"dfc225e9b6a1637561798bc9ae69b241d430f9f7317410f419bdd60e06f5706d"} Oct 30 20:24:11.237791 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.237767 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:24:11.241312 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.241290 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:24:11.351094 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.351062 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aad73251-93ce-400c-a351-60b67fa78cdc-tls-certs\" (UniqueName: \"kubernetes.io/secret/aad73251-93ce-400c-a351-60b67fa78cdc-tls-certs\") pod \"aad73251-93ce-400c-a351-60b67fa78cdc\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " Oct 30 20:24:11.351271 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.351113 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-dshm\") pod \"dc1bdfae-b781-4575-9c79-03bb9140822a\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " Oct 30 20:24:11.351271 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.351193 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-tmp-dir\") pod \"aad73251-93ce-400c-a351-60b67fa78cdc\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " Oct 30 20:24:11.351271 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.351210 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-model-cache\") pod \"aad73251-93ce-400c-a351-60b67fa78cdc\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " Oct 30 20:24:11.351271 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.351238 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-dshm\" (UniqueName: \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-dshm\") pod \"aad73251-93ce-400c-a351-60b67fa78cdc\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " Oct 30 20:24:11.351271 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.351268 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dc1bdfae-b781-4575-9c79-03bb9140822a-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc1bdfae-b781-4575-9c79-03bb9140822a-tls-certs\") pod \"dc1bdfae-b781-4575-9c79-03bb9140822a\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " Oct 30 20:24:11.351566 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.351286 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-tmp-dir\") pod \"dc1bdfae-b781-4575-9c79-03bb9140822a\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " Oct 30 20:24:11.351566 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.351319 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-home\" (UniqueName: \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-home\") pod \"dc1bdfae-b781-4575-9c79-03bb9140822a\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " Oct 30 20:24:11.351566 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.351390 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-model-cache\") pod \"dc1bdfae-b781-4575-9c79-03bb9140822a\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " Oct 30 20:24:11.351566 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.351423 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dc1bdfae-b781-4575-9c79-03bb9140822a-kube-api-access-vggkp\" (UniqueName: \"kubernetes.io/projected/dc1bdfae-b781-4575-9c79-03bb9140822a-kube-api-access-vggkp\") pod \"dc1bdfae-b781-4575-9c79-03bb9140822a\" (UID: \"dc1bdfae-b781-4575-9c79-03bb9140822a\") " Oct 30 20:24:11.351566 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.351460 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aad73251-93ce-400c-a351-60b67fa78cdc-kube-api-access-rk8px\" (UniqueName: \"kubernetes.io/projected/aad73251-93ce-400c-a351-60b67fa78cdc-kube-api-access-rk8px\") pod \"aad73251-93ce-400c-a351-60b67fa78cdc\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " Oct 30 20:24:11.351566 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.351455 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-tmp-dir" pod "aad73251-93ce-400c-a351-60b67fa78cdc" (UID: "aad73251-93ce-400c-a351-60b67fa78cdc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:11.351566 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.351533 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-home\" (UniqueName: \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-home\") pod \"aad73251-93ce-400c-a351-60b67fa78cdc\" (UID: \"aad73251-93ce-400c-a351-60b67fa78cdc\") " Oct 30 20:24:11.351995 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.351694 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-home" pod "dc1bdfae-b781-4575-9c79-03bb9140822a" (UID: "dc1bdfae-b781-4575-9c79-03bb9140822a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:11.351995 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.351803 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-tmp-dir" pod "dc1bdfae-b781-4575-9c79-03bb9140822a" (UID: "dc1bdfae-b781-4575-9c79-03bb9140822a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:11.351995 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.351940 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-model-cache" pod "aad73251-93ce-400c-a351-60b67fa78cdc" (UID: "aad73251-93ce-400c-a351-60b67fa78cdc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:11.352152 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.352016 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-home" pod "aad73251-93ce-400c-a351-60b67fa78cdc" (UID: "aad73251-93ce-400c-a351-60b67fa78cdc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:11.352205 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.352176 5078 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-tmp-dir\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:11.352205 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.352198 5078 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-model-cache\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:11.352311 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.352214 5078 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-tmp-dir\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:11.352311 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.352229 5078 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-home\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:11.352311 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.352242 5078 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-home\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:11.352519 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.352492 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-model-cache" pod "dc1bdfae-b781-4575-9c79-03bb9140822a" (UID: "dc1bdfae-b781-4575-9c79-03bb9140822a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:11.354055 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.354027 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-dshm" pod "dc1bdfae-b781-4575-9c79-03bb9140822a" (UID: "dc1bdfae-b781-4575-9c79-03bb9140822a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:11.354181 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.354126 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc1bdfae-b781-4575-9c79-03bb9140822a-tls-certs" pod "dc1bdfae-b781-4575-9c79-03bb9140822a" (UID: "dc1bdfae-b781-4575-9c79-03bb9140822a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:24:11.354253 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.354206 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aad73251-93ce-400c-a351-60b67fa78cdc-tls-certs" pod "aad73251-93ce-400c-a351-60b67fa78cdc" (UID: "aad73251-93ce-400c-a351-60b67fa78cdc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:24:11.354368 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.354321 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc1bdfae-b781-4575-9c79-03bb9140822a-kube-api-access-vggkp" pod "dc1bdfae-b781-4575-9c79-03bb9140822a" (UID: "dc1bdfae-b781-4575-9c79-03bb9140822a"). InnerVolumeSpecName "kube-api-access-vggkp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:24:11.354499 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.354480 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-dshm" pod "aad73251-93ce-400c-a351-60b67fa78cdc" (UID: "aad73251-93ce-400c-a351-60b67fa78cdc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:11.354572 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.354560 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aad73251-93ce-400c-a351-60b67fa78cdc-kube-api-access-rk8px" pod "aad73251-93ce-400c-a351-60b67fa78cdc" (UID: "aad73251-93ce-400c-a351-60b67fa78cdc"). InnerVolumeSpecName "kube-api-access-rk8px". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:24:11.453138 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.453056 5078 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aad73251-93ce-400c-a351-60b67fa78cdc-dshm\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:11.453138 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.453088 5078 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc1bdfae-b781-4575-9c79-03bb9140822a-tls-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:11.453138 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.453096 5078 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-model-cache\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:11.453138 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.453106 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vggkp\" (UniqueName: \"kubernetes.io/projected/dc1bdfae-b781-4575-9c79-03bb9140822a-kube-api-access-vggkp\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:11.453138 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.453116 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rk8px\" (UniqueName: \"kubernetes.io/projected/aad73251-93ce-400c-a351-60b67fa78cdc-kube-api-access-rk8px\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:11.453138 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.453124 5078 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aad73251-93ce-400c-a351-60b67fa78cdc-tls-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:11.453138 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:11.453133 5078 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc1bdfae-b781-4575-9c79-03bb9140822a-dshm\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:12.212265 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:12.212190 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" Oct 30 20:24:12.212265 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:12.212214 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt" event={"ID":"dc1bdfae-b781-4575-9c79-03bb9140822a","Type":"ContainerDied","Data":"6dc3544ddecff1e6e16fad8dbc30aa77ac36bc9327e0b7953106cf1318ee675a"} Oct 30 20:24:12.212823 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:12.212274 5078 scope.go:122] "RemoveContainer" containerID="8adb38cc36578dc4b2347a956970ba88d768c428729f670f88d3306e58d7d3cd" Oct 30 20:24:12.213812 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:12.213786 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" event={"ID":"aad73251-93ce-400c-a351-60b67fa78cdc","Type":"ContainerDied","Data":"4e6d357fe3022f96d74e836dd1a801035c87e00c5f63de445307ced1e2b20c04"} Oct 30 20:24:12.213812 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:12.213806 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659" Oct 30 20:24:12.222538 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:12.222516 5078 scope.go:122] "RemoveContainer" containerID="dfc225e9b6a1637561798bc9ae69b241d430f9f7317410f419bdd60e06f5706d" Oct 30 20:24:12.232167 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:12.232141 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659"] Oct 30 20:24:12.237145 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:12.237124 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-124fd1/distinct-w3-124fd1-kserve-5895b84956-7t659"] Oct 30 20:24:12.257985 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:12.257963 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt"] Oct 30 20:24:12.263510 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:12.263491 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-124fd1/distinct-2-w3-124fd1-kserve-646d7b7d95-2wbjt"] Oct 30 20:24:13.584991 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:13.584960 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aad73251-93ce-400c-a351-60b67fa78cdc" path="/var/lib/kubelet/pods/aad73251-93ce-400c-a351-60b67fa78cdc/volumes" Oct 30 20:24:13.585458 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:13.585442 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dc1bdfae-b781-4575-9c79-03bb9140822a" path="/var/lib/kubelet/pods/dc1bdfae-b781-4575-9c79-03bb9140822a/volumes" Oct 30 20:24:17.229646 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:17.229565 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s"] Oct 30 20:24:17.231369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:17.231320 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" podUID="5fee13d2-5043-487c-8940-8fb5e4682083" containerName="maas-api" containerID="cri-o://7fa904ea95512ea330ad5982d6a749737cd637cee07a8cc63fffbe926aeace73" gracePeriod=30 Oct 30 20:24:17.603713 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:17.603684 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" Oct 30 20:24:17.764598 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:17.764562 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5fee13d2-5043-487c-8940-8fb5e4682083-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fee13d2-5043-487c-8940-8fb5e4682083-openshift-service-ca\") pod \"5fee13d2-5043-487c-8940-8fb5e4682083\" (UID: \"5fee13d2-5043-487c-8940-8fb5e4682083\") " Oct 30 20:24:17.764776 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:17.764616 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5fee13d2-5043-487c-8940-8fb5e4682083-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fee13d2-5043-487c-8940-8fb5e4682083-maas-api-tls\") pod \"5fee13d2-5043-487c-8940-8fb5e4682083\" (UID: \"5fee13d2-5043-487c-8940-8fb5e4682083\") " Oct 30 20:24:17.764776 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:17.764661 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5fee13d2-5043-487c-8940-8fb5e4682083-kube-api-access-gqsh5\" (UniqueName: \"kubernetes.io/projected/5fee13d2-5043-487c-8940-8fb5e4682083-kube-api-access-gqsh5\") pod \"5fee13d2-5043-487c-8940-8fb5e4682083\" (UID: \"5fee13d2-5043-487c-8940-8fb5e4682083\") " Oct 30 20:24:17.764776 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:17.764743 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5fee13d2-5043-487c-8940-8fb5e4682083-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fee13d2-5043-487c-8940-8fb5e4682083-metrics-certs\") pod \"5fee13d2-5043-487c-8940-8fb5e4682083\" (UID: \"5fee13d2-5043-487c-8940-8fb5e4682083\") " Oct 30 20:24:17.764974 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:17.764957 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fee13d2-5043-487c-8940-8fb5e4682083-openshift-service-ca" pod "5fee13d2-5043-487c-8940-8fb5e4682083" (UID: "5fee13d2-5043-487c-8940-8fb5e4682083"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:24:17.765184 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:17.765153 5078 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fee13d2-5043-487c-8940-8fb5e4682083-openshift-service-ca\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:17.767045 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:17.767011 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fee13d2-5043-487c-8940-8fb5e4682083-metrics-certs" pod "5fee13d2-5043-487c-8940-8fb5e4682083" (UID: "5fee13d2-5043-487c-8940-8fb5e4682083"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:24:17.767323 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:17.767302 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fee13d2-5043-487c-8940-8fb5e4682083-maas-api-tls" pod "5fee13d2-5043-487c-8940-8fb5e4682083" (UID: "5fee13d2-5043-487c-8940-8fb5e4682083"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:24:17.767412 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:17.767361 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fee13d2-5043-487c-8940-8fb5e4682083-kube-api-access-gqsh5" pod "5fee13d2-5043-487c-8940-8fb5e4682083" (UID: "5fee13d2-5043-487c-8940-8fb5e4682083"). InnerVolumeSpecName "kube-api-access-gqsh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:24:17.866505 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:17.866423 5078 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fee13d2-5043-487c-8940-8fb5e4682083-maas-api-tls\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:17.866505 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:17.866453 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqsh5\" (UniqueName: \"kubernetes.io/projected/5fee13d2-5043-487c-8940-8fb5e4682083-kube-api-access-gqsh5\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:17.866505 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:17.866466 5078 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fee13d2-5043-487c-8940-8fb5e4682083-metrics-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:18.254325 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:18.254233 5078 generic.go:356] "Generic (PLEG): container finished" podID="5fee13d2-5043-487c-8940-8fb5e4682083" containerID="7fa904ea95512ea330ad5982d6a749737cd637cee07a8cc63fffbe926aeace73" exitCode=0 Oct 30 20:24:18.254325 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:18.254288 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" Oct 30 20:24:18.254921 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:18.254290 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" event={"ID":"5fee13d2-5043-487c-8940-8fb5e4682083","Type":"ContainerDied","Data":"7fa904ea95512ea330ad5982d6a749737cd637cee07a8cc63fffbe926aeace73"} Oct 30 20:24:18.254921 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:18.254403 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s" event={"ID":"5fee13d2-5043-487c-8940-8fb5e4682083","Type":"ContainerDied","Data":"92a9b42541dbfedeee9fc73fac985ee89fa25b810bfef8a27081dea8e815360a"} Oct 30 20:24:18.254921 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:18.254425 5078 scope.go:122] "RemoveContainer" containerID="7fa904ea95512ea330ad5982d6a749737cd637cee07a8cc63fffbe926aeace73" Oct 30 20:24:18.264687 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:18.264668 5078 scope.go:122] "RemoveContainer" containerID="7fa904ea95512ea330ad5982d6a749737cd637cee07a8cc63fffbe926aeace73" Oct 30 20:24:18.264957 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:24:18.264940 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fa904ea95512ea330ad5982d6a749737cd637cee07a8cc63fffbe926aeace73\": container with ID starting with 7fa904ea95512ea330ad5982d6a749737cd637cee07a8cc63fffbe926aeace73 not found: ID does not exist" containerID="7fa904ea95512ea330ad5982d6a749737cd637cee07a8cc63fffbe926aeace73" Oct 30 20:24:18.264993 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:18.264973 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fa904ea95512ea330ad5982d6a749737cd637cee07a8cc63fffbe926aeace73"} err="failed to get container status \"7fa904ea95512ea330ad5982d6a749737cd637cee07a8cc63fffbe926aeace73\": rpc error: code = NotFound desc = could not find container \"7fa904ea95512ea330ad5982d6a749737cd637cee07a8cc63fffbe926aeace73\": container with ID starting with 7fa904ea95512ea330ad5982d6a749737cd637cee07a8cc63fffbe926aeace73 not found: ID does not exist" Oct 30 20:24:18.278679 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:18.278654 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s"] Oct 30 20:24:18.283170 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:18.283148 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-124fd1-68bbd4fcc7-4v44s"] Oct 30 20:24:18.319805 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:18.319767 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6"] Oct 30 20:24:18.320069 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:18.320043 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" podUID="585bc541-1d99-4500-80f2-4f224c638192" containerName="istio-proxy" containerID="cri-o://9d41b13678f4673a1379811be2a9ba9dd141de2179e64de1004e9cb6366722ed" gracePeriod=30 Oct 30 20:24:18.322565 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:18.322539 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr"] Oct 30 20:24:18.322789 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:18.322766 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" podUID="0abd4e01-5d55-4e34-976a-8e6e7e1252ad" containerName="istio-proxy" containerID="cri-o://42021895e28fd8ebb50d94f17043ad48099bc60e6dda35ec34a6ebed05b7d125" gracePeriod=30 Oct 30 20:24:19.584684 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:19.584650 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5fee13d2-5043-487c-8940-8fb5e4682083" path="/var/lib/kubelet/pods/5fee13d2-5043-487c-8940-8fb5e4682083/volumes" Oct 30 20:24:23.598922 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.598896 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:24:23.602145 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.602122 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:24:23.625710 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.625685 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-workload-certs\") pod \"585bc541-1d99-4500-80f2-4f224c638192\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " Oct 30 20:24:23.625847 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.625717 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/585bc541-1d99-4500-80f2-4f224c638192-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/585bc541-1d99-4500-80f2-4f224c638192-istio-podinfo\") pod \"585bc541-1d99-4500-80f2-4f224c638192\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " Oct 30 20:24:23.625847 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.625742 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-credential-socket\") pod \"585bc541-1d99-4500-80f2-4f224c638192\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " Oct 30 20:24:23.625847 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.625766 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-data\") pod \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " Oct 30 20:24:23.626035 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.625876 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istiod-ca-cert\") pod \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " Oct 30 20:24:23.626035 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.625913 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-envoy\") pod \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " Oct 30 20:24:23.626035 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.625952 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-istio-envoy\") pod \"585bc541-1d99-4500-80f2-4f224c638192\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " Oct 30 20:24:23.626035 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.625965 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-workload-certs" pod "585bc541-1d99-4500-80f2-4f224c638192" (UID: "585bc541-1d99-4500-80f2-4f224c638192"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:23.626035 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.625979 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-data" pod "0abd4e01-5d55-4e34-976a-8e6e7e1252ad" (UID: "0abd4e01-5d55-4e34-976a-8e6e7e1252ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:23.626035 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.625989 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-podinfo\") pod \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " Oct 30 20:24:23.626384 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.626037 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-workload-certs\") pod \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " Oct 30 20:24:23.626384 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.626074 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-credential-socket" pod "585bc541-1d99-4500-80f2-4f224c638192" (UID: "585bc541-1d99-4500-80f2-4f224c638192"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:23.626384 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.626082 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-kube-api-access-rw5cs\" (UniqueName: \"kubernetes.io/projected/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-kube-api-access-rw5cs\") pod \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " Oct 30 20:24:23.626384 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.626173 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-token\" (UniqueName: \"kubernetes.io/projected/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-token\") pod \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " Oct 30 20:24:23.626384 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.626214 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-credential-socket\") pod \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " Oct 30 20:24:23.626384 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.626246 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-workload-socket\") pod \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\" (UID: \"0abd4e01-5d55-4e34-976a-8e6e7e1252ad\") " Oct 30 20:24:23.626384 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.626276 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-istio-data\") pod \"585bc541-1d99-4500-80f2-4f224c638192\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " Oct 30 20:24:23.626384 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.626314 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/585bc541-1d99-4500-80f2-4f224c638192-kube-api-access-v7m6v\" (UniqueName: \"kubernetes.io/projected/585bc541-1d99-4500-80f2-4f224c638192-kube-api-access-v7m6v\") pod \"585bc541-1d99-4500-80f2-4f224c638192\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " Oct 30 20:24:23.626384 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.626385 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/585bc541-1d99-4500-80f2-4f224c638192-istio-token\" (UniqueName: \"kubernetes.io/projected/585bc541-1d99-4500-80f2-4f224c638192-istio-token\") pod \"585bc541-1d99-4500-80f2-4f224c638192\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " Oct 30 20:24:23.626830 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.626380 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-workload-certs" pod "0abd4e01-5d55-4e34-976a-8e6e7e1252ad" (UID: "0abd4e01-5d55-4e34-976a-8e6e7e1252ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:23.626830 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.626452 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/585bc541-1d99-4500-80f2-4f224c638192-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/585bc541-1d99-4500-80f2-4f224c638192-istiod-ca-cert\") pod \"585bc541-1d99-4500-80f2-4f224c638192\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " Oct 30 20:24:23.626830 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.626492 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-workload-socket\") pod \"585bc541-1d99-4500-80f2-4f224c638192\" (UID: \"585bc541-1d99-4500-80f2-4f224c638192\") " Oct 30 20:24:23.626830 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.626684 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-istio-data" pod "585bc541-1d99-4500-80f2-4f224c638192" (UID: "585bc541-1d99-4500-80f2-4f224c638192"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:23.627017 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.626948 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-credential-socket" pod "0abd4e01-5d55-4e34-976a-8e6e7e1252ad" (UID: "0abd4e01-5d55-4e34-976a-8e6e7e1252ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:23.627017 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.626944 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istiod-ca-cert" pod "0abd4e01-5d55-4e34-976a-8e6e7e1252ad" (UID: "0abd4e01-5d55-4e34-976a-8e6e7e1252ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:24:23.627017 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.626957 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:23.627017 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.627008 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:23.627230 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.627031 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:23.627230 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.627048 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:23.627230 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.627063 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:23.627230 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.627150 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-workload-socket" pod "0abd4e01-5d55-4e34-976a-8e6e7e1252ad" (UID: "0abd4e01-5d55-4e34-976a-8e6e7e1252ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:23.627475 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.627348 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-workload-socket" pod "585bc541-1d99-4500-80f2-4f224c638192" (UID: "585bc541-1d99-4500-80f2-4f224c638192"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:23.627475 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.627411 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/585bc541-1d99-4500-80f2-4f224c638192-istiod-ca-cert" pod "585bc541-1d99-4500-80f2-4f224c638192" (UID: "585bc541-1d99-4500-80f2-4f224c638192"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:24:23.628697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.628557 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-istio-envoy" pod "585bc541-1d99-4500-80f2-4f224c638192" (UID: "585bc541-1d99-4500-80f2-4f224c638192"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:23.628697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.628644 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/585bc541-1d99-4500-80f2-4f224c638192-istio-podinfo" pod "585bc541-1d99-4500-80f2-4f224c638192" (UID: "585bc541-1d99-4500-80f2-4f224c638192"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:24:23.628697 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.628672 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-kube-api-access-rw5cs" pod "0abd4e01-5d55-4e34-976a-8e6e7e1252ad" (UID: "0abd4e01-5d55-4e34-976a-8e6e7e1252ad"). InnerVolumeSpecName "kube-api-access-rw5cs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:24:23.629037 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.629011 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-envoy" pod "0abd4e01-5d55-4e34-976a-8e6e7e1252ad" (UID: "0abd4e01-5d55-4e34-976a-8e6e7e1252ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:23.629121 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.629099 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/585bc541-1d99-4500-80f2-4f224c638192-kube-api-access-v7m6v" pod "585bc541-1d99-4500-80f2-4f224c638192" (UID: "585bc541-1d99-4500-80f2-4f224c638192"). InnerVolumeSpecName "kube-api-access-v7m6v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:24:23.629412 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.629390 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/585bc541-1d99-4500-80f2-4f224c638192-istio-token" pod "585bc541-1d99-4500-80f2-4f224c638192" (UID: "585bc541-1d99-4500-80f2-4f224c638192"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:24:23.629802 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.629785 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-token" pod "0abd4e01-5d55-4e34-976a-8e6e7e1252ad" (UID: "0abd4e01-5d55-4e34-976a-8e6e7e1252ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:24:23.629961 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.629940 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-podinfo" pod "0abd4e01-5d55-4e34-976a-8e6e7e1252ad" (UID: "0abd4e01-5d55-4e34-976a-8e6e7e1252ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:24:23.727822 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.727785 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/585bc541-1d99-4500-80f2-4f224c638192-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:23.727822 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.727817 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:23.727822 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.727827 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:23.728055 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.727836 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:23.728055 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.727845 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:23.728055 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.727854 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rw5cs\" (UniqueName: \"kubernetes.io/projected/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-kube-api-access-rw5cs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:23.728055 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.727863 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:23.728055 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.727874 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:23.728055 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.727882 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0abd4e01-5d55-4e34-976a-8e6e7e1252ad-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:23.728055 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.727890 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7m6v\" (UniqueName: \"kubernetes.io/projected/585bc541-1d99-4500-80f2-4f224c638192-kube-api-access-v7m6v\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:23.728055 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.727899 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/585bc541-1d99-4500-80f2-4f224c638192-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:23.728055 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.727907 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/585bc541-1d99-4500-80f2-4f224c638192-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:23.728055 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:23.727915 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/585bc541-1d99-4500-80f2-4f224c638192-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:24.288217 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.288184 5078 generic.go:356] "Generic (PLEG): container finished" podID="0abd4e01-5d55-4e34-976a-8e6e7e1252ad" containerID="42021895e28fd8ebb50d94f17043ad48099bc60e6dda35ec34a6ebed05b7d125" exitCode=0 Oct 30 20:24:24.288450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.288231 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" Oct 30 20:24:24.288450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.288271 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" event={"ID":"0abd4e01-5d55-4e34-976a-8e6e7e1252ad","Type":"ContainerDied","Data":"42021895e28fd8ebb50d94f17043ad48099bc60e6dda35ec34a6ebed05b7d125"} Oct 30 20:24:24.288450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.288322 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr" event={"ID":"0abd4e01-5d55-4e34-976a-8e6e7e1252ad","Type":"ContainerDied","Data":"db3a1e6790ec50a5feba205799b415a47d8a0d2000863152db752e5c1d7eaefc"} Oct 30 20:24:24.288450 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.288377 5078 scope.go:122] "RemoveContainer" containerID="42021895e28fd8ebb50d94f17043ad48099bc60e6dda35ec34a6ebed05b7d125" Oct 30 20:24:24.289831 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.289811 5078 generic.go:356] "Generic (PLEG): container finished" podID="585bc541-1d99-4500-80f2-4f224c638192" containerID="9d41b13678f4673a1379811be2a9ba9dd141de2179e64de1004e9cb6366722ed" exitCode=0 Oct 30 20:24:24.289951 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.289840 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" event={"ID":"585bc541-1d99-4500-80f2-4f224c638192","Type":"ContainerDied","Data":"9d41b13678f4673a1379811be2a9ba9dd141de2179e64de1004e9cb6366722ed"} Oct 30 20:24:24.289951 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.289902 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" event={"ID":"585bc541-1d99-4500-80f2-4f224c638192","Type":"ContainerDied","Data":"37611252e0320c0f3284fcaff031a7defc5a1b8f6c20aff00c6ddc8d85f8079b"} Oct 30 20:24:24.289951 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.289857 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6" Oct 30 20:24:24.300545 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.300527 5078 scope.go:122] "RemoveContainer" containerID="42021895e28fd8ebb50d94f17043ad48099bc60e6dda35ec34a6ebed05b7d125" Oct 30 20:24:24.300824 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:24:24.300805 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42021895e28fd8ebb50d94f17043ad48099bc60e6dda35ec34a6ebed05b7d125\": container with ID starting with 42021895e28fd8ebb50d94f17043ad48099bc60e6dda35ec34a6ebed05b7d125 not found: ID does not exist" containerID="42021895e28fd8ebb50d94f17043ad48099bc60e6dda35ec34a6ebed05b7d125" Oct 30 20:24:24.300889 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.300831 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42021895e28fd8ebb50d94f17043ad48099bc60e6dda35ec34a6ebed05b7d125"} err="failed to get container status \"42021895e28fd8ebb50d94f17043ad48099bc60e6dda35ec34a6ebed05b7d125\": rpc error: code = NotFound desc = could not find container \"42021895e28fd8ebb50d94f17043ad48099bc60e6dda35ec34a6ebed05b7d125\": container with ID starting with 42021895e28fd8ebb50d94f17043ad48099bc60e6dda35ec34a6ebed05b7d125 not found: ID does not exist" Oct 30 20:24:24.300889 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.300847 5078 scope.go:122] "RemoveContainer" containerID="9d41b13678f4673a1379811be2a9ba9dd141de2179e64de1004e9cb6366722ed" Oct 30 20:24:24.311987 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.311906 5078 scope.go:122] "RemoveContainer" containerID="9d41b13678f4673a1379811be2a9ba9dd141de2179e64de1004e9cb6366722ed" Oct 30 20:24:24.313100 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:24:24.312495 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d41b13678f4673a1379811be2a9ba9dd141de2179e64de1004e9cb6366722ed\": container with ID starting with 9d41b13678f4673a1379811be2a9ba9dd141de2179e64de1004e9cb6366722ed not found: ID does not exist" containerID="9d41b13678f4673a1379811be2a9ba9dd141de2179e64de1004e9cb6366722ed" Oct 30 20:24:24.313100 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.312526 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d41b13678f4673a1379811be2a9ba9dd141de2179e64de1004e9cb6366722ed"} err="failed to get container status \"9d41b13678f4673a1379811be2a9ba9dd141de2179e64de1004e9cb6366722ed\": rpc error: code = NotFound desc = could not find container \"9d41b13678f4673a1379811be2a9ba9dd141de2179e64de1004e9cb6366722ed\": container with ID starting with 9d41b13678f4673a1379811be2a9ba9dd141de2179e64de1004e9cb6366722ed not found: ID does not exist" Oct 30 20:24:24.315077 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.315057 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr"] Oct 30 20:24:24.323365 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.323316 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-g8slr"] Oct 30 20:24:24.336081 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.336060 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6"] Oct 30 20:24:24.343765 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.343736 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-k7hx6"] Oct 30 20:24:24.834864 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.834828 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk"] Oct 30 20:24:24.835260 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.835082 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" podUID="a27e1ae4-d40d-4dc8-8d6f-588f38901365" containerName="istio-proxy" containerID="cri-o://82f10f7e259f4a8b3104c6e13fd1d184f1aaea68ced639c7b029cd287441a348" gracePeriod=30 Oct 30 20:24:24.849592 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.849560 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6"] Oct 30 20:24:24.849820 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:24.849795 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" podUID="f638d7bc-a31f-4e99-8c8e-a78f45642b59" containerName="istio-proxy" containerID="cri-o://11c20ba7399bfe91e3683ad33a59fbaebf9f6c946c04ba470aa1db58f647572a" gracePeriod=30 Oct 30 20:24:25.584264 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:25.584235 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0abd4e01-5d55-4e34-976a-8e6e7e1252ad" path="/var/lib/kubelet/pods/0abd4e01-5d55-4e34-976a-8e6e7e1252ad/volumes" Oct 30 20:24:25.584681 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:25.584667 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="585bc541-1d99-4500-80f2-4f224c638192" path="/var/lib/kubelet/pods/585bc541-1d99-4500-80f2-4f224c638192/volumes" Oct 30 20:24:26.697993 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:24:26.697958 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:24:27.560813 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:27.560776 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76fb996bcf-c5tbp"] Oct 30 20:24:27.561025 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:27.560982 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-76fb996bcf-c5tbp" podUID="12babe67-4721-4422-aa81-3cf403e5c2c9" containerName="manager" containerID="cri-o://5a8cfd7b8a195aa27ee8b572242047a6670f95d6c9d264d400a9dd8115cc7fb2" gracePeriod=30 Oct 30 20:24:27.918808 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:27.918784 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb996bcf-c5tbp" Oct 30 20:24:27.972685 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:27.972651 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/12babe67-4721-4422-aa81-3cf403e5c2c9-metrics-certs\" (UniqueName: \"kubernetes.io/secret/12babe67-4721-4422-aa81-3cf403e5c2c9-metrics-certs\") pod \"12babe67-4721-4422-aa81-3cf403e5c2c9\" (UID: \"12babe67-4721-4422-aa81-3cf403e5c2c9\") " Oct 30 20:24:27.972873 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:27.972720 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/12babe67-4721-4422-aa81-3cf403e5c2c9-webhook-cert\" (UniqueName: \"kubernetes.io/secret/12babe67-4721-4422-aa81-3cf403e5c2c9-webhook-cert\") pod \"12babe67-4721-4422-aa81-3cf403e5c2c9\" (UID: \"12babe67-4721-4422-aa81-3cf403e5c2c9\") " Oct 30 20:24:27.972873 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:27.972800 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/12babe67-4721-4422-aa81-3cf403e5c2c9-kube-api-access-25xxh\" (UniqueName: \"kubernetes.io/projected/12babe67-4721-4422-aa81-3cf403e5c2c9-kube-api-access-25xxh\") pod \"12babe67-4721-4422-aa81-3cf403e5c2c9\" (UID: \"12babe67-4721-4422-aa81-3cf403e5c2c9\") " Oct 30 20:24:27.974903 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:27.974869 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12babe67-4721-4422-aa81-3cf403e5c2c9-webhook-cert" pod "12babe67-4721-4422-aa81-3cf403e5c2c9" (UID: "12babe67-4721-4422-aa81-3cf403e5c2c9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:24:27.975158 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:27.975128 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12babe67-4721-4422-aa81-3cf403e5c2c9-kube-api-access-25xxh" pod "12babe67-4721-4422-aa81-3cf403e5c2c9" (UID: "12babe67-4721-4422-aa81-3cf403e5c2c9"). InnerVolumeSpecName "kube-api-access-25xxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:24:27.975248 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:27.975220 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12babe67-4721-4422-aa81-3cf403e5c2c9-metrics-certs" pod "12babe67-4721-4422-aa81-3cf403e5c2c9" (UID: "12babe67-4721-4422-aa81-3cf403e5c2c9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:24:28.073951 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:28.073921 5078 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12babe67-4721-4422-aa81-3cf403e5c2c9-metrics-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:28.073951 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:28.073949 5078 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12babe67-4721-4422-aa81-3cf403e5c2c9-webhook-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:28.074152 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:28.073959 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25xxh\" (UniqueName: \"kubernetes.io/projected/12babe67-4721-4422-aa81-3cf403e5c2c9-kube-api-access-25xxh\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:28.316002 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:28.315962 5078 generic.go:356] "Generic (PLEG): container finished" podID="12babe67-4721-4422-aa81-3cf403e5c2c9" containerID="5a8cfd7b8a195aa27ee8b572242047a6670f95d6c9d264d400a9dd8115cc7fb2" exitCode=0 Oct 30 20:24:28.316221 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:28.316010 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb996bcf-c5tbp" Oct 30 20:24:28.316221 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:28.316044 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb996bcf-c5tbp" event={"ID":"12babe67-4721-4422-aa81-3cf403e5c2c9","Type":"ContainerDied","Data":"5a8cfd7b8a195aa27ee8b572242047a6670f95d6c9d264d400a9dd8115cc7fb2"} Oct 30 20:24:28.316221 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:28.316100 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb996bcf-c5tbp" event={"ID":"12babe67-4721-4422-aa81-3cf403e5c2c9","Type":"ContainerDied","Data":"2bcbb1da2f609f736e2d71141847d24f854d8cdc24d495d38381d83587475a13"} Oct 30 20:24:28.316221 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:28.316123 5078 scope.go:122] "RemoveContainer" containerID="5a8cfd7b8a195aa27ee8b572242047a6670f95d6c9d264d400a9dd8115cc7fb2" Oct 30 20:24:28.326892 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:28.326872 5078 scope.go:122] "RemoveContainer" containerID="5a8cfd7b8a195aa27ee8b572242047a6670f95d6c9d264d400a9dd8115cc7fb2" Oct 30 20:24:28.327150 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:24:28.327132 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a8cfd7b8a195aa27ee8b572242047a6670f95d6c9d264d400a9dd8115cc7fb2\": container with ID starting with 5a8cfd7b8a195aa27ee8b572242047a6670f95d6c9d264d400a9dd8115cc7fb2 not found: ID does not exist" containerID="5a8cfd7b8a195aa27ee8b572242047a6670f95d6c9d264d400a9dd8115cc7fb2" Oct 30 20:24:28.327251 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:28.327158 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a8cfd7b8a195aa27ee8b572242047a6670f95d6c9d264d400a9dd8115cc7fb2"} err="failed to get container status \"5a8cfd7b8a195aa27ee8b572242047a6670f95d6c9d264d400a9dd8115cc7fb2\": rpc error: code = NotFound desc = could not find container \"5a8cfd7b8a195aa27ee8b572242047a6670f95d6c9d264d400a9dd8115cc7fb2\": container with ID starting with 5a8cfd7b8a195aa27ee8b572242047a6670f95d6c9d264d400a9dd8115cc7fb2 not found: ID does not exist" Oct 30 20:24:28.342781 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:28.342752 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76fb996bcf-c5tbp"] Oct 30 20:24:28.345949 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:28.345919 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76fb996bcf-c5tbp"] Oct 30 20:24:29.092093 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092059 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76fb996bcf-88qtg"] Oct 30 20:24:29.092558 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092543 5078 cpu_manager.go:414] "containerMap: removing container" podUID="8db14715-2a34-4191-8764-c9cfd82abcec" containerName="istio-proxy" Oct 30 20:24:29.092603 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092559 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8db14715-2a34-4191-8764-c9cfd82abcec" containerName="istio-proxy" Oct 30 20:24:29.092603 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092567 5078 cpu_manager.go:414] "containerMap: removing container" podUID="12babe67-4721-4422-aa81-3cf403e5c2c9" containerName="manager" Oct 30 20:24:29.092603 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092573 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="12babe67-4721-4422-aa81-3cf403e5c2c9" containerName="manager" Oct 30 20:24:29.092603 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092580 5078 cpu_manager.go:414] "containerMap: removing container" podUID="5fee13d2-5043-487c-8940-8fb5e4682083" containerName="maas-api" Oct 30 20:24:29.092603 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092586 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5fee13d2-5043-487c-8940-8fb5e4682083" containerName="maas-api" Oct 30 20:24:29.092603 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092596 5078 cpu_manager.go:414] "containerMap: removing container" podUID="aad73251-93ce-400c-a351-60b67fa78cdc" containerName="main" Oct 30 20:24:29.092603 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092601 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aad73251-93ce-400c-a351-60b67fa78cdc" containerName="main" Oct 30 20:24:29.092811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092630 5078 cpu_manager.go:414] "containerMap: removing container" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" Oct 30 20:24:29.092811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092636 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" Oct 30 20:24:29.092811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092650 5078 cpu_manager.go:414] "containerMap: removing container" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" Oct 30 20:24:29.092811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092655 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" Oct 30 20:24:29.092811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092662 5078 cpu_manager.go:414] "containerMap: removing container" podUID="8db14715-2a34-4191-8764-c9cfd82abcec" containerName="istio-proxy" Oct 30 20:24:29.092811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092668 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8db14715-2a34-4191-8764-c9cfd82abcec" containerName="istio-proxy" Oct 30 20:24:29.092811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092679 5078 cpu_manager.go:414] "containerMap: removing container" podUID="0abd4e01-5d55-4e34-976a-8e6e7e1252ad" containerName="istio-proxy" Oct 30 20:24:29.092811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092684 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0abd4e01-5d55-4e34-976a-8e6e7e1252ad" containerName="istio-proxy" Oct 30 20:24:29.092811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092698 5078 cpu_manager.go:414] "containerMap: removing container" podUID="dc1bdfae-b781-4575-9c79-03bb9140822a" containerName="main" Oct 30 20:24:29.092811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092702 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dc1bdfae-b781-4575-9c79-03bb9140822a" containerName="main" Oct 30 20:24:29.092811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092710 5078 cpu_manager.go:414] "containerMap: removing container" podUID="585bc541-1d99-4500-80f2-4f224c638192" containerName="istio-proxy" Oct 30 20:24:29.092811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092715 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="585bc541-1d99-4500-80f2-4f224c638192" containerName="istio-proxy" Oct 30 20:24:29.092811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092775 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="0abd4e01-5d55-4e34-976a-8e6e7e1252ad" containerName="istio-proxy" Oct 30 20:24:29.092811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092785 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="dc1bdfae-b781-4575-9c79-03bb9140822a" containerName="main" Oct 30 20:24:29.092811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092792 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="585bc541-1d99-4500-80f2-4f224c638192" containerName="istio-proxy" Oct 30 20:24:29.092811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092800 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="8db14715-2a34-4191-8764-c9cfd82abcec" containerName="istio-proxy" Oct 30 20:24:29.092811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092805 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="12babe67-4721-4422-aa81-3cf403e5c2c9" containerName="manager" Oct 30 20:24:29.092811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092810 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="5fee13d2-5043-487c-8940-8fb5e4682083" containerName="maas-api" Oct 30 20:24:29.092811 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092816 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="aad73251-93ce-400c-a351-60b67fa78cdc" containerName="main" Oct 30 20:24:29.093374 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092823 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="bcda848d-8ba6-4040-8ad7-f38ba20bf2df" containerName="istio-proxy" Oct 30 20:24:29.093374 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092830 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="a1ffd906-78ce-4aa6-aa8f-6a65d6d963bc" containerName="istio-proxy" Oct 30 20:24:29.093374 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.092836 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="8db14715-2a34-4191-8764-c9cfd82abcec" containerName="istio-proxy" Oct 30 20:24:29.097296 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.097275 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb996bcf-88qtg" Oct 30 20:24:29.102674 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.102651 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Oct 30 20:24:29.102674 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.102652 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Oct 30 20:24:29.102804 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.102689 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c46xw\"" Oct 30 20:24:29.104802 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.104784 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Oct 30 20:24:29.110734 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.110707 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76fb996bcf-88qtg"] Oct 30 20:24:29.186903 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.186868 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/693dcc38-e6d0-411b-9bcd-9e294283afb2-metrics-certs\") pod \"maas-controller-76fb996bcf-88qtg\" (UID: \"693dcc38-e6d0-411b-9bcd-9e294283afb2\") " pod="opendatahub/maas-controller-76fb996bcf-88qtg" Oct 30 20:24:29.186903 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.186915 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8scn5\" (UniqueName: \"kubernetes.io/projected/693dcc38-e6d0-411b-9bcd-9e294283afb2-kube-api-access-8scn5\") pod \"maas-controller-76fb996bcf-88qtg\" (UID: \"693dcc38-e6d0-411b-9bcd-9e294283afb2\") " pod="opendatahub/maas-controller-76fb996bcf-88qtg" Oct 30 20:24:29.187194 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.186936 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/693dcc38-e6d0-411b-9bcd-9e294283afb2-webhook-cert\") pod \"maas-controller-76fb996bcf-88qtg\" (UID: \"693dcc38-e6d0-411b-9bcd-9e294283afb2\") " pod="opendatahub/maas-controller-76fb996bcf-88qtg" Oct 30 20:24:29.288000 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.287962 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8scn5\" (UniqueName: \"kubernetes.io/projected/693dcc38-e6d0-411b-9bcd-9e294283afb2-kube-api-access-8scn5\") pod \"maas-controller-76fb996bcf-88qtg\" (UID: \"693dcc38-e6d0-411b-9bcd-9e294283afb2\") " pod="opendatahub/maas-controller-76fb996bcf-88qtg" Oct 30 20:24:29.288213 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.288019 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/693dcc38-e6d0-411b-9bcd-9e294283afb2-webhook-cert\") pod \"maas-controller-76fb996bcf-88qtg\" (UID: \"693dcc38-e6d0-411b-9bcd-9e294283afb2\") " pod="opendatahub/maas-controller-76fb996bcf-88qtg" Oct 30 20:24:29.288213 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.288197 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/693dcc38-e6d0-411b-9bcd-9e294283afb2-metrics-certs\") pod \"maas-controller-76fb996bcf-88qtg\" (UID: \"693dcc38-e6d0-411b-9bcd-9e294283afb2\") " pod="opendatahub/maas-controller-76fb996bcf-88qtg" Oct 30 20:24:29.290711 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.290679 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/693dcc38-e6d0-411b-9bcd-9e294283afb2-metrics-certs\") pod \"maas-controller-76fb996bcf-88qtg\" (UID: \"693dcc38-e6d0-411b-9bcd-9e294283afb2\") " pod="opendatahub/maas-controller-76fb996bcf-88qtg" Oct 30 20:24:29.290860 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.290712 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/693dcc38-e6d0-411b-9bcd-9e294283afb2-webhook-cert\") pod \"maas-controller-76fb996bcf-88qtg\" (UID: \"693dcc38-e6d0-411b-9bcd-9e294283afb2\") " pod="opendatahub/maas-controller-76fb996bcf-88qtg" Oct 30 20:24:29.302287 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.302252 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8scn5\" (UniqueName: \"kubernetes.io/projected/693dcc38-e6d0-411b-9bcd-9e294283afb2-kube-api-access-8scn5\") pod \"maas-controller-76fb996bcf-88qtg\" (UID: \"693dcc38-e6d0-411b-9bcd-9e294283afb2\") " pod="opendatahub/maas-controller-76fb996bcf-88qtg" Oct 30 20:24:29.420663 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.420564 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb996bcf-88qtg" Oct 30 20:24:29.590137 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.590098 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="12babe67-4721-4422-aa81-3cf403e5c2c9" path="/var/lib/kubelet/pods/12babe67-4721-4422-aa81-3cf403e5c2c9/volumes" Oct 30 20:24:29.740011 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.739978 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76fb996bcf-88qtg"] Oct 30 20:24:29.743126 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:29.743105 5078 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 20:24:30.199651 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.199462 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:24:30.250654 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.249562 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:24:30.303761 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.303668 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-credential-socket\") pod \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " Oct 30 20:24:30.303761 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.303735 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-workload-socket\") pod \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " Oct 30 20:24:30.303956 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.303768 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-podinfo\") pod \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " Oct 30 20:24:30.303956 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.303804 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-token\" (UniqueName: \"kubernetes.io/projected/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-token\") pod \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " Oct 30 20:24:30.303956 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.303843 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-envoy\") pod \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " Oct 30 20:24:30.303956 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.303888 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-workload-certs\") pod \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " Oct 30 20:24:30.303956 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.303914 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-workload-socket\") pod \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.303957 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-podinfo\") pod \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.303990 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-credential-socket" pod "f638d7bc-a31f-4e99-8c8e-a78f45642b59" (UID: "f638d7bc-a31f-4e99-8c8e-a78f45642b59"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.304012 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a27e1ae4-d40d-4dc8-8d6f-588f38901365-kube-api-access-6pcz6\" (UniqueName: \"kubernetes.io/projected/a27e1ae4-d40d-4dc8-8d6f-588f38901365-kube-api-access-6pcz6\") pod \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.304061 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-workload-certs\") pod \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.304089 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-token\" (UniqueName: \"kubernetes.io/projected/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-token\") pod \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.304141 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-data\") pod \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.304168 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-envoy\") pod \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.304214 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-credential-socket\") pod \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.304244 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-workload-socket" pod "f638d7bc-a31f-4e99-8c8e-a78f45642b59" (UID: "f638d7bc-a31f-4e99-8c8e-a78f45642b59"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.304266 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-data\") pod \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.304297 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istiod-ca-cert\") pod \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.304358 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istiod-ca-cert\") pod \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\" (UID: \"a27e1ae4-d40d-4dc8-8d6f-588f38901365\") " Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.304411 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f638d7bc-a31f-4e99-8c8e-a78f45642b59-kube-api-access-whqd2\" (UniqueName: \"kubernetes.io/projected/f638d7bc-a31f-4e99-8c8e-a78f45642b59-kube-api-access-whqd2\") pod \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\" (UID: \"f638d7bc-a31f-4e99-8c8e-a78f45642b59\") " Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.304446 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-workload-certs" pod "f638d7bc-a31f-4e99-8c8e-a78f45642b59" (UID: "f638d7bc-a31f-4e99-8c8e-a78f45642b59"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.304512 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-workload-socket" pod "a27e1ae4-d40d-4dc8-8d6f-588f38901365" (UID: "a27e1ae4-d40d-4dc8-8d6f-588f38901365"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.304731 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-data" pod "a27e1ae4-d40d-4dc8-8d6f-588f38901365" (UID: "a27e1ae4-d40d-4dc8-8d6f-588f38901365"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.304828 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.304849 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.304852 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-data" pod "f638d7bc-a31f-4e99-8c8e-a78f45642b59" (UID: "f638d7bc-a31f-4e99-8c8e-a78f45642b59"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.304865 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.304880 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.304893 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:30.305640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.305138 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-workload-certs" pod "a27e1ae4-d40d-4dc8-8d6f-588f38901365" (UID: "a27e1ae4-d40d-4dc8-8d6f-588f38901365"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:30.307970 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.307777 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-envoy" pod "f638d7bc-a31f-4e99-8c8e-a78f45642b59" (UID: "f638d7bc-a31f-4e99-8c8e-a78f45642b59"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:30.307970 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.307810 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-token" pod "a27e1ae4-d40d-4dc8-8d6f-588f38901365" (UID: "a27e1ae4-d40d-4dc8-8d6f-588f38901365"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:24:30.308232 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.308128 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istiod-ca-cert" pod "f638d7bc-a31f-4e99-8c8e-a78f45642b59" (UID: "f638d7bc-a31f-4e99-8c8e-a78f45642b59"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:24:30.308232 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.308181 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-credential-socket" pod "a27e1ae4-d40d-4dc8-8d6f-588f38901365" (UID: "a27e1ae4-d40d-4dc8-8d6f-588f38901365"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:30.308599 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.308564 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istiod-ca-cert" pod "a27e1ae4-d40d-4dc8-8d6f-588f38901365" (UID: "a27e1ae4-d40d-4dc8-8d6f-588f38901365"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:24:30.308908 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.308888 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-token" pod "f638d7bc-a31f-4e99-8c8e-a78f45642b59" (UID: "f638d7bc-a31f-4e99-8c8e-a78f45642b59"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:24:30.310476 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.310442 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-podinfo" pod "f638d7bc-a31f-4e99-8c8e-a78f45642b59" (UID: "f638d7bc-a31f-4e99-8c8e-a78f45642b59"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:24:30.310747 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.310713 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-envoy" pod "a27e1ae4-d40d-4dc8-8d6f-588f38901365" (UID: "a27e1ae4-d40d-4dc8-8d6f-588f38901365"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:24:30.310859 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.310833 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-podinfo" pod "a27e1ae4-d40d-4dc8-8d6f-588f38901365" (UID: "a27e1ae4-d40d-4dc8-8d6f-588f38901365"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:24:30.311080 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.311052 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a27e1ae4-d40d-4dc8-8d6f-588f38901365-kube-api-access-6pcz6" pod "a27e1ae4-d40d-4dc8-8d6f-588f38901365" (UID: "a27e1ae4-d40d-4dc8-8d6f-588f38901365"). InnerVolumeSpecName "kube-api-access-6pcz6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:24:30.311900 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.311879 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f638d7bc-a31f-4e99-8c8e-a78f45642b59-kube-api-access-whqd2" pod "f638d7bc-a31f-4e99-8c8e-a78f45642b59" (UID: "f638d7bc-a31f-4e99-8c8e-a78f45642b59"). InnerVolumeSpecName "kube-api-access-whqd2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:24:30.358058 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.358019 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb996bcf-88qtg" event={"ID":"693dcc38-e6d0-411b-9bcd-9e294283afb2","Type":"ContainerStarted","Data":"6f25d88c65219a9d808df5d403bf5755074db7315a57fcb65b47b45522fc5555"} Oct 30 20:24:30.360875 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.360852 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" event={"ID":"a27e1ae4-d40d-4dc8-8d6f-588f38901365","Type":"ContainerDied","Data":"82f10f7e259f4a8b3104c6e13fd1d184f1aaea68ced639c7b029cd287441a348"} Oct 30 20:24:30.361055 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.361043 5078 scope.go:122] "RemoveContainer" containerID="82f10f7e259f4a8b3104c6e13fd1d184f1aaea68ced639c7b029cd287441a348" Oct 30 20:24:30.361231 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.360566 5078 generic.go:356] "Generic (PLEG): container finished" podID="a27e1ae4-d40d-4dc8-8d6f-588f38901365" containerID="82f10f7e259f4a8b3104c6e13fd1d184f1aaea68ced639c7b029cd287441a348" exitCode=0 Oct 30 20:24:30.363287 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.360650 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" Oct 30 20:24:30.363664 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.363455 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk" event={"ID":"a27e1ae4-d40d-4dc8-8d6f-588f38901365","Type":"ContainerDied","Data":"8ea9ede986186814d6d26a797dac6483aab726f19125e26ae8fd346416262c81"} Oct 30 20:24:30.367090 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.367076 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" Oct 30 20:24:30.367285 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.366965 5078 generic.go:356] "Generic (PLEG): container finished" podID="f638d7bc-a31f-4e99-8c8e-a78f45642b59" containerID="11c20ba7399bfe91e3683ad33a59fbaebf9f6c946c04ba470aa1db58f647572a" exitCode=0 Oct 30 20:24:30.367468 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.367215 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" event={"ID":"f638d7bc-a31f-4e99-8c8e-a78f45642b59","Type":"ContainerDied","Data":"11c20ba7399bfe91e3683ad33a59fbaebf9f6c946c04ba470aa1db58f647572a"} Oct 30 20:24:30.367635 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.367617 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6" event={"ID":"f638d7bc-a31f-4e99-8c8e-a78f45642b59","Type":"ContainerDied","Data":"d369da7f2ebad56fb022572ae0a3a763113900a20a7c28c20b97f01d0dd21413"} Oct 30 20:24:30.403124 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.402740 5078 scope.go:122] "RemoveContainer" containerID="e51c7e0a35ef62224e4bba342c177b0317ba970fddbcb0b650b97c0e5fbac82e" Oct 30 20:24:30.403723 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.403300 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk"] Oct 30 20:24:30.406237 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.406217 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:30.407093 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.406241 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:30.407093 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.406257 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:30.407093 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.406270 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:30.407093 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.406283 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:30.407093 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.406297 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whqd2\" (UniqueName: \"kubernetes.io/projected/f638d7bc-a31f-4e99-8c8e-a78f45642b59-kube-api-access-whqd2\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:30.407093 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.406311 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:30.407093 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.406324 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:30.407093 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.406352 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:30.407093 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.406366 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:30.407093 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.406380 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pcz6\" (UniqueName: \"kubernetes.io/projected/a27e1ae4-d40d-4dc8-8d6f-588f38901365-kube-api-access-6pcz6\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:30.407093 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.406393 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a27e1ae4-d40d-4dc8-8d6f-588f38901365-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:30.407093 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.406405 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f638d7bc-a31f-4e99-8c8e-a78f45642b59-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:24:30.409028 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.408999 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-mrwzk"] Oct 30 20:24:30.415100 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.415085 5078 scope.go:122] "RemoveContainer" containerID="82f10f7e259f4a8b3104c6e13fd1d184f1aaea68ced639c7b029cd287441a348" Oct 30 20:24:30.415449 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:24:30.415430 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82f10f7e259f4a8b3104c6e13fd1d184f1aaea68ced639c7b029cd287441a348\": container with ID starting with 82f10f7e259f4a8b3104c6e13fd1d184f1aaea68ced639c7b029cd287441a348 not found: ID does not exist" containerID="82f10f7e259f4a8b3104c6e13fd1d184f1aaea68ced639c7b029cd287441a348" Oct 30 20:24:30.415519 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.415458 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f10f7e259f4a8b3104c6e13fd1d184f1aaea68ced639c7b029cd287441a348"} err="failed to get container status \"82f10f7e259f4a8b3104c6e13fd1d184f1aaea68ced639c7b029cd287441a348\": rpc error: code = NotFound desc = could not find container \"82f10f7e259f4a8b3104c6e13fd1d184f1aaea68ced639c7b029cd287441a348\": container with ID starting with 82f10f7e259f4a8b3104c6e13fd1d184f1aaea68ced639c7b029cd287441a348 not found: ID does not exist" Oct 30 20:24:30.415519 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.415473 5078 scope.go:122] "RemoveContainer" containerID="e51c7e0a35ef62224e4bba342c177b0317ba970fddbcb0b650b97c0e5fbac82e" Oct 30 20:24:30.415681 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:24:30.415663 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e51c7e0a35ef62224e4bba342c177b0317ba970fddbcb0b650b97c0e5fbac82e\": container with ID starting with e51c7e0a35ef62224e4bba342c177b0317ba970fddbcb0b650b97c0e5fbac82e not found: ID does not exist" containerID="e51c7e0a35ef62224e4bba342c177b0317ba970fddbcb0b650b97c0e5fbac82e" Oct 30 20:24:30.415722 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.415686 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e51c7e0a35ef62224e4bba342c177b0317ba970fddbcb0b650b97c0e5fbac82e"} err="failed to get container status \"e51c7e0a35ef62224e4bba342c177b0317ba970fddbcb0b650b97c0e5fbac82e\": rpc error: code = NotFound desc = could not find container \"e51c7e0a35ef62224e4bba342c177b0317ba970fddbcb0b650b97c0e5fbac82e\": container with ID starting with e51c7e0a35ef62224e4bba342c177b0317ba970fddbcb0b650b97c0e5fbac82e not found: ID does not exist" Oct 30 20:24:30.415722 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.415699 5078 scope.go:122] "RemoveContainer" containerID="11c20ba7399bfe91e3683ad33a59fbaebf9f6c946c04ba470aa1db58f647572a" Oct 30 20:24:30.424466 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.424272 5078 scope.go:122] "RemoveContainer" containerID="11c20ba7399bfe91e3683ad33a59fbaebf9f6c946c04ba470aa1db58f647572a" Oct 30 20:24:30.424542 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.424525 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6"] Oct 30 20:24:30.424705 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:24:30.424673 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11c20ba7399bfe91e3683ad33a59fbaebf9f6c946c04ba470aa1db58f647572a\": container with ID starting with 11c20ba7399bfe91e3683ad33a59fbaebf9f6c946c04ba470aa1db58f647572a not found: ID does not exist" containerID="11c20ba7399bfe91e3683ad33a59fbaebf9f6c946c04ba470aa1db58f647572a" Oct 30 20:24:30.424768 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.424713 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11c20ba7399bfe91e3683ad33a59fbaebf9f6c946c04ba470aa1db58f647572a"} err="failed to get container status \"11c20ba7399bfe91e3683ad33a59fbaebf9f6c946c04ba470aa1db58f647572a\": rpc error: code = NotFound desc = could not find container \"11c20ba7399bfe91e3683ad33a59fbaebf9f6c946c04ba470aa1db58f647572a\": container with ID starting with 11c20ba7399bfe91e3683ad33a59fbaebf9f6c946c04ba470aa1db58f647572a not found: ID does not exist" Oct 30 20:24:30.459353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:30.452822 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-124fd1-openshift-default-5b554bcd59-fzbb6"] Oct 30 20:24:31.381636 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:31.381593 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb996bcf-88qtg" event={"ID":"693dcc38-e6d0-411b-9bcd-9e294283afb2","Type":"ContainerStarted","Data":"68e4f2d6bdf5a6fff612968de56b88f44edadc191af2e9b3bb634126e6d5e440"} Oct 30 20:24:31.382105 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:31.381746 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76fb996bcf-88qtg" Oct 30 20:24:31.403494 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:31.403451 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-76fb996bcf-88qtg" podStartSLOduration=1.673738942 podStartE2EDuration="2.403438517s" totalImagesPullingTime="729.699575ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:24:31.402175974 +0000 UTC m=+1245.935448570" watchObservedRunningTime="2026-10-30 20:24:31.403438517 +0000 UTC m=+1245.936711122" Oct 30 20:24:31.585583 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:31.585550 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a27e1ae4-d40d-4dc8-8d6f-588f38901365" path="/var/lib/kubelet/pods/a27e1ae4-d40d-4dc8-8d6f-588f38901365/volumes" Oct 30 20:24:31.586082 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:31.586051 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f638d7bc-a31f-4e99-8c8e-a78f45642b59" path="/var/lib/kubelet/pods/f638d7bc-a31f-4e99-8c8e-a78f45642b59/volumes" Oct 30 20:24:33.364423 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.364388 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s"] Oct 30 20:24:33.364864 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.364849 5078 cpu_manager.go:414] "containerMap: removing container" podUID="a27e1ae4-d40d-4dc8-8d6f-588f38901365" containerName="istio-proxy" Oct 30 20:24:33.364904 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.364865 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a27e1ae4-d40d-4dc8-8d6f-588f38901365" containerName="istio-proxy" Oct 30 20:24:33.364945 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.364914 5078 cpu_manager.go:414] "containerMap: removing container" podUID="f638d7bc-a31f-4e99-8c8e-a78f45642b59" containerName="istio-proxy" Oct 30 20:24:33.364945 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.364920 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f638d7bc-a31f-4e99-8c8e-a78f45642b59" containerName="istio-proxy" Oct 30 20:24:33.365008 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.364988 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="f638d7bc-a31f-4e99-8c8e-a78f45642b59" containerName="istio-proxy" Oct 30 20:24:33.365008 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.365000 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="a27e1ae4-d40d-4dc8-8d6f-588f38901365" containerName="istio-proxy" Oct 30 20:24:33.365008 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.365007 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="a27e1ae4-d40d-4dc8-8d6f-588f38901365" containerName="istio-proxy" Oct 30 20:24:33.368281 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.368266 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.380679 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.380648 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s"] Oct 30 20:24:33.384604 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.384581 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76"] Oct 30 20:24:33.385280 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.385258 5078 cpu_manager.go:414] "containerMap: removing container" podUID="a27e1ae4-d40d-4dc8-8d6f-588f38901365" containerName="istio-proxy" Oct 30 20:24:33.385353 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.385284 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a27e1ae4-d40d-4dc8-8d6f-588f38901365" containerName="istio-proxy" Oct 30 20:24:33.389011 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.388984 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.402987 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.402120 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76"] Oct 30 20:24:33.435419 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.435392 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f281b490-5afe-467a-a479-483203314e1c-istio-data\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.435569 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.435427 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/728c746f-de35-4521-90a5-262af3971cc2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.435569 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.435458 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f281b490-5afe-467a-a479-483203314e1c-istio-token\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.435569 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.435557 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq82c\" (UniqueName: \"kubernetes.io/projected/728c746f-de35-4521-90a5-262af3971cc2-kube-api-access-wq82c\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.435709 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.435592 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/728c746f-de35-4521-90a5-262af3971cc2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.435709 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.435648 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rjjq\" (UniqueName: \"kubernetes.io/projected/f281b490-5afe-467a-a479-483203314e1c-kube-api-access-6rjjq\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.435709 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.435694 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f281b490-5afe-467a-a479-483203314e1c-credential-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.435816 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.435716 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/728c746f-de35-4521-90a5-262af3971cc2-istio-envoy\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.435816 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.435767 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/728c746f-de35-4521-90a5-262af3971cc2-workload-certs\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.435816 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.435803 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f281b490-5afe-467a-a479-483203314e1c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.435915 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.435828 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f281b490-5afe-467a-a479-483203314e1c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.435915 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.435885 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f281b490-5afe-467a-a479-483203314e1c-workload-certs\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.435979 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.435962 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/728c746f-de35-4521-90a5-262af3971cc2-workload-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.436012 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.435989 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f281b490-5afe-467a-a479-483203314e1c-workload-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.436059 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.436028 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/728c746f-de35-4521-90a5-262af3971cc2-istio-data\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.436131 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.436111 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f281b490-5afe-467a-a479-483203314e1c-istio-envoy\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.436233 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.436214 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/728c746f-de35-4521-90a5-262af3971cc2-istio-token\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.436318 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.436303 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/728c746f-de35-4521-90a5-262af3971cc2-credential-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.537024 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.536992 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f281b490-5afe-467a-a479-483203314e1c-istio-envoy\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.537024 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.537031 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/728c746f-de35-4521-90a5-262af3971cc2-istio-token\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.537288 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.537069 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/728c746f-de35-4521-90a5-262af3971cc2-credential-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.537288 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.537092 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f281b490-5afe-467a-a479-483203314e1c-istio-data\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.537288 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.537112 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/728c746f-de35-4521-90a5-262af3971cc2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.537288 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.537135 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f281b490-5afe-467a-a479-483203314e1c-istio-token\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.537288 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.537154 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq82c\" (UniqueName: \"kubernetes.io/projected/728c746f-de35-4521-90a5-262af3971cc2-kube-api-access-wq82c\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.537288 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.537189 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/728c746f-de35-4521-90a5-262af3971cc2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.537288 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.537223 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rjjq\" (UniqueName: \"kubernetes.io/projected/f281b490-5afe-467a-a479-483203314e1c-kube-api-access-6rjjq\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.537288 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.537275 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f281b490-5afe-467a-a479-483203314e1c-credential-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.537730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.537306 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/728c746f-de35-4521-90a5-262af3971cc2-istio-envoy\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.537730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.537356 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/728c746f-de35-4521-90a5-262af3971cc2-workload-certs\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.537730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.537389 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f281b490-5afe-467a-a479-483203314e1c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.537730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.537412 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f281b490-5afe-467a-a479-483203314e1c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.537730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.537437 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f281b490-5afe-467a-a479-483203314e1c-workload-certs\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.537730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.537468 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/728c746f-de35-4521-90a5-262af3971cc2-workload-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.537730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.537495 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f281b490-5afe-467a-a479-483203314e1c-workload-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.537730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.537533 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/728c746f-de35-4521-90a5-262af3971cc2-istio-data\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.537730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.537533 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/728c746f-de35-4521-90a5-262af3971cc2-credential-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.537730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.537572 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f281b490-5afe-467a-a479-483203314e1c-istio-data\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.537730 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.537724 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f281b490-5afe-467a-a479-483203314e1c-credential-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.538281 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.537878 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f281b490-5afe-467a-a479-483203314e1c-workload-certs\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.538281 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.538009 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/728c746f-de35-4521-90a5-262af3971cc2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.538281 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.538088 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f281b490-5afe-467a-a479-483203314e1c-workload-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.538468 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.538282 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/728c746f-de35-4521-90a5-262af3971cc2-workload-certs\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.538468 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.538298 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f281b490-5afe-467a-a479-483203314e1c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.538468 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.538413 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/728c746f-de35-4521-90a5-262af3971cc2-istio-data\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.538629 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.538577 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/728c746f-de35-4521-90a5-262af3971cc2-workload-socket\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.539718 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.539691 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f281b490-5afe-467a-a479-483203314e1c-istio-envoy\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.539984 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.539965 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/728c746f-de35-4521-90a5-262af3971cc2-istio-envoy\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.540091 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.540075 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f281b490-5afe-467a-a479-483203314e1c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.540491 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.540473 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/728c746f-de35-4521-90a5-262af3971cc2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.550098 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.550070 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq82c\" (UniqueName: \"kubernetes.io/projected/728c746f-de35-4521-90a5-262af3971cc2-kube-api-access-wq82c\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.550212 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.550164 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/728c746f-de35-4521-90a5-262af3971cc2-istio-token\") pod \"maas-default-gateway-openshift-default-64d4cc998c-mct6s\" (UID: \"728c746f-de35-4521-90a5-262af3971cc2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.550449 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.550427 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f281b490-5afe-467a-a479-483203314e1c-istio-token\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.551441 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.551414 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rjjq\" (UniqueName: \"kubernetes.io/projected/f281b490-5afe-467a-a479-483203314e1c-kube-api-access-6rjjq\") pod \"maas-default-gateway-openshift-default-64d4cc998c-rnm76\" (UID: \"f281b490-5afe-467a-a479-483203314e1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.682486 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.682403 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:33.705951 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.705920 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:33.971514 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.971490 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s"] Oct 30 20:24:33.973859 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:24:33.973834 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod728c746f_de35_4521_90a5_262af3971cc2.slice/crio-6cb77ea062ee64fbceef7828d64609031f8c85531c43afb69973f39190724530 WatchSource:0}: Error finding container 6cb77ea062ee64fbceef7828d64609031f8c85531c43afb69973f39190724530: Status 404 returned error can't find the container with id 6cb77ea062ee64fbceef7828d64609031f8c85531c43afb69973f39190724530 Oct 30 20:24:33.976053 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.976014 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:24:33.976122 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.976087 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:24:33.976157 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:33.976126 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:24:34.003591 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:34.003569 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76"] Oct 30 20:24:34.005894 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:24:34.005869 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf281b490_5afe_467a_a479_483203314e1c.slice/crio-5c3d949f8364fde7770dd99d044f2d7bdb84a6280d508ab8a82abacb85ba0fbc WatchSource:0}: Error finding container 5c3d949f8364fde7770dd99d044f2d7bdb84a6280d508ab8a82abacb85ba0fbc: Status 404 returned error can't find the container with id 5c3d949f8364fde7770dd99d044f2d7bdb84a6280d508ab8a82abacb85ba0fbc Oct 30 20:24:34.007484 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:34.007456 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:24:34.007590 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:34.007516 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:24:34.007590 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:34.007549 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:24:34.407928 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:34.407884 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" event={"ID":"f281b490-5afe-467a-a479-483203314e1c","Type":"ContainerStarted","Data":"13124fc90aab0d4e4217ce9d301eabdff7cbc454889266459c638d10494b6462"} Oct 30 20:24:34.408416 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:34.407954 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" event={"ID":"f281b490-5afe-467a-a479-483203314e1c","Type":"ContainerStarted","Data":"5c3d949f8364fde7770dd99d044f2d7bdb84a6280d508ab8a82abacb85ba0fbc"} Oct 30 20:24:34.409767 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:34.409734 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" event={"ID":"728c746f-de35-4521-90a5-262af3971cc2","Type":"ContainerStarted","Data":"95e50274815dfa9547e20d5504be80a29fa32af344c9f373be0ec58a5d417be4"} Oct 30 20:24:34.409906 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:34.409783 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" event={"ID":"728c746f-de35-4521-90a5-262af3971cc2","Type":"ContainerStarted","Data":"6cb77ea062ee64fbceef7828d64609031f8c85531c43afb69973f39190724530"} Oct 30 20:24:34.444648 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:34.444581 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" podStartSLOduration=1.444560975 podStartE2EDuration="1.444560975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:24:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:24:34.43890599 +0000 UTC m=+1248.972178586" watchObservedRunningTime="2026-10-30 20:24:34.444560975 +0000 UTC m=+1248.977833573" Oct 30 20:24:34.682635 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:34.682503 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:34.706957 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:34.706924 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:35.684759 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:35.684662 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-mct6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body= Oct 30 20:24:35.684759 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:35.684724 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" podUID="728c746f-de35-4521-90a5-262af3971cc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" Oct 30 20:24:35.707897 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:35.707867 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-rnm76 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body= Oct 30 20:24:35.708044 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:35.707912 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" podUID="f281b490-5afe-467a-a479-483203314e1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" Oct 30 20:24:36.682842 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:36.682797 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-mct6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body= Oct 30 20:24:36.683034 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:36.682851 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" podUID="728c746f-de35-4521-90a5-262af3971cc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" Oct 30 20:24:36.707207 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:36.707177 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-rnm76 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body= Oct 30 20:24:36.707567 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:36.707229 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" podUID="f281b490-5afe-467a-a479-483203314e1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" Oct 30 20:24:37.682817 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:37.682775 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-mct6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body= Oct 30 20:24:37.683008 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:37.682828 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" podUID="728c746f-de35-4521-90a5-262af3971cc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" Oct 30 20:24:37.707199 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:37.707166 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-rnm76 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body= Oct 30 20:24:37.707294 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:37.707217 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" podUID="f281b490-5afe-467a-a479-483203314e1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" Oct 30 20:24:38.683876 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:38.683833 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-mct6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body= Oct 30 20:24:38.684207 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:38.684157 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" podUID="728c746f-de35-4521-90a5-262af3971cc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" Oct 30 20:24:38.707194 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:38.707081 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-rnm76 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body= Oct 30 20:24:38.707194 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:38.707159 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" podUID="f281b490-5afe-467a-a479-483203314e1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" Oct 30 20:24:39.683230 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:39.683181 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-mct6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body= Oct 30 20:24:39.683465 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:39.683250 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" podUID="728c746f-de35-4521-90a5-262af3971cc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" Oct 30 20:24:39.706924 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:39.706895 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-rnm76 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body= Oct 30 20:24:39.707030 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:39.706953 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" podUID="f281b490-5afe-467a-a479-483203314e1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" Oct 30 20:24:40.683234 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:40.683198 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-mct6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body= Oct 30 20:24:40.683764 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:40.683261 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" podUID="728c746f-de35-4521-90a5-262af3971cc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" Oct 30 20:24:40.706596 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:40.706561 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-rnm76 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body= Oct 30 20:24:40.706731 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:40.706622 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" podUID="f281b490-5afe-467a-a479-483203314e1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" Oct 30 20:24:42.365996 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:42.365959 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:42.366674 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:42.366648 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:42.367345 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:42.367308 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" Oct 30 20:24:42.383976 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:42.383949 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:42.384568 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:42.384549 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:42.385361 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:42.385322 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" Oct 30 20:24:42.390365 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:42.390343 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76fb996bcf-88qtg" Oct 30 20:24:42.391269 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:24:42.391227 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" podStartSLOduration=9.391216703 podStartE2EDuration="9.391216703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:24:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:24:34.476151113 +0000 UTC m=+1249.009423707" watchObservedRunningTime="2026-10-30 20:24:42.391216703 +0000 UTC m=+1256.924489294" Oct 30 20:24:56.698183 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:24:56.698141 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:25:02.983031 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:02.982995 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76fb996bcf-88qtg"] Oct 30 20:25:02.983516 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:02.983209 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-76fb996bcf-88qtg" podUID="693dcc38-e6d0-411b-9bcd-9e294283afb2" containerName="manager" containerID="cri-o://68e4f2d6bdf5a6fff612968de56b88f44edadc191af2e9b3bb634126e6d5e440" gracePeriod=30 Oct 30 20:25:03.244124 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:03.244070 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb996bcf-88qtg" Oct 30 20:25:03.309070 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:03.309038 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/693dcc38-e6d0-411b-9bcd-9e294283afb2-metrics-certs\" (UniqueName: \"kubernetes.io/secret/693dcc38-e6d0-411b-9bcd-9e294283afb2-metrics-certs\") pod \"693dcc38-e6d0-411b-9bcd-9e294283afb2\" (UID: \"693dcc38-e6d0-411b-9bcd-9e294283afb2\") " Oct 30 20:25:03.309070 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:03.309074 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/693dcc38-e6d0-411b-9bcd-9e294283afb2-webhook-cert\" (UniqueName: \"kubernetes.io/secret/693dcc38-e6d0-411b-9bcd-9e294283afb2-webhook-cert\") pod \"693dcc38-e6d0-411b-9bcd-9e294283afb2\" (UID: \"693dcc38-e6d0-411b-9bcd-9e294283afb2\") " Oct 30 20:25:03.309377 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:03.309193 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/693dcc38-e6d0-411b-9bcd-9e294283afb2-kube-api-access-8scn5\" (UniqueName: \"kubernetes.io/projected/693dcc38-e6d0-411b-9bcd-9e294283afb2-kube-api-access-8scn5\") pod \"693dcc38-e6d0-411b-9bcd-9e294283afb2\" (UID: \"693dcc38-e6d0-411b-9bcd-9e294283afb2\") " Oct 30 20:25:03.311302 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:03.311262 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/693dcc38-e6d0-411b-9bcd-9e294283afb2-webhook-cert" pod "693dcc38-e6d0-411b-9bcd-9e294283afb2" (UID: "693dcc38-e6d0-411b-9bcd-9e294283afb2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:25:03.311652 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:03.311624 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/693dcc38-e6d0-411b-9bcd-9e294283afb2-metrics-certs" pod "693dcc38-e6d0-411b-9bcd-9e294283afb2" (UID: "693dcc38-e6d0-411b-9bcd-9e294283afb2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:25:03.311823 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:03.311800 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/693dcc38-e6d0-411b-9bcd-9e294283afb2-kube-api-access-8scn5" pod "693dcc38-e6d0-411b-9bcd-9e294283afb2" (UID: "693dcc38-e6d0-411b-9bcd-9e294283afb2"). InnerVolumeSpecName "kube-api-access-8scn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:25:03.410566 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:03.410530 5078 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/693dcc38-e6d0-411b-9bcd-9e294283afb2-metrics-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:25:03.410735 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:03.410582 5078 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/693dcc38-e6d0-411b-9bcd-9e294283afb2-webhook-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:25:03.410735 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:03.410593 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8scn5\" (UniqueName: \"kubernetes.io/projected/693dcc38-e6d0-411b-9bcd-9e294283afb2-kube-api-access-8scn5\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:25:03.627102 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:03.627072 5078 generic.go:356] "Generic (PLEG): container finished" podID="693dcc38-e6d0-411b-9bcd-9e294283afb2" containerID="68e4f2d6bdf5a6fff612968de56b88f44edadc191af2e9b3bb634126e6d5e440" exitCode=0 Oct 30 20:25:03.627257 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:03.627123 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb996bcf-88qtg" Oct 30 20:25:03.627257 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:03.627122 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb996bcf-88qtg" event={"ID":"693dcc38-e6d0-411b-9bcd-9e294283afb2","Type":"ContainerDied","Data":"68e4f2d6bdf5a6fff612968de56b88f44edadc191af2e9b3bb634126e6d5e440"} Oct 30 20:25:03.627257 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:03.627224 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb996bcf-88qtg" event={"ID":"693dcc38-e6d0-411b-9bcd-9e294283afb2","Type":"ContainerDied","Data":"6f25d88c65219a9d808df5d403bf5755074db7315a57fcb65b47b45522fc5555"} Oct 30 20:25:03.627257 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:03.627256 5078 scope.go:122] "RemoveContainer" containerID="68e4f2d6bdf5a6fff612968de56b88f44edadc191af2e9b3bb634126e6d5e440" Oct 30 20:25:03.635979 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:03.635960 5078 scope.go:122] "RemoveContainer" containerID="68e4f2d6bdf5a6fff612968de56b88f44edadc191af2e9b3bb634126e6d5e440" Oct 30 20:25:03.636273 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:25:03.636252 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68e4f2d6bdf5a6fff612968de56b88f44edadc191af2e9b3bb634126e6d5e440\": container with ID starting with 68e4f2d6bdf5a6fff612968de56b88f44edadc191af2e9b3bb634126e6d5e440 not found: ID does not exist" containerID="68e4f2d6bdf5a6fff612968de56b88f44edadc191af2e9b3bb634126e6d5e440" Oct 30 20:25:03.636376 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:03.636279 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68e4f2d6bdf5a6fff612968de56b88f44edadc191af2e9b3bb634126e6d5e440"} err="failed to get container status \"68e4f2d6bdf5a6fff612968de56b88f44edadc191af2e9b3bb634126e6d5e440\": rpc error: code = NotFound desc = could not find container \"68e4f2d6bdf5a6fff612968de56b88f44edadc191af2e9b3bb634126e6d5e440\": container with ID starting with 68e4f2d6bdf5a6fff612968de56b88f44edadc191af2e9b3bb634126e6d5e440 not found: ID does not exist" Oct 30 20:25:03.646370 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:03.646349 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76fb996bcf-88qtg"] Oct 30 20:25:03.651040 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:03.651020 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76fb996bcf-88qtg"] Oct 30 20:25:04.883968 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:04.883934 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76fb996bcf-4br2k"] Oct 30 20:25:04.884631 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:04.884611 5078 cpu_manager.go:414] "containerMap: removing container" podUID="693dcc38-e6d0-411b-9bcd-9e294283afb2" containerName="manager" Oct 30 20:25:04.884729 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:04.884633 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="693dcc38-e6d0-411b-9bcd-9e294283afb2" containerName="manager" Oct 30 20:25:04.884794 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:04.884753 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="693dcc38-e6d0-411b-9bcd-9e294283afb2" containerName="manager" Oct 30 20:25:04.889212 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:04.889190 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb996bcf-4br2k" Oct 30 20:25:04.896982 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:04.896960 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Oct 30 20:25:04.897149 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:04.897062 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c46xw\"" Oct 30 20:25:04.897149 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:04.897099 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Oct 30 20:25:04.897366 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:04.897323 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Oct 30 20:25:04.899812 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:04.899788 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76fb996bcf-4br2k"] Oct 30 20:25:04.927920 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:04.927888 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73330fbb-b274-4748-b91d-065ca47fbb94-metrics-certs\") pod \"maas-controller-76fb996bcf-4br2k\" (UID: \"73330fbb-b274-4748-b91d-065ca47fbb94\") " pod="opendatahub/maas-controller-76fb996bcf-4br2k" Oct 30 20:25:04.928056 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:04.928025 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/73330fbb-b274-4748-b91d-065ca47fbb94-webhook-cert\") pod \"maas-controller-76fb996bcf-4br2k\" (UID: \"73330fbb-b274-4748-b91d-065ca47fbb94\") " pod="opendatahub/maas-controller-76fb996bcf-4br2k" Oct 30 20:25:04.928187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:04.928165 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsjmw\" (UniqueName: \"kubernetes.io/projected/73330fbb-b274-4748-b91d-065ca47fbb94-kube-api-access-dsjmw\") pod \"maas-controller-76fb996bcf-4br2k\" (UID: \"73330fbb-b274-4748-b91d-065ca47fbb94\") " pod="opendatahub/maas-controller-76fb996bcf-4br2k" Oct 30 20:25:05.028963 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:05.028922 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/73330fbb-b274-4748-b91d-065ca47fbb94-webhook-cert\") pod \"maas-controller-76fb996bcf-4br2k\" (UID: \"73330fbb-b274-4748-b91d-065ca47fbb94\") " pod="opendatahub/maas-controller-76fb996bcf-4br2k" Oct 30 20:25:05.029149 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:05.029016 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsjmw\" (UniqueName: \"kubernetes.io/projected/73330fbb-b274-4748-b91d-065ca47fbb94-kube-api-access-dsjmw\") pod \"maas-controller-76fb996bcf-4br2k\" (UID: \"73330fbb-b274-4748-b91d-065ca47fbb94\") " pod="opendatahub/maas-controller-76fb996bcf-4br2k" Oct 30 20:25:05.029149 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:05.029054 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73330fbb-b274-4748-b91d-065ca47fbb94-metrics-certs\") pod \"maas-controller-76fb996bcf-4br2k\" (UID: \"73330fbb-b274-4748-b91d-065ca47fbb94\") " pod="opendatahub/maas-controller-76fb996bcf-4br2k" Oct 30 20:25:05.031504 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:05.031470 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/73330fbb-b274-4748-b91d-065ca47fbb94-webhook-cert\") pod \"maas-controller-76fb996bcf-4br2k\" (UID: \"73330fbb-b274-4748-b91d-065ca47fbb94\") " pod="opendatahub/maas-controller-76fb996bcf-4br2k" Oct 30 20:25:05.031633 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:05.031528 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73330fbb-b274-4748-b91d-065ca47fbb94-metrics-certs\") pod \"maas-controller-76fb996bcf-4br2k\" (UID: \"73330fbb-b274-4748-b91d-065ca47fbb94\") " pod="opendatahub/maas-controller-76fb996bcf-4br2k" Oct 30 20:25:05.042057 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:05.042031 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsjmw\" (UniqueName: \"kubernetes.io/projected/73330fbb-b274-4748-b91d-065ca47fbb94-kube-api-access-dsjmw\") pod \"maas-controller-76fb996bcf-4br2k\" (UID: \"73330fbb-b274-4748-b91d-065ca47fbb94\") " pod="opendatahub/maas-controller-76fb996bcf-4br2k" Oct 30 20:25:05.203793 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:05.203701 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb996bcf-4br2k" Oct 30 20:25:05.481324 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:05.481260 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76fb996bcf-4br2k"] Oct 30 20:25:05.483881 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:25:05.483851 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73330fbb_b274_4748_b91d_065ca47fbb94.slice/crio-338988f24ad63933e772f46d1b0aa269c9e1a42a00936b91fb685555b8c6c388 WatchSource:0}: Error finding container 338988f24ad63933e772f46d1b0aa269c9e1a42a00936b91fb685555b8c6c388: Status 404 returned error can't find the container with id 338988f24ad63933e772f46d1b0aa269c9e1a42a00936b91fb685555b8c6c388 Oct 30 20:25:05.585284 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:05.585246 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="693dcc38-e6d0-411b-9bcd-9e294283afb2" path="/var/lib/kubelet/pods/693dcc38-e6d0-411b-9bcd-9e294283afb2/volumes" Oct 30 20:25:05.640203 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:05.640172 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb996bcf-4br2k" event={"ID":"73330fbb-b274-4748-b91d-065ca47fbb94","Type":"ContainerStarted","Data":"338988f24ad63933e772f46d1b0aa269c9e1a42a00936b91fb685555b8c6c388"} Oct 30 20:25:06.647817 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:06.647770 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb996bcf-4br2k" event={"ID":"73330fbb-b274-4748-b91d-065ca47fbb94","Type":"ContainerStarted","Data":"251c8da73d6c4b5e25cdf2eb013f2fed57c6c4cec43eedc56998e466244c5ba9"} Oct 30 20:25:06.648309 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:06.647847 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76fb996bcf-4br2k" Oct 30 20:25:06.671171 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:06.671126 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-76fb996bcf-4br2k" podStartSLOduration=2.284100444 podStartE2EDuration="2.671111497s" totalImagesPullingTime="387.011053ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:25:06.669499601 +0000 UTC m=+1281.202772196" watchObservedRunningTime="2026-10-30 20:25:06.671111497 +0000 UTC m=+1281.204384090" Oct 30 20:25:17.656755 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:25:17.656724 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76fb996bcf-4br2k" Oct 30 20:25:26.697928 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:25:26.697846 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:25:56.697986 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:25:56.697947 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:26:26.698765 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:26:26.698723 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:26:42.114543 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:26:42.114490 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-4p5zj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:26:42.115223 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:26:42.115187 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" podUID="97082e84-45d0-4ca4-b427-d703172d8671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:26:56.697760 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:26:56.697720 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:27:26.698846 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:27:26.698805 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:27:56.699743 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:27:56.699702 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:28:26.698290 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:28:26.698209 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:28:45.786892 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:28:45.786860 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/1.log" Oct 30 20:28:45.787360 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:28:45.787001 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/1.log" Oct 30 20:28:46.293427 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:28:46.293397 5078 scope.go:122] "RemoveContainer" containerID="3313cc107786bdaff2f6e0034bca3b9e7adb0adfd4b0222c6ccd16ec634e35ac" Oct 30 20:28:56.697672 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:28:56.697633 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:29:02.325584 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.325546 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg"] Oct 30 20:29:02.331579 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.331554 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.341815 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.341791 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-single-main-402199-openshift-default-dockercfg-zg2mh\"" Oct 30 20:29:02.345276 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.345234 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg"] Oct 30 20:29:02.433368 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.433299 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-credential-socket\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.433744 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.433716 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-workload-socket\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.433880 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.433865 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-podinfo\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.434021 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.434008 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istiod-ca-cert\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.434125 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.434111 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-token\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.434235 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.434220 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shs44\" (UniqueName: \"kubernetes.io/projected/7b01230f-f0eb-4db0-bf71-5dc23825b9da-kube-api-access-shs44\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.434414 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.434391 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-workload-certs\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.434566 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.434550 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-envoy\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.451477 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.451440 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-data\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.553362 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.553314 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-credential-socket\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.553564 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.553386 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-workload-socket\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.553564 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.553403 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-podinfo\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.553564 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.553437 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istiod-ca-cert\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.553564 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.553454 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-token\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.553564 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.553481 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shs44\" (UniqueName: \"kubernetes.io/projected/7b01230f-f0eb-4db0-bf71-5dc23825b9da-kube-api-access-shs44\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.553564 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.553531 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-workload-certs\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.553564 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.553563 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-envoy\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.553897 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.553602 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-data\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.555369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.553741 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-credential-socket\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.555369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.554189 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-workload-socket\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.555369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.554263 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-data\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.555369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.554366 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-workload-certs\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.555369 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.554561 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istiod-ca-cert\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.556887 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.556845 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-envoy\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.565375 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.565314 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-podinfo\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.567362 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.567320 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-token\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.567478 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.567419 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shs44\" (UniqueName: \"kubernetes.io/projected/7b01230f-f0eb-4db0-bf71-5dc23825b9da-kube-api-access-shs44\") pod \"e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.648379 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.648266 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:02.931943 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.931912 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg"] Oct 30 20:29:02.933921 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:29:02.933894 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b01230f_f0eb_4db0_bf71_5dc23825b9da.slice/crio-982f039be32d257006504b3b6c5291dc988069ef349d466895724e6f6956c3cb WatchSource:0}: Error finding container 982f039be32d257006504b3b6c5291dc988069ef349d466895724e6f6956c3cb: Status 404 returned error can't find the container with id 982f039be32d257006504b3b6c5291dc988069ef349d466895724e6f6956c3cb Oct 30 20:29:02.936265 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.936221 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:29:02.936368 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.936311 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:29:02.936423 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:02.936374 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:29:03.260320 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:03.260236 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" event={"ID":"7b01230f-f0eb-4db0-bf71-5dc23825b9da","Type":"ContainerStarted","Data":"e4d46831405a7e2cd41d2caced0a5225f5c7cd03cf2c0b0b80041d77d08cffb9"} Oct 30 20:29:03.260320 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:03.260287 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" event={"ID":"7b01230f-f0eb-4db0-bf71-5dc23825b9da","Type":"ContainerStarted","Data":"982f039be32d257006504b3b6c5291dc988069ef349d466895724e6f6956c3cb"} Oct 30 20:29:03.286405 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:03.286352 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" podStartSLOduration=1.286323324 podStartE2EDuration="1.286323324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:29:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:29:03.284424054 +0000 UTC m=+1517.817696659" watchObservedRunningTime="2026-10-30 20:29:03.286323324 +0000 UTC m=+1517.819595987" Oct 30 20:29:03.648522 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:03.648487 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:04.655034 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:04.654998 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:05.272075 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:05.272044 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:05.272951 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:05.272933 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:06.723491 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:06.723455 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh"] Oct 30 20:29:06.728401 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:06.728379 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" Oct 30 20:29:06.738722 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:06.738682 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh"] Oct 30 20:29:06.739452 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:06.739422 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-402199-serving-cert\"" Oct 30 20:29:06.899408 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:06.899370 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-metrics-certs\") pod \"maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh\" (UID: \"d59c6d6c-7707-45b1-a74b-eb89c5b23f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" Oct 30 20:29:06.899408 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:06.899418 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx7gc\" (UniqueName: \"kubernetes.io/projected/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-kube-api-access-nx7gc\") pod \"maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh\" (UID: \"d59c6d6c-7707-45b1-a74b-eb89c5b23f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" Oct 30 20:29:06.899684 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:06.899594 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh\" (UID: \"d59c6d6c-7707-45b1-a74b-eb89c5b23f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" Oct 30 20:29:06.899775 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:06.899756 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh\" (UID: \"d59c6d6c-7707-45b1-a74b-eb89c5b23f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" Oct 30 20:29:07.001388 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:07.001268 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh\" (UID: \"d59c6d6c-7707-45b1-a74b-eb89c5b23f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" Oct 30 20:29:07.001563 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:07.001457 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh\" (UID: \"d59c6d6c-7707-45b1-a74b-eb89c5b23f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" Oct 30 20:29:07.001563 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:07.001507 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-metrics-certs\") pod \"maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh\" (UID: \"d59c6d6c-7707-45b1-a74b-eb89c5b23f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" Oct 30 20:29:07.001563 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:07.001543 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx7gc\" (UniqueName: \"kubernetes.io/projected/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-kube-api-access-nx7gc\") pod \"maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh\" (UID: \"d59c6d6c-7707-45b1-a74b-eb89c5b23f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" Oct 30 20:29:07.001748 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:29:07.001618 5078 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-serving-cert: secret "maas-api-e2e-worker-single-main-402199-serving-cert" not found Oct 30 20:29:07.001748 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:29:07.001737 5078 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-maas-api-tls podName:d59c6d6c-7707-45b1-a74b-eb89c5b23f67 nodeName:}" failed. No retries permitted until 2026-10-30 20:29:07.501671947 +0000 UTC m=+1522.034944533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-maas-api-tls") pod "maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" (UID: "d59c6d6c-7707-45b1-a74b-eb89c5b23f67") : secret "maas-api-e2e-worker-single-main-402199-serving-cert" not found Oct 30 20:29:07.002048 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:07.002024 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh\" (UID: \"d59c6d6c-7707-45b1-a74b-eb89c5b23f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" Oct 30 20:29:07.004578 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:07.004554 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-metrics-certs\") pod \"maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh\" (UID: \"d59c6d6c-7707-45b1-a74b-eb89c5b23f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" Oct 30 20:29:07.021256 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:07.021223 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx7gc\" (UniqueName: \"kubernetes.io/projected/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-kube-api-access-nx7gc\") pod \"maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh\" (UID: \"d59c6d6c-7707-45b1-a74b-eb89c5b23f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" Oct 30 20:29:07.510703 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:07.510661 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh\" (UID: \"d59c6d6c-7707-45b1-a74b-eb89c5b23f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" Oct 30 20:29:07.513137 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:07.513112 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh\" (UID: \"d59c6d6c-7707-45b1-a74b-eb89c5b23f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" Oct 30 20:29:07.645723 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:07.645687 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" Oct 30 20:29:07.938732 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:07.938705 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh"] Oct 30 20:29:07.941190 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:29:07.941161 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd59c6d6c_7707_45b1_a74b_eb89c5b23f67.slice/crio-4e30e714c82743c2bea29466d0112fed6fc1d466d293b360c20ce83a5b18503c WatchSource:0}: Error finding container 4e30e714c82743c2bea29466d0112fed6fc1d466d293b360c20ce83a5b18503c: Status 404 returned error can't find the container with id 4e30e714c82743c2bea29466d0112fed6fc1d466d293b360c20ce83a5b18503c Oct 30 20:29:08.294769 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:08.294680 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" event={"ID":"d59c6d6c-7707-45b1-a74b-eb89c5b23f67","Type":"ContainerStarted","Data":"4e30e714c82743c2bea29466d0112fed6fc1d466d293b360c20ce83a5b18503c"} Oct 30 20:29:09.301919 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:09.301877 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" event={"ID":"d59c6d6c-7707-45b1-a74b-eb89c5b23f67","Type":"ContainerStarted","Data":"8173522145f0051285f999f8730837337912075536e91aa35578493492bd18c1"} Oct 30 20:29:09.302392 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:09.302080 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" Oct 30 20:29:15.342594 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:15.342551 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" Oct 30 20:29:15.376990 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:15.376929 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" podStartSLOduration=8.895451675 podStartE2EDuration="9.3769144s" totalImagesPullingTime="481.462725ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:29:09.336313618 +0000 UTC m=+1523.869586229" watchObservedRunningTime="2026-10-30 20:29:15.3769144 +0000 UTC m=+1529.910186994" Oct 30 20:29:20.274342 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:20.274297 5078 patch_prober.go:29] interesting pod/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body= Oct 30 20:29:20.274780 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:20.274404 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" podUID="7b01230f-f0eb-4db0-bf71-5dc23825b9da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" Oct 30 20:29:20.409662 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:20.409629 5078 generic.go:356] "Generic (PLEG): container finished" podID="7b01230f-f0eb-4db0-bf71-5dc23825b9da" containerID="e4d46831405a7e2cd41d2caced0a5225f5c7cd03cf2c0b0b80041d77d08cffb9" exitCode=0 Oct 30 20:29:20.409840 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:20.409674 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" event={"ID":"7b01230f-f0eb-4db0-bf71-5dc23825b9da","Type":"ContainerDied","Data":"e4d46831405a7e2cd41d2caced0a5225f5c7cd03cf2c0b0b80041d77d08cffb9"} Oct 30 20:29:20.410037 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:20.410024 5078 scope.go:122] "RemoveContainer" containerID="e4d46831405a7e2cd41d2caced0a5225f5c7cd03cf2c0b0b80041d77d08cffb9" Oct 30 20:29:20.411261 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:20.411232 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:29:20.411317 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:20.411299 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:29:20.411368 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:20.411346 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:29:21.416937 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:21.416898 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" event={"ID":"7b01230f-f0eb-4db0-bf71-5dc23825b9da","Type":"ContainerStarted","Data":"1b484fd03c991becf5f11aefea997423398385d61967c909e4c5e35d94367aa2"} Oct 30 20:29:21.653554 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:21.653517 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:21.653840 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:21.653742 5078 patch_prober.go:29] interesting pod/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body= Oct 30 20:29:21.654002 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:21.653979 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" podUID="7b01230f-f0eb-4db0-bf71-5dc23825b9da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" Oct 30 20:29:22.649795 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:22.649753 5078 patch_prober.go:29] interesting pod/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body= Oct 30 20:29:22.650420 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:22.650379 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" podUID="7b01230f-f0eb-4db0-bf71-5dc23825b9da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" Oct 30 20:29:23.653552 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:23.653518 5078 patch_prober.go:29] interesting pod/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body= Oct 30 20:29:23.654118 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:23.654086 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" podUID="7b01230f-f0eb-4db0-bf71-5dc23825b9da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" Oct 30 20:29:24.651798 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:24.651758 5078 patch_prober.go:29] interesting pod/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body= Oct 30 20:29:24.652121 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:24.652087 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" podUID="7b01230f-f0eb-4db0-bf71-5dc23825b9da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" Oct 30 20:29:25.648716 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:25.648675 5078 patch_prober.go:29] interesting pod/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body= Oct 30 20:29:25.649357 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:25.649299 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" podUID="7b01230f-f0eb-4db0-bf71-5dc23825b9da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" Oct 30 20:29:26.700503 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:29:26.700461 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:29:26.985757 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:26.985664 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:26.986124 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:26.986094 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:26.990002 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:29:26.989955 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:29:56.729323 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:29:56.729219 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:30:05.184591 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.184546 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh"] Oct 30 20:30:05.187129 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.184773 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" podUID="d59c6d6c-7707-45b1-a74b-eb89c5b23f67" containerName="maas-api" containerID="cri-o://8173522145f0051285f999f8730837337912075536e91aa35578493492bd18c1" gracePeriod=30 Oct 30 20:30:05.325469 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.325420 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" podUID="d59c6d6c-7707-45b1-a74b-eb89c5b23f67" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.102:8443/health\": dial tcp 10.132.0.102:8443: connect: connection refused" Oct 30 20:30:05.681997 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.681964 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" Oct 30 20:30:05.684603 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.684569 5078 generic.go:356] "Generic (PLEG): container finished" podID="d59c6d6c-7707-45b1-a74b-eb89c5b23f67" containerID="8173522145f0051285f999f8730837337912075536e91aa35578493492bd18c1" exitCode=0 Oct 30 20:30:05.684773 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.684607 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" event={"ID":"d59c6d6c-7707-45b1-a74b-eb89c5b23f67","Type":"ContainerDied","Data":"8173522145f0051285f999f8730837337912075536e91aa35578493492bd18c1"} Oct 30 20:30:05.684773 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.684631 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" Oct 30 20:30:05.684773 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.684662 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh" event={"ID":"d59c6d6c-7707-45b1-a74b-eb89c5b23f67","Type":"ContainerDied","Data":"4e30e714c82743c2bea29466d0112fed6fc1d466d293b360c20ce83a5b18503c"} Oct 30 20:30:05.684773 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.684687 5078 scope.go:122] "RemoveContainer" containerID="8173522145f0051285f999f8730837337912075536e91aa35578493492bd18c1" Oct 30 20:30:05.694873 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.694854 5078 scope.go:122] "RemoveContainer" containerID="8173522145f0051285f999f8730837337912075536e91aa35578493492bd18c1" Oct 30 20:30:05.695148 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:30:05.695124 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8173522145f0051285f999f8730837337912075536e91aa35578493492bd18c1\": container with ID starting with 8173522145f0051285f999f8730837337912075536e91aa35578493492bd18c1 not found: ID does not exist" containerID="8173522145f0051285f999f8730837337912075536e91aa35578493492bd18c1" Oct 30 20:30:05.695194 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.695160 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8173522145f0051285f999f8730837337912075536e91aa35578493492bd18c1"} err="failed to get container status \"8173522145f0051285f999f8730837337912075536e91aa35578493492bd18c1\": rpc error: code = NotFound desc = could not find container \"8173522145f0051285f999f8730837337912075536e91aa35578493492bd18c1\": container with ID starting with 8173522145f0051285f999f8730837337912075536e91aa35578493492bd18c1 not found: ID does not exist" Oct 30 20:30:05.807013 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.806984 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-maas-api-tls\") pod \"d59c6d6c-7707-45b1-a74b-eb89c5b23f67\" (UID: \"d59c6d6c-7707-45b1-a74b-eb89c5b23f67\") " Oct 30 20:30:05.807226 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.807038 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-metrics-certs\") pod \"d59c6d6c-7707-45b1-a74b-eb89c5b23f67\" (UID: \"d59c6d6c-7707-45b1-a74b-eb89c5b23f67\") " Oct 30 20:30:05.807226 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.807134 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-openshift-service-ca\") pod \"d59c6d6c-7707-45b1-a74b-eb89c5b23f67\" (UID: \"d59c6d6c-7707-45b1-a74b-eb89c5b23f67\") " Oct 30 20:30:05.807226 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.807197 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-kube-api-access-nx7gc\" (UniqueName: \"kubernetes.io/projected/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-kube-api-access-nx7gc\") pod \"d59c6d6c-7707-45b1-a74b-eb89c5b23f67\" (UID: \"d59c6d6c-7707-45b1-a74b-eb89c5b23f67\") " Oct 30 20:30:05.807578 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.807547 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-openshift-service-ca" pod "d59c6d6c-7707-45b1-a74b-eb89c5b23f67" (UID: "d59c6d6c-7707-45b1-a74b-eb89c5b23f67"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:30:05.807717 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.807621 5078 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-openshift-service-ca\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:30:05.809568 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.809539 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-metrics-certs" pod "d59c6d6c-7707-45b1-a74b-eb89c5b23f67" (UID: "d59c6d6c-7707-45b1-a74b-eb89c5b23f67"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:30:05.809698 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.809595 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-kube-api-access-nx7gc" pod "d59c6d6c-7707-45b1-a74b-eb89c5b23f67" (UID: "d59c6d6c-7707-45b1-a74b-eb89c5b23f67"). InnerVolumeSpecName "kube-api-access-nx7gc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:30:05.809968 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.809940 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-maas-api-tls" pod "d59c6d6c-7707-45b1-a74b-eb89c5b23f67" (UID: "d59c6d6c-7707-45b1-a74b-eb89c5b23f67"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:30:05.908648 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.908603 5078 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-maas-api-tls\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:30:05.908648 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.908644 5078 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-metrics-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:30:05.908878 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:05.908658 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx7gc\" (UniqueName: \"kubernetes.io/projected/d59c6d6c-7707-45b1-a74b-eb89c5b23f67-kube-api-access-nx7gc\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:30:06.009185 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:06.009149 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh"] Oct 30 20:30:06.013532 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:06.013507 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-402199-5d88666f98-tgmqh"] Oct 30 20:30:07.584148 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:07.584113 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d59c6d6c-7707-45b1-a74b-eb89c5b23f67" path="/var/lib/kubelet/pods/d59c6d6c-7707-45b1-a74b-eb89c5b23f67/volumes" Oct 30 20:30:12.414540 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:12.414509 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg"] Oct 30 20:30:12.414978 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:12.414732 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" podUID="7b01230f-f0eb-4db0-bf71-5dc23825b9da" containerName="istio-proxy" containerID="cri-o://1b484fd03c991becf5f11aefea997423398385d61967c909e4c5e35d94367aa2" gracePeriod=30 Oct 30 20:30:17.684816 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.684745 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:30:17.724716 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.724687 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-workload-certs\") pod \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " Oct 30 20:30:17.724899 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.724788 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-data\") pod \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " Oct 30 20:30:17.724899 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.724809 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-credential-socket\") pod \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " Oct 30 20:30:17.724899 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.724847 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-podinfo\") pod \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " Oct 30 20:30:17.724899 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.724878 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b01230f-f0eb-4db0-bf71-5dc23825b9da-kube-api-access-shs44\" (UniqueName: \"kubernetes.io/projected/7b01230f-f0eb-4db0-bf71-5dc23825b9da-kube-api-access-shs44\") pod \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " Oct 30 20:30:17.725141 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.724944 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-token\" (UniqueName: \"kubernetes.io/projected/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-token\") pod \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " Oct 30 20:30:17.725141 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.724982 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-workload-certs" pod "7b01230f-f0eb-4db0-bf71-5dc23825b9da" (UID: "7b01230f-f0eb-4db0-bf71-5dc23825b9da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:30:17.725141 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.725001 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-workload-socket\") pod \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " Oct 30 20:30:17.725141 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.725079 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istiod-ca-cert\") pod \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " Oct 30 20:30:17.725141 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.725114 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-credential-socket" pod "7b01230f-f0eb-4db0-bf71-5dc23825b9da" (UID: "7b01230f-f0eb-4db0-bf71-5dc23825b9da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:30:17.725445 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.725144 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-envoy\") pod \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\" (UID: \"7b01230f-f0eb-4db0-bf71-5dc23825b9da\") " Oct 30 20:30:17.725445 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.725209 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-workload-socket" pod "7b01230f-f0eb-4db0-bf71-5dc23825b9da" (UID: "7b01230f-f0eb-4db0-bf71-5dc23825b9da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:30:17.725553 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.725455 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-data" pod "7b01230f-f0eb-4db0-bf71-5dc23825b9da" (UID: "7b01230f-f0eb-4db0-bf71-5dc23825b9da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:30:17.725616 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.725563 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istiod-ca-cert" pod "7b01230f-f0eb-4db0-bf71-5dc23825b9da" (UID: "7b01230f-f0eb-4db0-bf71-5dc23825b9da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:30:17.725679 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.725614 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:30:17.725679 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.725636 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:30:17.725679 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.725653 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:30:17.725679 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.725668 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:30:17.727249 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.727222 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-token" pod "7b01230f-f0eb-4db0-bf71-5dc23825b9da" (UID: "7b01230f-f0eb-4db0-bf71-5dc23825b9da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:30:17.727642 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.727616 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b01230f-f0eb-4db0-bf71-5dc23825b9da-kube-api-access-shs44" pod "7b01230f-f0eb-4db0-bf71-5dc23825b9da" (UID: "7b01230f-f0eb-4db0-bf71-5dc23825b9da"). InnerVolumeSpecName "kube-api-access-shs44". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:30:17.727794 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.727777 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-envoy" pod "7b01230f-f0eb-4db0-bf71-5dc23825b9da" (UID: "7b01230f-f0eb-4db0-bf71-5dc23825b9da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:30:17.727864 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.727795 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-podinfo" pod "7b01230f-f0eb-4db0-bf71-5dc23825b9da" (UID: "7b01230f-f0eb-4db0-bf71-5dc23825b9da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:30:17.750529 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.750495 5078 generic.go:356] "Generic (PLEG): container finished" podID="7b01230f-f0eb-4db0-bf71-5dc23825b9da" containerID="1b484fd03c991becf5f11aefea997423398385d61967c909e4c5e35d94367aa2" exitCode=0 Oct 30 20:30:17.750688 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.750544 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" event={"ID":"7b01230f-f0eb-4db0-bf71-5dc23825b9da","Type":"ContainerDied","Data":"1b484fd03c991becf5f11aefea997423398385d61967c909e4c5e35d94367aa2"} Oct 30 20:30:17.750688 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.750570 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" Oct 30 20:30:17.750688 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.750589 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg" event={"ID":"7b01230f-f0eb-4db0-bf71-5dc23825b9da","Type":"ContainerDied","Data":"982f039be32d257006504b3b6c5291dc988069ef349d466895724e6f6956c3cb"} Oct 30 20:30:17.750688 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.750610 5078 scope.go:122] "RemoveContainer" containerID="1b484fd03c991becf5f11aefea997423398385d61967c909e4c5e35d94367aa2" Oct 30 20:30:17.760234 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.760217 5078 scope.go:122] "RemoveContainer" containerID="e4d46831405a7e2cd41d2caced0a5225f5c7cd03cf2c0b0b80041d77d08cffb9" Oct 30 20:30:17.769059 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.769039 5078 scope.go:122] "RemoveContainer" containerID="1b484fd03c991becf5f11aefea997423398385d61967c909e4c5e35d94367aa2" Oct 30 20:30:17.769375 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:30:17.769354 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b484fd03c991becf5f11aefea997423398385d61967c909e4c5e35d94367aa2\": container with ID starting with 1b484fd03c991becf5f11aefea997423398385d61967c909e4c5e35d94367aa2 not found: ID does not exist" containerID="1b484fd03c991becf5f11aefea997423398385d61967c909e4c5e35d94367aa2" Oct 30 20:30:17.769452 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.769383 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b484fd03c991becf5f11aefea997423398385d61967c909e4c5e35d94367aa2"} err="failed to get container status \"1b484fd03c991becf5f11aefea997423398385d61967c909e4c5e35d94367aa2\": rpc error: code = NotFound desc = could not find container \"1b484fd03c991becf5f11aefea997423398385d61967c909e4c5e35d94367aa2\": container with ID starting with 1b484fd03c991becf5f11aefea997423398385d61967c909e4c5e35d94367aa2 not found: ID does not exist" Oct 30 20:30:17.769452 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.769403 5078 scope.go:122] "RemoveContainer" containerID="e4d46831405a7e2cd41d2caced0a5225f5c7cd03cf2c0b0b80041d77d08cffb9" Oct 30 20:30:17.769653 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:30:17.769632 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4d46831405a7e2cd41d2caced0a5225f5c7cd03cf2c0b0b80041d77d08cffb9\": container with ID starting with e4d46831405a7e2cd41d2caced0a5225f5c7cd03cf2c0b0b80041d77d08cffb9 not found: ID does not exist" containerID="e4d46831405a7e2cd41d2caced0a5225f5c7cd03cf2c0b0b80041d77d08cffb9" Oct 30 20:30:17.769702 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.769659 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4d46831405a7e2cd41d2caced0a5225f5c7cd03cf2c0b0b80041d77d08cffb9"} err="failed to get container status \"e4d46831405a7e2cd41d2caced0a5225f5c7cd03cf2c0b0b80041d77d08cffb9\": rpc error: code = NotFound desc = could not find container \"e4d46831405a7e2cd41d2caced0a5225f5c7cd03cf2c0b0b80041d77d08cffb9\": container with ID starting with e4d46831405a7e2cd41d2caced0a5225f5c7cd03cf2c0b0b80041d77d08cffb9 not found: ID does not exist" Oct 30 20:30:17.776263 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.776241 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg"] Oct 30 20:30:17.788018 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.787990 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-single-main-402199-openshift-default-dfbf49cf7-cl8gg"] Oct 30 20:30:17.826591 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.826558 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:30:17.826591 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.826588 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:30:17.826766 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.826601 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:30:17.826766 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.826611 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shs44\" (UniqueName: \"kubernetes.io/projected/7b01230f-f0eb-4db0-bf71-5dc23825b9da-kube-api-access-shs44\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:30:17.826766 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:17.826620 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b01230f-f0eb-4db0-bf71-5dc23825b9da-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:30:19.583967 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:19.583938 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7b01230f-f0eb-4db0-bf71-5dc23825b9da" path="/var/lib/kubelet/pods/7b01230f-f0eb-4db0-bf71-5dc23825b9da/volumes" Oct 30 20:30:26.765448 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:30:26.765389 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:30:27.107221 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:27.107179 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-4p5zj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:30:27.107570 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:30:27.107534 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" podUID="97082e84-45d0-4ca4-b427-d703172d8671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:30:56.699268 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:30:56.699223 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:31:26.698660 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:31:26.698570 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:31:56.697519 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:31:56.697472 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:32:24.246841 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.246805 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx"] Oct 30 20:32:24.248963 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.248531 5078 cpu_manager.go:414] "containerMap: removing container" podUID="7b01230f-f0eb-4db0-bf71-5dc23825b9da" containerName="istio-proxy" Oct 30 20:32:24.250216 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.249280 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7b01230f-f0eb-4db0-bf71-5dc23825b9da" containerName="istio-proxy" Oct 30 20:32:24.250216 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.249315 5078 cpu_manager.go:414] "containerMap: removing container" podUID="7b01230f-f0eb-4db0-bf71-5dc23825b9da" containerName="istio-proxy" Oct 30 20:32:24.250216 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.249325 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7b01230f-f0eb-4db0-bf71-5dc23825b9da" containerName="istio-proxy" Oct 30 20:32:24.250216 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.249402 5078 cpu_manager.go:414] "containerMap: removing container" podUID="d59c6d6c-7707-45b1-a74b-eb89c5b23f67" containerName="maas-api" Oct 30 20:32:24.250216 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.249410 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d59c6d6c-7707-45b1-a74b-eb89c5b23f67" containerName="maas-api" Oct 30 20:32:24.250216 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.249552 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="d59c6d6c-7707-45b1-a74b-eb89c5b23f67" containerName="maas-api" Oct 30 20:32:24.250216 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.249569 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="7b01230f-f0eb-4db0-bf71-5dc23825b9da" containerName="istio-proxy" Oct 30 20:32:24.250216 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.250077 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="7b01230f-f0eb-4db0-bf71-5dc23825b9da" containerName="istio-proxy" Oct 30 20:32:24.253972 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.253949 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx"] Oct 30 20:32:24.254095 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.254062 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.258603 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.258576 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-single-main-3f7c44-openshift-default-dockercfg-bd8rp\"" Oct 30 20:32:24.357352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.356926 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-workload-socket\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.357352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.357070 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-istio-envoy\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.357352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.357099 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-istio-data\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.357352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.357153 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-workload-certs\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.357352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.357178 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd59e850-f868-492f-875f-105b6a29c8db-istio-podinfo\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.357352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.357223 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-credential-socket\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.357352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.357275 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g8n9\" (UniqueName: \"kubernetes.io/projected/fd59e850-f868-492f-875f-105b6a29c8db-kube-api-access-7g8n9\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.357352 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.357305 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd59e850-f868-492f-875f-105b6a29c8db-istio-token\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.357903 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.357373 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd59e850-f868-492f-875f-105b6a29c8db-istiod-ca-cert\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.458491 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.458455 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-istio-envoy\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.458491 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.458496 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-istio-data\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.458744 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.458528 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-workload-certs\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.458744 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.458545 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd59e850-f868-492f-875f-105b6a29c8db-istio-podinfo\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.458744 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.458574 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-credential-socket\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.458744 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.458608 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g8n9\" (UniqueName: \"kubernetes.io/projected/fd59e850-f868-492f-875f-105b6a29c8db-kube-api-access-7g8n9\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.458744 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.458628 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd59e850-f868-492f-875f-105b6a29c8db-istio-token\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.458744 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.458661 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd59e850-f868-492f-875f-105b6a29c8db-istiod-ca-cert\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.459074 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.459012 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-workload-certs\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.459074 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.459034 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-workload-socket\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.459074 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.459061 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-istio-data\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.459240 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.459111 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-credential-socket\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.459400 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.459377 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-workload-socket\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.459481 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.459404 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd59e850-f868-492f-875f-105b6a29c8db-istiod-ca-cert\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.460941 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.460914 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-istio-envoy\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.461041 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.461026 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd59e850-f868-492f-875f-105b6a29c8db-istio-podinfo\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.472612 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.472590 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd59e850-f868-492f-875f-105b6a29c8db-istio-token\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.474671 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.474648 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g8n9\" (UniqueName: \"kubernetes.io/projected/fd59e850-f868-492f-875f-105b6a29c8db-kube-api-access-7g8n9\") pod \"e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.568870 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.568836 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:24.852025 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.852003 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx"] Oct 30 20:32:24.854562 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:32:24.854532 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd59e850_f868_492f_875f_105b6a29c8db.slice/crio-78aee41c6f0cb865033d43f0fd4d960b21c9bd422cc9ebb70edcfc2b42035745 WatchSource:0}: Error finding container 78aee41c6f0cb865033d43f0fd4d960b21c9bd422cc9ebb70edcfc2b42035745: Status 404 returned error can't find the container with id 78aee41c6f0cb865033d43f0fd4d960b21c9bd422cc9ebb70edcfc2b42035745 Oct 30 20:32:24.856840 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.856810 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:32:24.856920 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.856872 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:32:24.856920 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:24.856902 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:32:25.492978 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:25.492944 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" event={"ID":"fd59e850-f868-492f-875f-105b6a29c8db","Type":"ContainerStarted","Data":"3e80c0d63b78c6a209a30d6932727b568ce9306f3256ecc22306bff02aef81ea"} Oct 30 20:32:25.493458 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:25.492999 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" event={"ID":"fd59e850-f868-492f-875f-105b6a29c8db","Type":"ContainerStarted","Data":"78aee41c6f0cb865033d43f0fd4d960b21c9bd422cc9ebb70edcfc2b42035745"} Oct 30 20:32:25.518599 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:25.518550 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" podStartSLOduration=1.518536788 podStartE2EDuration="1.518536788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:32:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:32:25.5166282 +0000 UTC m=+1720.049900793" watchObservedRunningTime="2026-10-30 20:32:25.518536788 +0000 UTC m=+1720.051809439" Oct 30 20:32:25.569749 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:25.569725 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:25.574994 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:25.574970 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:26.499617 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:26.499581 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:26.500720 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:26.500698 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:26.698548 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:32:26.698504 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:32:29.134440 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:29.134406 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg"] Oct 30 20:32:29.138559 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:29.138532 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" Oct 30 20:32:29.151011 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:29.150984 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg"] Oct 30 20:32:29.156377 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:29.156346 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-3f7c44-serving-cert\"" Oct 30 20:32:29.312417 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:29.312385 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg\" (UID: \"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" Oct 30 20:32:29.312595 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:29.312444 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg\" (UID: \"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" Oct 30 20:32:29.312639 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:29.312586 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq6hr\" (UniqueName: \"kubernetes.io/projected/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-kube-api-access-jq6hr\") pod \"maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg\" (UID: \"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" Oct 30 20:32:29.312639 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:29.312623 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-metrics-certs\") pod \"maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg\" (UID: \"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" Oct 30 20:32:29.413384 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:29.413262 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg\" (UID: \"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" Oct 30 20:32:29.413677 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:29.413356 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg\" (UID: \"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" Oct 30 20:32:29.413677 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:32:29.413492 5078 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-serving-cert: secret "maas-api-e2e-worker-single-main-3f7c44-serving-cert" not found Oct 30 20:32:29.413677 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:29.413514 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq6hr\" (UniqueName: \"kubernetes.io/projected/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-kube-api-access-jq6hr\") pod \"maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg\" (UID: \"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" Oct 30 20:32:29.413677 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:29.413557 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-metrics-certs\") pod \"maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg\" (UID: \"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" Oct 30 20:32:29.413677 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:32:29.413576 5078 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-maas-api-tls podName:9a35d9d3-d0ea-4a15-b3ac-428a626d6c87 nodeName:}" failed. No retries permitted until 2026-10-30 20:32:29.913555184 +0000 UTC m=+1724.446827768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-maas-api-tls") pod "maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" (UID: "9a35d9d3-d0ea-4a15-b3ac-428a626d6c87") : secret "maas-api-e2e-worker-single-main-3f7c44-serving-cert" not found Oct 30 20:32:29.414047 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:29.414027 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg\" (UID: \"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" Oct 30 20:32:29.416285 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:29.416259 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-metrics-certs\") pod \"maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg\" (UID: \"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" Oct 30 20:32:29.426374 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:29.426354 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq6hr\" (UniqueName: \"kubernetes.io/projected/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-kube-api-access-jq6hr\") pod \"maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg\" (UID: \"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" Oct 30 20:32:29.927344 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:29.927291 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg\" (UID: \"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" Oct 30 20:32:29.929829 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:29.929793 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg\" (UID: \"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" Oct 30 20:32:30.055305 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:30.055274 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" Oct 30 20:32:30.333531 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:30.333507 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg"] Oct 30 20:32:30.335421 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:32:30.335391 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a35d9d3_d0ea_4a15_b3ac_428a626d6c87.slice/crio-561d7da89eee1ba7bf623e06801100e5267613dccbf2ddeed1ad45ff412e662f WatchSource:0}: Error finding container 561d7da89eee1ba7bf623e06801100e5267613dccbf2ddeed1ad45ff412e662f: Status 404 returned error can't find the container with id 561d7da89eee1ba7bf623e06801100e5267613dccbf2ddeed1ad45ff412e662f Oct 30 20:32:30.336709 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:30.336688 5078 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 20:32:30.523017 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:30.522980 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" event={"ID":"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87","Type":"ContainerStarted","Data":"561d7da89eee1ba7bf623e06801100e5267613dccbf2ddeed1ad45ff412e662f"} Oct 30 20:32:31.531388 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:31.531322 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" event={"ID":"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87","Type":"ContainerStarted","Data":"04ee71c4c60f6d96fe5cd0002f15824480cf764417fea5ba43ec7061b7be0da1"} Oct 30 20:32:31.531900 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:31.531410 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" Oct 30 20:32:31.555316 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:31.555254 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" podStartSLOduration=1.557467403 podStartE2EDuration="2.555239378s" totalImagesPullingTime="997.771975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:32:31.552980638 +0000 UTC m=+1726.086253229" watchObservedRunningTime="2026-10-30 20:32:31.555239378 +0000 UTC m=+1726.088511972" Oct 30 20:32:37.557837 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:37.557809 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" Oct 30 20:32:41.848355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:41.847562 5078 patch_prober.go:29] interesting pod/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": read tcp 10.132.0.2:51564->10.132.0.103:15021: read: connection reset by peer" start-of-body= Oct 30 20:32:41.848355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:41.847628 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" podUID="fd59e850-f868-492f-875f-105b6a29c8db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": read tcp 10.132.0.2:51564->10.132.0.103:15021: read: connection reset by peer" Oct 30 20:32:42.617746 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:42.617710 5078 generic.go:356] "Generic (PLEG): container finished" podID="fd59e850-f868-492f-875f-105b6a29c8db" containerID="3e80c0d63b78c6a209a30d6932727b568ce9306f3256ecc22306bff02aef81ea" exitCode=0 Oct 30 20:32:42.617915 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:42.617754 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" event={"ID":"fd59e850-f868-492f-875f-105b6a29c8db","Type":"ContainerDied","Data":"3e80c0d63b78c6a209a30d6932727b568ce9306f3256ecc22306bff02aef81ea"} Oct 30 20:32:42.618114 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:42.618099 5078 scope.go:122] "RemoveContainer" containerID="3e80c0d63b78c6a209a30d6932727b568ce9306f3256ecc22306bff02aef81ea" Oct 30 20:32:42.619267 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:42.619237 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:32:42.619394 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:42.619320 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:32:42.619472 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:42.619401 5078 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 20:32:43.625222 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:43.625188 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" event={"ID":"fd59e850-f868-492f-875f-105b6a29c8db","Type":"ContainerStarted","Data":"d0b79e16ea0c3016f197b827b61325d40ef32f6a36eabb07ddc9d68669c622f5"} Oct 30 20:32:44.569394 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:44.569362 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:44.569577 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:44.569554 5078 patch_prober.go:29] interesting pod/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body= Oct 30 20:32:44.569626 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:44.569601 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" podUID="fd59e850-f868-492f-875f-105b6a29c8db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" Oct 30 20:32:45.569937 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:45.569901 5078 patch_prober.go:29] interesting pod/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body= Oct 30 20:32:45.570381 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:45.569952 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" podUID="fd59e850-f868-492f-875f-105b6a29c8db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" Oct 30 20:32:46.569560 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:46.569526 5078 patch_prober.go:29] interesting pod/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body= Oct 30 20:32:46.569739 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:46.569597 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" podUID="fd59e850-f868-492f-875f-105b6a29c8db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" Oct 30 20:32:47.569196 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:47.569154 5078 patch_prober.go:29] interesting pod/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body= Oct 30 20:32:47.569740 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:47.569217 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" podUID="fd59e850-f868-492f-875f-105b6a29c8db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" Oct 30 20:32:48.570057 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:48.570013 5078 patch_prober.go:29] interesting pod/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body= Oct 30 20:32:48.570476 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:48.570082 5078 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" podUID="fd59e850-f868-492f-875f-105b6a29c8db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" Oct 30 20:32:49.573005 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:49.572972 5078 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:49.573531 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:49.573380 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:49.573974 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:32:49.573955 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:32:56.698282 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:32:56.698192 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:33:23.900936 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:23.900885 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg"] Oct 30 20:33:23.901582 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:23.901412 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" podUID="9a35d9d3-d0ea-4a15-b3ac-428a626d6c87" containerName="maas-api" containerID="cri-o://04ee71c4c60f6d96fe5cd0002f15824480cf764417fea5ba43ec7061b7be0da1" gracePeriod=30 Oct 30 20:33:24.201874 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.201845 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" Oct 30 20:33:24.295302 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.295269 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-kube-api-access-jq6hr\" (UniqueName: \"kubernetes.io/projected/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-kube-api-access-jq6hr\") pod \"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87\" (UID: \"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87\") " Oct 30 20:33:24.295529 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.295325 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-openshift-service-ca\") pod \"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87\" (UID: \"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87\") " Oct 30 20:33:24.295529 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.295380 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-metrics-certs\") pod \"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87\" (UID: \"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87\") " Oct 30 20:33:24.295529 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.295424 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-maas-api-tls\") pod \"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87\" (UID: \"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87\") " Oct 30 20:33:24.295799 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.295771 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-openshift-service-ca" pod "9a35d9d3-d0ea-4a15-b3ac-428a626d6c87" (UID: "9a35d9d3-d0ea-4a15-b3ac-428a626d6c87"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:33:24.297816 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.297793 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-kube-api-access-jq6hr" pod "9a35d9d3-d0ea-4a15-b3ac-428a626d6c87" (UID: "9a35d9d3-d0ea-4a15-b3ac-428a626d6c87"). InnerVolumeSpecName "kube-api-access-jq6hr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:33:24.297999 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.297974 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-maas-api-tls" pod "9a35d9d3-d0ea-4a15-b3ac-428a626d6c87" (UID: "9a35d9d3-d0ea-4a15-b3ac-428a626d6c87"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:33:24.298168 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.298144 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-metrics-certs" pod "9a35d9d3-d0ea-4a15-b3ac-428a626d6c87" (UID: "9a35d9d3-d0ea-4a15-b3ac-428a626d6c87"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:33:24.397324 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.397282 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq6hr\" (UniqueName: \"kubernetes.io/projected/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-kube-api-access-jq6hr\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:33:24.397324 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.397315 5078 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-openshift-service-ca\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:33:24.397572 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.397357 5078 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-metrics-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:33:24.397572 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.397370 5078 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87-maas-api-tls\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:33:24.872978 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.872941 5078 generic.go:356] "Generic (PLEG): container finished" podID="9a35d9d3-d0ea-4a15-b3ac-428a626d6c87" containerID="04ee71c4c60f6d96fe5cd0002f15824480cf764417fea5ba43ec7061b7be0da1" exitCode=0 Oct 30 20:33:24.873167 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.872984 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" Oct 30 20:33:24.873167 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.872983 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" event={"ID":"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87","Type":"ContainerDied","Data":"04ee71c4c60f6d96fe5cd0002f15824480cf764417fea5ba43ec7061b7be0da1"} Oct 30 20:33:24.873167 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.873111 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg" event={"ID":"9a35d9d3-d0ea-4a15-b3ac-428a626d6c87","Type":"ContainerDied","Data":"561d7da89eee1ba7bf623e06801100e5267613dccbf2ddeed1ad45ff412e662f"} Oct 30 20:33:24.873167 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.873133 5078 scope.go:122] "RemoveContainer" containerID="04ee71c4c60f6d96fe5cd0002f15824480cf764417fea5ba43ec7061b7be0da1" Oct 30 20:33:24.883363 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.883321 5078 scope.go:122] "RemoveContainer" containerID="04ee71c4c60f6d96fe5cd0002f15824480cf764417fea5ba43ec7061b7be0da1" Oct 30 20:33:24.883603 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:33:24.883583 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04ee71c4c60f6d96fe5cd0002f15824480cf764417fea5ba43ec7061b7be0da1\": container with ID starting with 04ee71c4c60f6d96fe5cd0002f15824480cf764417fea5ba43ec7061b7be0da1 not found: ID does not exist" containerID="04ee71c4c60f6d96fe5cd0002f15824480cf764417fea5ba43ec7061b7be0da1" Oct 30 20:33:24.883672 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.883615 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04ee71c4c60f6d96fe5cd0002f15824480cf764417fea5ba43ec7061b7be0da1"} err="failed to get container status \"04ee71c4c60f6d96fe5cd0002f15824480cf764417fea5ba43ec7061b7be0da1\": rpc error: code = NotFound desc = could not find container \"04ee71c4c60f6d96fe5cd0002f15824480cf764417fea5ba43ec7061b7be0da1\": container with ID starting with 04ee71c4c60f6d96fe5cd0002f15824480cf764417fea5ba43ec7061b7be0da1 not found: ID does not exist" Oct 30 20:33:24.903851 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.903816 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg"] Oct 30 20:33:24.904263 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:24.903872 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3f7c44-554f749578-wrbpg"] Oct 30 20:33:25.584578 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:25.584551 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9a35d9d3-d0ea-4a15-b3ac-428a626d6c87" path="/var/lib/kubelet/pods/9a35d9d3-d0ea-4a15-b3ac-428a626d6c87/volumes" Oct 30 20:33:26.697999 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:33:26.697956 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:33:31.586429 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:31.586401 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx"] Oct 30 20:33:31.586959 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:31.586638 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" podUID="fd59e850-f868-492f-875f-105b6a29c8db" containerName="istio-proxy" containerID="cri-o://d0b79e16ea0c3016f197b827b61325d40ef32f6a36eabb07ddc9d68669c622f5" gracePeriod=30 Oct 30 20:33:34.576539 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:34.576502 5078 patch_prober.go:29] interesting pod/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 20:33:34.576997 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:34.576563 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" podUID="fd59e850-f868-492f-875f-105b6a29c8db" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 20:33:36.838732 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.838707 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:33:36.923728 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.923651 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fd59e850-f868-492f-875f-105b6a29c8db-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd59e850-f868-492f-875f-105b6a29c8db-istio-podinfo\") pod \"fd59e850-f868-492f-875f-105b6a29c8db\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " Oct 30 20:33:36.923728 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.923689 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fd59e850-f868-492f-875f-105b6a29c8db-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd59e850-f868-492f-875f-105b6a29c8db-istiod-ca-cert\") pod \"fd59e850-f868-492f-875f-105b6a29c8db\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " Oct 30 20:33:36.923973 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.923737 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-istio-data\") pod \"fd59e850-f868-492f-875f-105b6a29c8db\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " Oct 30 20:33:36.923973 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.923815 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-credential-socket\") pod \"fd59e850-f868-492f-875f-105b6a29c8db\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " Oct 30 20:33:36.923973 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.923851 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fd59e850-f868-492f-875f-105b6a29c8db-istio-token\" (UniqueName: \"kubernetes.io/projected/fd59e850-f868-492f-875f-105b6a29c8db-istio-token\") pod \"fd59e850-f868-492f-875f-105b6a29c8db\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " Oct 30 20:33:36.923973 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.923878 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-istio-envoy\") pod \"fd59e850-f868-492f-875f-105b6a29c8db\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " Oct 30 20:33:36.923973 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.923917 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fd59e850-f868-492f-875f-105b6a29c8db-kube-api-access-7g8n9\" (UniqueName: \"kubernetes.io/projected/fd59e850-f868-492f-875f-105b6a29c8db-kube-api-access-7g8n9\") pod \"fd59e850-f868-492f-875f-105b6a29c8db\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " Oct 30 20:33:36.924253 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.923989 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-workload-socket\") pod \"fd59e850-f868-492f-875f-105b6a29c8db\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " Oct 30 20:33:36.924253 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.924029 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-workload-certs\") pod \"fd59e850-f868-492f-875f-105b6a29c8db\" (UID: \"fd59e850-f868-492f-875f-105b6a29c8db\") " Oct 30 20:33:36.924253 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.924181 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-credential-socket" pod "fd59e850-f868-492f-875f-105b6a29c8db" (UID: "fd59e850-f868-492f-875f-105b6a29c8db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:33:36.924253 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.924199 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-istio-data" pod "fd59e850-f868-492f-875f-105b6a29c8db" (UID: "fd59e850-f868-492f-875f-105b6a29c8db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:33:36.924253 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.924220 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd59e850-f868-492f-875f-105b6a29c8db-istiod-ca-cert" pod "fd59e850-f868-492f-875f-105b6a29c8db" (UID: "fd59e850-f868-492f-875f-105b6a29c8db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:33:36.924527 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.924396 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-workload-certs" pod "fd59e850-f868-492f-875f-105b6a29c8db" (UID: "fd59e850-f868-492f-875f-105b6a29c8db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:33:36.924527 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.924421 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-workload-socket" pod "fd59e850-f868-492f-875f-105b6a29c8db" (UID: "fd59e850-f868-492f-875f-105b6a29c8db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:33:36.924527 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.924508 5078 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-workload-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:33:36.924527 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.924526 5078 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-workload-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:33:36.924751 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.924538 5078 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd59e850-f868-492f-875f-105b6a29c8db-istiod-ca-cert\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:33:36.924751 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.924556 5078 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-istio-data\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:33:36.924751 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.924575 5078 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-credential-socket\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:33:36.926095 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.926071 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fd59e850-f868-492f-875f-105b6a29c8db-istio-podinfo" pod "fd59e850-f868-492f-875f-105b6a29c8db" (UID: "fd59e850-f868-492f-875f-105b6a29c8db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 20:33:36.926212 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.926109 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-istio-envoy" pod "fd59e850-f868-492f-875f-105b6a29c8db" (UID: "fd59e850-f868-492f-875f-105b6a29c8db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 20:33:36.926212 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.926130 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd59e850-f868-492f-875f-105b6a29c8db-istio-token" pod "fd59e850-f868-492f-875f-105b6a29c8db" (UID: "fd59e850-f868-492f-875f-105b6a29c8db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:33:36.926212 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.926161 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd59e850-f868-492f-875f-105b6a29c8db-kube-api-access-7g8n9" pod "fd59e850-f868-492f-875f-105b6a29c8db" (UID: "fd59e850-f868-492f-875f-105b6a29c8db"). InnerVolumeSpecName "kube-api-access-7g8n9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:33:36.944411 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.944380 5078 generic.go:356] "Generic (PLEG): container finished" podID="fd59e850-f868-492f-875f-105b6a29c8db" containerID="d0b79e16ea0c3016f197b827b61325d40ef32f6a36eabb07ddc9d68669c622f5" exitCode=0 Oct 30 20:33:36.944540 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.944456 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" Oct 30 20:33:36.944540 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.944464 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" event={"ID":"fd59e850-f868-492f-875f-105b6a29c8db","Type":"ContainerDied","Data":"d0b79e16ea0c3016f197b827b61325d40ef32f6a36eabb07ddc9d68669c622f5"} Oct 30 20:33:36.944616 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.944544 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx" event={"ID":"fd59e850-f868-492f-875f-105b6a29c8db","Type":"ContainerDied","Data":"78aee41c6f0cb865033d43f0fd4d960b21c9bd422cc9ebb70edcfc2b42035745"} Oct 30 20:33:36.944616 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.944567 5078 scope.go:122] "RemoveContainer" containerID="d0b79e16ea0c3016f197b827b61325d40ef32f6a36eabb07ddc9d68669c622f5" Oct 30 20:33:36.956269 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.956250 5078 scope.go:122] "RemoveContainer" containerID="3e80c0d63b78c6a209a30d6932727b568ce9306f3256ecc22306bff02aef81ea" Oct 30 20:33:36.964888 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.964872 5078 scope.go:122] "RemoveContainer" containerID="d0b79e16ea0c3016f197b827b61325d40ef32f6a36eabb07ddc9d68669c622f5" Oct 30 20:33:36.965140 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:33:36.965119 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0b79e16ea0c3016f197b827b61325d40ef32f6a36eabb07ddc9d68669c622f5\": container with ID starting with d0b79e16ea0c3016f197b827b61325d40ef32f6a36eabb07ddc9d68669c622f5 not found: ID does not exist" containerID="d0b79e16ea0c3016f197b827b61325d40ef32f6a36eabb07ddc9d68669c622f5" Oct 30 20:33:36.965215 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.965152 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b79e16ea0c3016f197b827b61325d40ef32f6a36eabb07ddc9d68669c622f5"} err="failed to get container status \"d0b79e16ea0c3016f197b827b61325d40ef32f6a36eabb07ddc9d68669c622f5\": rpc error: code = NotFound desc = could not find container \"d0b79e16ea0c3016f197b827b61325d40ef32f6a36eabb07ddc9d68669c622f5\": container with ID starting with d0b79e16ea0c3016f197b827b61325d40ef32f6a36eabb07ddc9d68669c622f5 not found: ID does not exist" Oct 30 20:33:36.965215 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.965177 5078 scope.go:122] "RemoveContainer" containerID="3e80c0d63b78c6a209a30d6932727b568ce9306f3256ecc22306bff02aef81ea" Oct 30 20:33:36.965436 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:33:36.965419 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e80c0d63b78c6a209a30d6932727b568ce9306f3256ecc22306bff02aef81ea\": container with ID starting with 3e80c0d63b78c6a209a30d6932727b568ce9306f3256ecc22306bff02aef81ea not found: ID does not exist" containerID="3e80c0d63b78c6a209a30d6932727b568ce9306f3256ecc22306bff02aef81ea" Oct 30 20:33:36.965486 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.965442 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e80c0d63b78c6a209a30d6932727b568ce9306f3256ecc22306bff02aef81ea"} err="failed to get container status \"3e80c0d63b78c6a209a30d6932727b568ce9306f3256ecc22306bff02aef81ea\": rpc error: code = NotFound desc = could not find container \"3e80c0d63b78c6a209a30d6932727b568ce9306f3256ecc22306bff02aef81ea\": container with ID starting with 3e80c0d63b78c6a209a30d6932727b568ce9306f3256ecc22306bff02aef81ea not found: ID does not exist" Oct 30 20:33:36.971881 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.971860 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx"] Oct 30 20:33:36.977069 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:36.977049 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-single-main-3f7c44-openshift-default-7988497f69qtndx"] Oct 30 20:33:37.025712 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:37.025684 5078 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd59e850-f868-492f-875f-105b6a29c8db-istio-podinfo\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:33:37.025712 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:37.025709 5078 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd59e850-f868-492f-875f-105b6a29c8db-istio-token\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:33:37.025712 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:37.025719 5078 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd59e850-f868-492f-875f-105b6a29c8db-istio-envoy\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:33:37.025917 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:37.025728 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7g8n9\" (UniqueName: \"kubernetes.io/projected/fd59e850-f868-492f-875f-105b6a29c8db-kube-api-access-7g8n9\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:33:37.585064 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:37.585029 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fd59e850-f868-492f-875f-105b6a29c8db" path="/var/lib/kubelet/pods/fd59e850-f868-492f-875f-105b6a29c8db/volumes" Oct 30 20:33:42.101996 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:42.101939 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-4p5zj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:33:42.102843 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:42.102809 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" podUID="97082e84-45d0-4ca4-b427-d703172d8671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:33:45.819232 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:45.819193 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/1.log" Oct 30 20:33:45.821719 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:45.821695 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/1.log" Oct 30 20:33:56.955664 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:33:56.955622 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:33:57.105700 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:57.105642 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-4p5zj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:33:57.106028 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:33:57.105980 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" podUID="97082e84-45d0-4ca4-b427-d703172d8671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:34:13.417095 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:34:13.417054 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-mct6s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:34:13.418027 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:34:13.417993 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" podUID="728c746f-de35-4521-90a5-262af3971cc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:34:13.442466 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:34:13.442433 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-rnm76 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:34:13.442738 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:34:13.442707 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" podUID="f281b490-5afe-467a-a479-483203314e1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:34:26.712804 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:34:26.712677 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:34:28.416712 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:34:28.416666 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-mct6s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:34:28.417383 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:34:28.417324 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-mct6s" podUID="728c746f-de35-4521-90a5-262af3971cc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:34:28.429443 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:34:28.429413 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-rnm76 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:34:28.429663 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:34:28.429636 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-rnm76" podUID="f281b490-5afe-467a-a479-483203314e1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:34:56.699254 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:34:56.699212 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:34:59.924659 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:34:59.924622 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-595cc648c-cwt4x"] Oct 30 20:34:59.925180 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:34:59.925163 5078 cpu_manager.go:414] "containerMap: removing container" podUID="fd59e850-f868-492f-875f-105b6a29c8db" containerName="istio-proxy" Oct 30 20:34:59.925260 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:34:59.925181 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fd59e850-f868-492f-875f-105b6a29c8db" containerName="istio-proxy" Oct 30 20:34:59.925260 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:34:59.925206 5078 cpu_manager.go:414] "containerMap: removing container" podUID="fd59e850-f868-492f-875f-105b6a29c8db" containerName="istio-proxy" Oct 30 20:34:59.925260 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:34:59.925212 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fd59e850-f868-492f-875f-105b6a29c8db" containerName="istio-proxy" Oct 30 20:34:59.925260 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:34:59.925219 5078 cpu_manager.go:414] "containerMap: removing container" podUID="9a35d9d3-d0ea-4a15-b3ac-428a626d6c87" containerName="maas-api" Oct 30 20:34:59.925260 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:34:59.925224 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9a35d9d3-d0ea-4a15-b3ac-428a626d6c87" containerName="maas-api" Oct 30 20:34:59.925564 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:34:59.925322 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="fd59e850-f868-492f-875f-105b6a29c8db" containerName="istio-proxy" Oct 30 20:34:59.925564 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:34:59.925455 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="fd59e850-f868-492f-875f-105b6a29c8db" containerName="istio-proxy" Oct 30 20:34:59.925564 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:34:59.925493 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="9a35d9d3-d0ea-4a15-b3ac-428a626d6c87" containerName="maas-api" Oct 30 20:34:59.929099 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:34:59.929078 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-595cc648c-cwt4x" Oct 30 20:34:59.944048 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:34:59.944018 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-595cc648c-cwt4x"] Oct 30 20:35:00.042400 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:00.042357 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpfv4\" (UniqueName: \"kubernetes.io/projected/bafbe0ff-8d94-42a4-af17-81e14427f41f-kube-api-access-rpfv4\") pod \"maas-api-595cc648c-cwt4x\" (UID: \"bafbe0ff-8d94-42a4-af17-81e14427f41f\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-cwt4x" Oct 30 20:35:00.042594 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:00.042413 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bafbe0ff-8d94-42a4-af17-81e14427f41f-maas-api-tls\") pod \"maas-api-595cc648c-cwt4x\" (UID: \"bafbe0ff-8d94-42a4-af17-81e14427f41f\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-cwt4x" Oct 30 20:35:00.042594 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:00.042441 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bafbe0ff-8d94-42a4-af17-81e14427f41f-openshift-service-ca\") pod \"maas-api-595cc648c-cwt4x\" (UID: \"bafbe0ff-8d94-42a4-af17-81e14427f41f\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-cwt4x" Oct 30 20:35:00.042594 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:00.042541 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bafbe0ff-8d94-42a4-af17-81e14427f41f-metrics-certs\") pod \"maas-api-595cc648c-cwt4x\" (UID: \"bafbe0ff-8d94-42a4-af17-81e14427f41f\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-cwt4x" Oct 30 20:35:00.144022 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:00.143981 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpfv4\" (UniqueName: \"kubernetes.io/projected/bafbe0ff-8d94-42a4-af17-81e14427f41f-kube-api-access-rpfv4\") pod \"maas-api-595cc648c-cwt4x\" (UID: \"bafbe0ff-8d94-42a4-af17-81e14427f41f\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-cwt4x" Oct 30 20:35:00.144187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:00.144030 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bafbe0ff-8d94-42a4-af17-81e14427f41f-maas-api-tls\") pod \"maas-api-595cc648c-cwt4x\" (UID: \"bafbe0ff-8d94-42a4-af17-81e14427f41f\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-cwt4x" Oct 30 20:35:00.144187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:00.144056 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bafbe0ff-8d94-42a4-af17-81e14427f41f-openshift-service-ca\") pod \"maas-api-595cc648c-cwt4x\" (UID: \"bafbe0ff-8d94-42a4-af17-81e14427f41f\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-cwt4x" Oct 30 20:35:00.144187 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:00.144113 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bafbe0ff-8d94-42a4-af17-81e14427f41f-metrics-certs\") pod \"maas-api-595cc648c-cwt4x\" (UID: \"bafbe0ff-8d94-42a4-af17-81e14427f41f\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-cwt4x" Oct 30 20:35:00.144942 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:00.144915 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bafbe0ff-8d94-42a4-af17-81e14427f41f-openshift-service-ca\") pod \"maas-api-595cc648c-cwt4x\" (UID: \"bafbe0ff-8d94-42a4-af17-81e14427f41f\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-cwt4x" Oct 30 20:35:00.146911 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:00.146876 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bafbe0ff-8d94-42a4-af17-81e14427f41f-metrics-certs\") pod \"maas-api-595cc648c-cwt4x\" (UID: \"bafbe0ff-8d94-42a4-af17-81e14427f41f\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-cwt4x" Oct 30 20:35:00.147084 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:00.147064 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bafbe0ff-8d94-42a4-af17-81e14427f41f-maas-api-tls\") pod \"maas-api-595cc648c-cwt4x\" (UID: \"bafbe0ff-8d94-42a4-af17-81e14427f41f\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-cwt4x" Oct 30 20:35:00.156311 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:00.156287 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpfv4\" (UniqueName: \"kubernetes.io/projected/bafbe0ff-8d94-42a4-af17-81e14427f41f-kube-api-access-rpfv4\") pod \"maas-api-595cc648c-cwt4x\" (UID: \"bafbe0ff-8d94-42a4-af17-81e14427f41f\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-cwt4x" Oct 30 20:35:00.251289 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:00.251193 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-595cc648c-cwt4x" Oct 30 20:35:00.531656 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:00.531624 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-595cc648c-cwt4x"] Oct 30 20:35:00.533409 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:35:00.533378 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbafbe0ff_8d94_42a4_af17_81e14427f41f.slice/crio-92cf7384616a2ed545c017bc86e9dc52005c14a2f63ac483b7c953d6cd1962b7 WatchSource:0}: Error finding container 92cf7384616a2ed545c017bc86e9dc52005c14a2f63ac483b7c953d6cd1962b7: Status 404 returned error can't find the container with id 92cf7384616a2ed545c017bc86e9dc52005c14a2f63ac483b7c953d6cd1962b7 Oct 30 20:35:00.802583 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:00.802503 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-595cc648c-cwt4x" event={"ID":"bafbe0ff-8d94-42a4-af17-81e14427f41f","Type":"ContainerStarted","Data":"92cf7384616a2ed545c017bc86e9dc52005c14a2f63ac483b7c953d6cd1962b7"} Oct 30 20:35:01.809242 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:01.809207 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-595cc648c-cwt4x" event={"ID":"bafbe0ff-8d94-42a4-af17-81e14427f41f","Type":"ContainerStarted","Data":"edd57c4bc88e3b36beaf69fa032381536bb1b240fefd1e1ca24b446cdf16fdf9"} Oct 30 20:35:01.809695 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:01.809309 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-595cc648c-cwt4x" Oct 30 20:35:01.831515 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:01.831458 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-595cc648c-cwt4x" podStartSLOduration=2.343631864 podStartE2EDuration="2.83144377s" totalImagesPullingTime="487.811906ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:34:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:35:01.829454202 +0000 UTC m=+1876.362726806" watchObservedRunningTime="2026-10-30 20:35:01.83144377 +0000 UTC m=+1876.364716364" Oct 30 20:35:07.820840 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:07.820812 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-595cc648c-cwt4x" Oct 30 20:35:17.057338 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:17.057302 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd"] Oct 30 20:35:17.057880 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:17.057534 5078 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" podUID="6f3008b4-8bb4-4b51-b2ae-54d2a0148809" containerName="maas-api" containerID="cri-o://94fc7b3bce7a245efb0b8e2f8a0c0e986e05a689459cc7c42cb2b5dc5a0e9a7b" gracePeriod=30 Oct 30 20:35:18.308556 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.308532 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" Oct 30 20:35:18.426090 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.426013 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-kube-api-access-fdbjk\" (UniqueName: \"kubernetes.io/projected/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-kube-api-access-fdbjk\") pod \"6f3008b4-8bb4-4b51-b2ae-54d2a0148809\" (UID: \"6f3008b4-8bb4-4b51-b2ae-54d2a0148809\") " Oct 30 20:35:18.426090 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.426074 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-maas-api-tls\") pod \"6f3008b4-8bb4-4b51-b2ae-54d2a0148809\" (UID: \"6f3008b4-8bb4-4b51-b2ae-54d2a0148809\") " Oct 30 20:35:18.426317 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.426100 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-metrics-certs\") pod \"6f3008b4-8bb4-4b51-b2ae-54d2a0148809\" (UID: \"6f3008b4-8bb4-4b51-b2ae-54d2a0148809\") " Oct 30 20:35:18.426317 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.426136 5078 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-openshift-service-ca\") pod \"6f3008b4-8bb4-4b51-b2ae-54d2a0148809\" (UID: \"6f3008b4-8bb4-4b51-b2ae-54d2a0148809\") " Oct 30 20:35:18.426640 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.426612 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-openshift-service-ca" pod "6f3008b4-8bb4-4b51-b2ae-54d2a0148809" (UID: "6f3008b4-8bb4-4b51-b2ae-54d2a0148809"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 20:35:18.428120 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.428092 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-metrics-certs" pod "6f3008b4-8bb4-4b51-b2ae-54d2a0148809" (UID: "6f3008b4-8bb4-4b51-b2ae-54d2a0148809"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:35:18.428209 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.428138 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-kube-api-access-fdbjk" pod "6f3008b4-8bb4-4b51-b2ae-54d2a0148809" (UID: "6f3008b4-8bb4-4b51-b2ae-54d2a0148809"). InnerVolumeSpecName "kube-api-access-fdbjk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 20:35:18.428209 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.428155 5078 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-maas-api-tls" pod "6f3008b4-8bb4-4b51-b2ae-54d2a0148809" (UID: "6f3008b4-8bb4-4b51-b2ae-54d2a0148809"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 20:35:18.526956 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.526925 5078 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdbjk\" (UniqueName: \"kubernetes.io/projected/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-kube-api-access-fdbjk\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:35:18.526956 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.526952 5078 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-maas-api-tls\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:35:18.526956 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.526962 5078 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-metrics-certs\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:35:18.527191 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.526972 5078 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f3008b4-8bb4-4b51-b2ae-54d2a0148809-openshift-service-ca\") on node \"ip-10-0-139-217.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 20:35:18.966823 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.966786 5078 generic.go:356] "Generic (PLEG): container finished" podID="6f3008b4-8bb4-4b51-b2ae-54d2a0148809" containerID="94fc7b3bce7a245efb0b8e2f8a0c0e986e05a689459cc7c42cb2b5dc5a0e9a7b" exitCode=0 Oct 30 20:35:18.967010 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.966830 5078 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" Oct 30 20:35:18.967010 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.966875 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" event={"ID":"6f3008b4-8bb4-4b51-b2ae-54d2a0148809","Type":"ContainerDied","Data":"94fc7b3bce7a245efb0b8e2f8a0c0e986e05a689459cc7c42cb2b5dc5a0e9a7b"} Oct 30 20:35:18.967010 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.966929 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd" event={"ID":"6f3008b4-8bb4-4b51-b2ae-54d2a0148809","Type":"ContainerDied","Data":"b091945cf0fcc37e62df62887be42324d050fd8ffbb9884d4fd6458d90972328"} Oct 30 20:35:18.967010 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.966952 5078 scope.go:122] "RemoveContainer" containerID="94fc7b3bce7a245efb0b8e2f8a0c0e986e05a689459cc7c42cb2b5dc5a0e9a7b" Oct 30 20:35:18.977171 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.977151 5078 scope.go:122] "RemoveContainer" containerID="94fc7b3bce7a245efb0b8e2f8a0c0e986e05a689459cc7c42cb2b5dc5a0e9a7b" Oct 30 20:35:18.977462 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:35:18.977441 5078 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94fc7b3bce7a245efb0b8e2f8a0c0e986e05a689459cc7c42cb2b5dc5a0e9a7b\": container with ID starting with 94fc7b3bce7a245efb0b8e2f8a0c0e986e05a689459cc7c42cb2b5dc5a0e9a7b not found: ID does not exist" containerID="94fc7b3bce7a245efb0b8e2f8a0c0e986e05a689459cc7c42cb2b5dc5a0e9a7b" Oct 30 20:35:18.977543 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.977475 5078 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94fc7b3bce7a245efb0b8e2f8a0c0e986e05a689459cc7c42cb2b5dc5a0e9a7b"} err="failed to get container status \"94fc7b3bce7a245efb0b8e2f8a0c0e986e05a689459cc7c42cb2b5dc5a0e9a7b\": rpc error: code = NotFound desc = could not find container \"94fc7b3bce7a245efb0b8e2f8a0c0e986e05a689459cc7c42cb2b5dc5a0e9a7b\": container with ID starting with 94fc7b3bce7a245efb0b8e2f8a0c0e986e05a689459cc7c42cb2b5dc5a0e9a7b not found: ID does not exist" Oct 30 20:35:18.990272 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.990251 5078 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd"] Oct 30 20:35:18.994893 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:18.994866 5078 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-x9vxd"] Oct 30 20:35:19.583980 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:19.583949 5078 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6f3008b4-8bb4-4b51-b2ae-54d2a0148809" path="/var/lib/kubelet/pods/6f3008b4-8bb4-4b51-b2ae-54d2a0148809/volumes" Oct 30 20:35:26.698437 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:35:26.698390 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:35:56.800411 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:35:56.798105 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:35:57.103468 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:57.103424 5078 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-64d4cc998c-4p5zj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 20:35:57.103838 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:35:57.103800 5078 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-64d4cc998c-4p5zj" podUID="97082e84-45d0-4ca4-b427-d703172d8671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 20:36:06.878108 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:06.878081 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6f69558f77-dxrdp_b266ac29-fd57-49a6-acc5-e67aba37864d/manager/0.log" Oct 30 20:36:07.074578 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:07.074543 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-64vpw_8fa2c3f1-8034-452b-9d06-fa6e84573c05/manager/0.log" Oct 30 20:36:07.769549 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:07.769508 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76fb996bcf-4br2k_73330fbb-b274-4748-b91d-065ca47fbb94/manager/0.log" Oct 30 20:36:08.000926 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:08.000897 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-vgl8x_0539e8ae-dc5f-4ed9-8f34-0c0a928b7409/server/0.log" Oct 30 20:36:08.191193 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:08.191136 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-f87fcf56c-kdkbm_3ae3de76-2d1f-413a-a07a-46f367221dcf/manager/0.log" Oct 30 20:36:08.881652 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:08.881626 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft_905da0b8-b345-447a-960f-7f3ddaa544ff/copy-manifests/0.log" Oct 30 20:36:08.903122 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:08.903100 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft_905da0b8-b345-447a-960f-7f3ddaa544ff/manager/0.log" Oct 30 20:36:09.358520 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:09.358472 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-7d94f55f4b-ltspk_6bd378ec-e598-445c-a5c5-6d46ebe9226d/proxy/0.log" Oct 30 20:36:10.159104 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:10.159073 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-595cc648c-cwt4x_bafbe0ff-8d94-42a4-af17-81e14427f41f/maas-api/0.log" Oct 30 20:36:14.128512 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:14.128480 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d6dd76dc-jm276_5b1aff91-a0ed-41ac-bab9-00877ecc6b27/manager/0.log" Oct 30 20:36:16.041390 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:16.041360 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7_7f5345fa-631a-402f-9cca-7e7cc832283f/istio-proxy/0.log" Oct 30 20:36:16.232321 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:16.232292 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-rzs4p_465367da-f578-4099-9ce5-0fb854fb2482/discovery/0.log" Oct 30 20:36:16.432090 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:16.432057 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d477969dd-cchjb_7d85401f-0ca6-4d63-a134-1c1a40bd1754/kube-auth-proxy/0.log" Oct 30 20:36:17.053030 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:17.052998 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-4p5zj_97082e84-45d0-4ca4-b427-d703172d8671/istio-proxy/0.log" Oct 30 20:36:17.823879 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:17.823851 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-mct6s_728c746f-de35-4521-90a5-262af3971cc2/istio-proxy/0.log" Oct 30 20:36:18.230183 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:18.230112 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-pzpq5_626f7c24-fa80-4b57-ab5c-9739398bd547/istio-proxy/1.log" Oct 30 20:36:18.436839 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:18.436809 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-rnm76_f281b490-5afe-467a-a479-483203314e1c/istio-proxy/0.log" Oct 30 20:36:18.810615 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:18.810552 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-55qkv_21103aa0-66f4-446b-b377-d3bac5973c2e/payload-pre-processing/0.log" Oct 30 20:36:19.003740 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:19.003702 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-sztc2_5392a640-4770-4118-90de-fdeb9ce14da1/payload-processing/0.log" Oct 30 20:36:19.199786 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:19.199691 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f94f8f65c-dqcj8_2e5941e6-4fc9-4353-a518-8ad492e9ad61/router/0.log" Oct 30 20:36:19.648183 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:19.648149 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-pzpq5_626f7c24-fa80-4b57-ab5c-9739398bd547/istio-proxy/0.log" Oct 30 20:36:20.205255 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:20.205212 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t_99fc63f4-6234-44b4-9627-031cc95991ca/main/0.log" Oct 30 20:36:20.590775 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:20.590744 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-85ns8_6544cfff-736a-4c71-a9d2-630833e88a05/main/0.log" Oct 30 20:36:20.980687 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:20.980609 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4_e426b14f-ee43-48e8-bac1-c82651a177ba/main/0.log" Oct 30 20:36:26.698212 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:36:26.698176 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:36:32.094232 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:32.094198 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6f69558f77-dxrdp_b266ac29-fd57-49a6-acc5-e67aba37864d/manager/0.log" Oct 30 20:36:32.284268 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:32.284237 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-64vpw_8fa2c3f1-8034-452b-9d06-fa6e84573c05/manager/0.log" Oct 30 20:36:32.895855 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:32.895822 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76fb996bcf-4br2k_73330fbb-b274-4748-b91d-065ca47fbb94/manager/0.log" Oct 30 20:36:33.115847 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:33.115820 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-vgl8x_0539e8ae-dc5f-4ed9-8f34-0c0a928b7409/server/0.log" Oct 30 20:36:33.292426 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:33.292347 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-f87fcf56c-kdkbm_3ae3de76-2d1f-413a-a07a-46f367221dcf/manager/0.log" Oct 30 20:36:33.987105 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:33.987074 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft_905da0b8-b345-447a-960f-7f3ddaa544ff/copy-manifests/0.log" Oct 30 20:36:34.006738 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:34.006714 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft_905da0b8-b345-447a-960f-7f3ddaa544ff/manager/0.log" Oct 30 20:36:34.448343 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:34.448310 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-7d94f55f4b-ltspk_6bd378ec-e598-445c-a5c5-6d46ebe9226d/proxy/0.log" Oct 30 20:36:35.009418 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:35.009380 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-595cc648c-cwt4x_bafbe0ff-8d94-42a4-af17-81e14427f41f/maas-api/0.log" Oct 30 20:36:38.402889 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:38.402849 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d6dd76dc-jm276_5b1aff91-a0ed-41ac-bab9-00877ecc6b27/manager/0.log" Oct 30 20:36:39.920164 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:39.920131 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7_7f5345fa-631a-402f-9cca-7e7cc832283f/istio-proxy/0.log" Oct 30 20:36:40.115242 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:40.115212 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-rzs4p_465367da-f578-4099-9ce5-0fb854fb2482/discovery/0.log" Oct 30 20:36:40.298446 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:40.298350 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d477969dd-cchjb_7d85401f-0ca6-4d63-a134-1c1a40bd1754/kube-auth-proxy/0.log" Oct 30 20:36:40.845726 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:40.845700 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-4p5zj_97082e84-45d0-4ca4-b427-d703172d8671/istio-proxy/0.log" Oct 30 20:36:41.596887 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:41.596860 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-mct6s_728c746f-de35-4521-90a5-262af3971cc2/istio-proxy/0.log" Oct 30 20:36:41.969341 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:41.969247 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-pzpq5_626f7c24-fa80-4b57-ab5c-9739398bd547/istio-proxy/1.log" Oct 30 20:36:42.165407 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:42.165379 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-rnm76_f281b490-5afe-467a-a479-483203314e1c/istio-proxy/0.log" Oct 30 20:36:42.547585 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:42.547553 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-55qkv_21103aa0-66f4-446b-b377-d3bac5973c2e/payload-pre-processing/0.log" Oct 30 20:36:42.728930 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:42.728893 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-sztc2_5392a640-4770-4118-90de-fdeb9ce14da1/payload-processing/0.log" Oct 30 20:36:42.918796 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:42.918767 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f94f8f65c-dqcj8_2e5941e6-4fc9-4353-a518-8ad492e9ad61/router/0.log" Oct 30 20:36:43.452860 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:43.452831 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-2pz8t_99fc63f4-6234-44b4-9627-031cc95991ca/main/0.log" Oct 30 20:36:43.828091 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:43.828059 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-85ns8_6544cfff-736a-4c71-a9d2-630833e88a05/main/0.log" Oct 30 20:36:44.195729 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:36:44.195653 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8hpwq4_e426b14f-ee43-48e8-bac1-c82651a177ba/main/0.log" Oct 30 20:36:56.697288 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:36:56.697242 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:37:22.482534 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:37:22.482502 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76fb996bcf-4br2k_73330fbb-b274-4748-b91d-065ca47fbb94/manager/0.log" Oct 30 20:37:22.747297 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:37:22.747219 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76fb996bcf-4br2k_73330fbb-b274-4748-b91d-065ca47fbb94/manager/0.log" Oct 30 20:37:23.472931 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:37:23.472899 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-sztc2_5392a640-4770-4118-90de-fdeb9ce14da1/payload-processing/0.log" Oct 30 20:37:23.661096 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:37:23.661070 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-sztc2_5392a640-4770-4118-90de-fdeb9ce14da1/payload-processing/0.log" Oct 30 20:37:26.698682 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:37:26.698603 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:37:56.699068 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:37:56.699029 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:38:10.513537 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:10.513505 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76fb996bcf-4br2k_73330fbb-b274-4748-b91d-065ca47fbb94/manager/0.log" Oct 30 20:38:10.785074 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:10.784994 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76fb996bcf-4br2k_73330fbb-b274-4748-b91d-065ca47fbb94/manager/0.log" Oct 30 20:38:11.485355 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:11.485314 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-sztc2_5392a640-4770-4118-90de-fdeb9ce14da1/payload-processing/0.log" Oct 30 20:38:11.672920 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:11.672895 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-sztc2_5392a640-4770-4118-90de-fdeb9ce14da1/payload-processing/0.log" Oct 30 20:38:15.213970 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:15.213943 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dw59s_9dabf5d4-7787-40b3-b01e-fe430c316887/global-pull-secret-syncer/0.log" Oct 30 20:38:15.428304 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:15.428279 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-4zrr5_93a3069b-7891-4146-a085-7b218eeff695/connection-checker/0.log" Oct 30 20:38:15.457757 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:15.457733 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-ffthk_364408a3-5d56-4e76-9c96-a2a08841b50f/connection-checker/0.log" Oct 30 20:38:15.487594 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:15.487538 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-xh8v8_a7d2c4e7-accb-4388-97c7-62c0b40ebb4c/connection-checker/0.log" Oct 30 20:38:15.568213 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:15.568182 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cvpxr_caeeb8a7-4283-4c38-b3be-c036eeeceb65/konnectivity-agent/0.log" Oct 30 20:38:15.697049 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:15.697019 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-217.us-east-2.compute.internal_49a9f3fd327006d80eb3bde05ad64dae/haproxy/0.log" Oct 30 20:38:23.212943 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:23.212917 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d6dd76dc-jm276_5b1aff91-a0ed-41ac-bab9-00877ecc6b27/manager/0.log" Oct 30 20:38:24.819979 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:24.819948 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-bbm2j_24b57f65-bf27-4659-a922-83a241893696/cluster-monitoring-operator/0.log" Oct 30 20:38:25.100674 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.100601 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-srz9p_b599af6c-32a0-45cf-98da-7eeb5c79c17d/node-exporter/0.log" Oct 30 20:38:25.162380 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.162325 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-srz9p_b599af6c-32a0-45cf-98da-7eeb5c79c17d/kube-rbac-proxy/0.log" Oct 30 20:38:25.227746 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.227720 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-srz9p_b599af6c-32a0-45cf-98da-7eeb5c79c17d/init-textfile/0.log" Oct 30 20:38:25.363675 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.363603 5078 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9"] Oct 30 20:38:25.364076 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.364063 5078 cpu_manager.go:414] "containerMap: removing container" podUID="6f3008b4-8bb4-4b51-b2ae-54d2a0148809" containerName="maas-api" Oct 30 20:38:25.364076 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.364076 5078 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f3008b4-8bb4-4b51-b2ae-54d2a0148809" containerName="maas-api" Oct 30 20:38:25.364210 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.364178 5078 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f3008b4-8bb4-4b51-b2ae-54d2a0148809" containerName="maas-api" Oct 30 20:38:25.367607 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.367587 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" Oct 30 20:38:25.377680 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.377656 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9"] Oct 30 20:38:25.378410 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.378391 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rnhfw\"/\"openshift-service-ca.crt\"" Oct 30 20:38:25.378501 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.378434 5078 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rnhfw\"/\"kube-root-ca.crt\"" Oct 30 20:38:25.397944 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.397918 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/64a6436a-dba8-48a5-ad32-b8e058984328-podres\") pod \"perf-node-gather-daemonset-2qfb9\" (UID: \"64a6436a-dba8-48a5-ad32-b8e058984328\") " pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" Oct 30 20:38:25.398060 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.397973 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64a6436a-dba8-48a5-ad32-b8e058984328-sys\") pod \"perf-node-gather-daemonset-2qfb9\" (UID: \"64a6436a-dba8-48a5-ad32-b8e058984328\") " pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" Oct 30 20:38:25.398102 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.398062 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czwbj\" (UniqueName: \"kubernetes.io/projected/64a6436a-dba8-48a5-ad32-b8e058984328-kube-api-access-czwbj\") pod \"perf-node-gather-daemonset-2qfb9\" (UID: \"64a6436a-dba8-48a5-ad32-b8e058984328\") " pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" Oct 30 20:38:25.398102 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.398095 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/64a6436a-dba8-48a5-ad32-b8e058984328-lib-modules\") pod \"perf-node-gather-daemonset-2qfb9\" (UID: \"64a6436a-dba8-48a5-ad32-b8e058984328\") " pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" Oct 30 20:38:25.398205 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.398122 5078 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/64a6436a-dba8-48a5-ad32-b8e058984328-proc\") pod \"perf-node-gather-daemonset-2qfb9\" (UID: \"64a6436a-dba8-48a5-ad32-b8e058984328\") " pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" Oct 30 20:38:25.424704 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.424678 5078 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rnhfw\"/\"default-dockercfg-5cxtm\"" Oct 30 20:38:25.499491 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.499462 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/64a6436a-dba8-48a5-ad32-b8e058984328-lib-modules\") pod \"perf-node-gather-daemonset-2qfb9\" (UID: \"64a6436a-dba8-48a5-ad32-b8e058984328\") " pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" Oct 30 20:38:25.499595 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.499494 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/64a6436a-dba8-48a5-ad32-b8e058984328-proc\") pod \"perf-node-gather-daemonset-2qfb9\" (UID: \"64a6436a-dba8-48a5-ad32-b8e058984328\") " pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" Oct 30 20:38:25.499595 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.499540 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/64a6436a-dba8-48a5-ad32-b8e058984328-podres\") pod \"perf-node-gather-daemonset-2qfb9\" (UID: \"64a6436a-dba8-48a5-ad32-b8e058984328\") " pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" Oct 30 20:38:25.499595 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.499572 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64a6436a-dba8-48a5-ad32-b8e058984328-sys\") pod \"perf-node-gather-daemonset-2qfb9\" (UID: \"64a6436a-dba8-48a5-ad32-b8e058984328\") " pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" Oct 30 20:38:25.499758 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.499596 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/64a6436a-dba8-48a5-ad32-b8e058984328-lib-modules\") pod \"perf-node-gather-daemonset-2qfb9\" (UID: \"64a6436a-dba8-48a5-ad32-b8e058984328\") " pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" Oct 30 20:38:25.499758 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.499616 5078 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czwbj\" (UniqueName: \"kubernetes.io/projected/64a6436a-dba8-48a5-ad32-b8e058984328-kube-api-access-czwbj\") pod \"perf-node-gather-daemonset-2qfb9\" (UID: \"64a6436a-dba8-48a5-ad32-b8e058984328\") " pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" Oct 30 20:38:25.499758 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.499648 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/64a6436a-dba8-48a5-ad32-b8e058984328-proc\") pod \"perf-node-gather-daemonset-2qfb9\" (UID: \"64a6436a-dba8-48a5-ad32-b8e058984328\") " pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" Oct 30 20:38:25.499758 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.499672 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/64a6436a-dba8-48a5-ad32-b8e058984328-podres\") pod \"perf-node-gather-daemonset-2qfb9\" (UID: \"64a6436a-dba8-48a5-ad32-b8e058984328\") " pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" Oct 30 20:38:25.499758 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.499681 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64a6436a-dba8-48a5-ad32-b8e058984328-sys\") pod \"perf-node-gather-daemonset-2qfb9\" (UID: \"64a6436a-dba8-48a5-ad32-b8e058984328\") " pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" Oct 30 20:38:25.512278 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.512258 5078 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czwbj\" (UniqueName: \"kubernetes.io/projected/64a6436a-dba8-48a5-ad32-b8e058984328-kube-api-access-czwbj\") pod \"perf-node-gather-daemonset-2qfb9\" (UID: \"64a6436a-dba8-48a5-ad32-b8e058984328\") " pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" Oct 30 20:38:25.682385 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.682280 5078 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" Oct 30 20:38:25.792088 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.792062 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-4bsxb_e28012b0-8275-4d69-a15d-ff19bd255602/prometheus-operator-admission-webhook/0.log" Oct 30 20:38:25.958551 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.958528 5078 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9"] Oct 30 20:38:25.961413 ip-10-0-139-217 kubenswrapper[5078]: W1030 20:38:25.961372 5078 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod64a6436a_dba8_48a5_ad32_b8e058984328.slice/crio-4545497b42fed7310612ade505807f71a09d29d27566db33afb170a920a7435a WatchSource:0}: Error finding container 4545497b42fed7310612ade505807f71a09d29d27566db33afb170a920a7435a: Status 404 returned error can't find the container with id 4545497b42fed7310612ade505807f71a09d29d27566db33afb170a920a7435a Oct 30 20:38:25.985875 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:25.985852 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" event={"ID":"64a6436a-dba8-48a5-ad32-b8e058984328","Type":"ContainerStarted","Data":"4545497b42fed7310612ade505807f71a09d29d27566db33afb170a920a7435a"} Oct 30 20:38:26.696713 ip-10-0-139-217 kubenswrapper[5078]: E1030 20:38:26.696676 5078 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-js96l" containerName="extractor" Oct 30 20:38:26.992100 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:26.992000 5078 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" event={"ID":"64a6436a-dba8-48a5-ad32-b8e058984328","Type":"ContainerStarted","Data":"7bc8a6a29cf30eed18607e891d5721004196b4fee06a0a5ae1f83590dc77131a"} Oct 30 20:38:26.992629 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:26.992154 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" Oct 30 20:38:27.012567 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:27.012514 5078 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" podStartSLOduration=2.012501598 podStartE2EDuration="2.012501598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:27.010705126 +0000 UTC m=+2081.543977717" watchObservedRunningTime="2026-10-30 20:38:27.012501598 +0000 UTC m=+2081.545774192" Oct 30 20:38:27.249504 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:27.249432 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-gksz8_ae25b031-7ac9-4041-bc3a-7a6679eab74d/networking-console-plugin/0.log" Oct 30 20:38:27.861044 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:27.861009 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/1.log" Oct 30 20:38:27.866240 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:27.866215 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-dr852_ee5e6319-c93c-4713-b99c-9e5660af5192/console-operator/2.log" Oct 30 20:38:28.401227 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:28.401192 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6dd789c8b7-78j5c_eb41a99a-d50e-4508-8f86-68e69baf8f9c/download-server/0.log" Oct 30 20:38:29.078580 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:29.078549 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-58c9f5f46d-s4s25_f5dddacb-f3d8-43cc-9191-c9f63e56db20/volume-data-source-validator/0.log" Oct 30 20:38:30.380526 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:30.380492 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hd99r_7f941d6e-cd94-47d5-a641-fb608c05a903/dns/0.log" Oct 30 20:38:30.406872 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:30.406845 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hd99r_7f941d6e-cd94-47d5-a641-fb608c05a903/kube-rbac-proxy/0.log" Oct 30 20:38:30.534688 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:30.534660 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sxszz_bea5c7b2-5ad1-43f5-8f43-07e3af665d6a/dns-node-resolver/0.log" Oct 30 20:38:31.187764 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:31.187731 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5cbbcb9f56-h46cm_ae7e6701-f883-486b-ad49-2f7f65494862/registry/0.log" Oct 30 20:38:31.215537 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:31.215513 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fc6gd_ff5da8ed-018c-4182-82f0-a8a3266aff52/node-ca/0.log" Oct 30 20:38:32.311768 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:32.311740 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7_7f5345fa-631a-402f-9cca-7e7cc832283f/istio-proxy/0.log" Oct 30 20:38:33.008829 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:33.008797 5078 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rnhfw/perf-node-gather-daemonset-2qfb9" Oct 30 20:38:33.602116 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:33.602090 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-rzs4p_465367da-f578-4099-9ce5-0fb854fb2482/discovery/0.log" Oct 30 20:38:33.631305 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:33.631278 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d477969dd-cchjb_7d85401f-0ca6-4d63-a134-1c1a40bd1754/kube-auth-proxy/0.log" Oct 30 20:38:33.736067 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:33.736040 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-4p5zj_97082e84-45d0-4ca4-b427-d703172d8671/istio-proxy/0.log" Oct 30 20:38:33.907740 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:33.907656 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-mct6s_728c746f-de35-4521-90a5-262af3971cc2/istio-proxy/0.log" Oct 30 20:38:33.983913 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:33.983880 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-pzpq5_626f7c24-fa80-4b57-ab5c-9739398bd547/istio-proxy/0.log" Oct 30 20:38:33.984879 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:33.984857 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-pzpq5_626f7c24-fa80-4b57-ab5c-9739398bd547/istio-proxy/1.log" Oct 30 20:38:34.019148 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:34.019123 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-rnm76_f281b490-5afe-467a-a479-483203314e1c/istio-proxy/0.log" Oct 30 20:38:34.088965 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:34.088934 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-55qkv_21103aa0-66f4-446b-b377-d3bac5973c2e/payload-pre-processing/0.log" Oct 30 20:38:34.118064 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:34.118038 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-sztc2_5392a640-4770-4118-90de-fdeb9ce14da1/payload-processing/0.log" Oct 30 20:38:34.150415 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:34.150388 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f94f8f65c-dqcj8_2e5941e6-4fc9-4353-a518-8ad492e9ad61/router/0.log" Oct 30 20:38:35.746944 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:35.746917 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t85sd_22e3da9c-5201-4bd9-b247-1caaa18f5d7d/serve-healthcheck-canary/0.log" Oct 30 20:38:35.819318 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:35.819285 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7_7f5345fa-631a-402f-9cca-7e7cc832283f/istio-proxy/0.log" Oct 30 20:38:36.460922 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:36.460886 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-c262w_adb774f6-0266-4c60-92e9-f0a5f8ac831e/insights-operator/0.log" Oct 30 20:38:36.461588 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:36.461566 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-c262w_adb774f6-0266-4c60-92e9-f0a5f8ac831e/insights-operator/1.log" Oct 30 20:38:36.491141 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:36.491111 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-js96l_b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc/kube-rbac-proxy/0.log" Oct 30 20:38:36.520339 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:36.520290 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-js96l_b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc/exporter/0.log" Oct 30 20:38:36.549354 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:36.549303 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-js96l_b91b3e76-8c7d-4b4f-9e35-1b18b1c772bc/extractor/0.log" Oct 30 20:38:36.790059 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:36.789983 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_periodic-gathering-sd6vl-68tbx_2a0531af-9e1e-4496-b260-d8310fa93013/insights-gathering/0.log" Oct 30 20:38:37.159897 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:37.159864 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-rzs4p_465367da-f578-4099-9ce5-0fb854fb2482/discovery/0.log" Oct 30 20:38:37.172687 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:37.172657 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d477969dd-cchjb_7d85401f-0ca6-4d63-a134-1c1a40bd1754/kube-auth-proxy/0.log" Oct 30 20:38:37.234981 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:37.234940 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-4p5zj_97082e84-45d0-4ca4-b427-d703172d8671/istio-proxy/0.log" Oct 30 20:38:37.323000 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:37.322959 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-mct6s_728c746f-de35-4521-90a5-262af3971cc2/istio-proxy/0.log" Oct 30 20:38:37.361589 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:37.361562 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-pzpq5_626f7c24-fa80-4b57-ab5c-9739398bd547/istio-proxy/0.log" Oct 30 20:38:37.362814 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:37.362796 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-pzpq5_626f7c24-fa80-4b57-ab5c-9739398bd547/istio-proxy/1.log" Oct 30 20:38:37.377361 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:37.377314 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-rnm76_f281b490-5afe-467a-a479-483203314e1c/istio-proxy/0.log" Oct 30 20:38:37.420789 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:37.420721 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-55qkv_21103aa0-66f4-446b-b377-d3bac5973c2e/payload-pre-processing/0.log" Oct 30 20:38:37.438990 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:37.438964 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-sztc2_5392a640-4770-4118-90de-fdeb9ce14da1/payload-processing/0.log" Oct 30 20:38:37.463393 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:37.463367 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f94f8f65c-dqcj8_2e5941e6-4fc9-4353-a518-8ad492e9ad61/router/0.log" Oct 30 20:38:39.196470 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:39.196438 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6bc88ffd5-7r8v7_7f5345fa-631a-402f-9cca-7e7cc832283f/istio-proxy/0.log" Oct 30 20:38:39.280792 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:39.280761 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6f69558f77-dxrdp_b266ac29-fd57-49a6-acc5-e67aba37864d/manager/0.log" Oct 30 20:38:39.308196 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:39.308167 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-64vpw_8fa2c3f1-8034-452b-9d06-fa6e84573c05/manager/0.log" Oct 30 20:38:39.822549 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:39.822514 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76fb996bcf-4br2k_73330fbb-b274-4748-b91d-065ca47fbb94/manager/0.log" Oct 30 20:38:39.848494 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:39.848467 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-vgl8x_0539e8ae-dc5f-4ed9-8f34-0c0a928b7409/server/0.log" Oct 30 20:38:40.001075 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:40.001042 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-f87fcf56c-kdkbm_3ae3de76-2d1f-413a-a07a-46f367221dcf/manager/0.log" Oct 30 20:38:40.200600 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:40.200521 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft_905da0b8-b345-447a-960f-7f3ddaa544ff/manager/0.log" Oct 30 20:38:40.229020 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:40.228985 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cfd5cbdbb-g9wft_905da0b8-b345-447a-960f-7f3ddaa544ff/copy-manifests/0.log" Oct 30 20:38:40.367068 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:40.367039 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-7d94f55f4b-ltspk_6bd378ec-e598-445c-a5c5-6d46ebe9226d/proxy/0.log" Oct 30 20:38:40.549228 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:40.549160 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-rzs4p_465367da-f578-4099-9ce5-0fb854fb2482/discovery/0.log" Oct 30 20:38:40.595032 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:40.595002 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d477969dd-cchjb_7d85401f-0ca6-4d63-a134-1c1a40bd1754/kube-auth-proxy/0.log" Oct 30 20:38:40.656117 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:40.656087 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-4p5zj_97082e84-45d0-4ca4-b427-d703172d8671/istio-proxy/0.log" Oct 30 20:38:40.758372 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:40.758317 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-mct6s_728c746f-de35-4521-90a5-262af3971cc2/istio-proxy/0.log" Oct 30 20:38:40.812410 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:40.812384 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-pzpq5_626f7c24-fa80-4b57-ab5c-9739398bd547/istio-proxy/0.log" Oct 30 20:38:40.813757 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:40.813728 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-pzpq5_626f7c24-fa80-4b57-ab5c-9739398bd547/istio-proxy/1.log" Oct 30 20:38:40.827780 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:40.827757 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-64d4cc998c-rnm76_f281b490-5afe-467a-a479-483203314e1c/istio-proxy/0.log" Oct 30 20:38:40.867215 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:40.867193 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-55qkv_21103aa0-66f4-446b-b377-d3bac5973c2e/payload-pre-processing/0.log" Oct 30 20:38:40.888008 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:40.887986 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-sztc2_5392a640-4770-4118-90de-fdeb9ce14da1/payload-processing/0.log" Oct 30 20:38:40.914462 ip-10-0-139-217 kubenswrapper[5078]: I1030 20:38:40.914443 5078 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f94f8f65c-dqcj8_2e5941e6-4fc9-4353-a518-8ad492e9ad61/router/0.log"