Oct 31 00:55:10.470822 ip-10-0-132-179 systemd[1]: Starting Kubernetes Kubelet... Oct 31 00:55:10.864414 ip-10-0-132-179 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 00:55:10.864414 ip-10-0-132-179 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 31 00:55:10.864414 ip-10-0-132-179 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 00:55:10.864414 ip-10-0-132-179 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 00:55:10.868563 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868485 2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:55:10.868603 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868567 2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:55:10.868603 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868571 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:55:10.868603 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868574 2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:55:10.868603 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868577 2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:55:10.868603 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868580 2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:55:10.868603 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868583 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:55:10.868603 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868586 2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:55:10.868603 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868588 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:55:10.868603 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868591 2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:55:10.868603 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868593 2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:55:10.868603 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868596 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:55:10.868603 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868599 2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:55:10.868603 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868602 2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:55:10.868603 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868605 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:55:10.868603 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868608 2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:55:10.868603 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868611 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:55:10.868980 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868614 2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:55:10.868980 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868616 2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:55:10.868980 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868619 2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:55:10.868980 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868621 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:55:10.868980 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868624 2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:55:10.868980 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868627 2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:55:10.868980 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868629 2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:55:10.868980 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868632 2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:55:10.868980 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868634 2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:55:10.868980 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868637 2579 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:55:10.868980 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868639 2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:55:10.868980 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868646 2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:55:10.868980 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868649 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:55:10.868980 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868652 2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:55:10.868980 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868655 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:55:10.868980 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868658 2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:55:10.868980 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868660 2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:55:10.868980 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868663 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:55:10.868980 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868665 2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:55:10.869429 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868668 2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:55:10.869429 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868670 2579 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:55:10.869429 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868673 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:55:10.869429 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868675 2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:55:10.869429 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868678 2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:55:10.869429 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868680 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:55:10.869429 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868683 2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:55:10.869429 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868685 2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:55:10.869429 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868687 2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:55:10.869429 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868690 2579 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:55:10.869429 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868692 2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:55:10.869429 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868695 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:55:10.869429 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868697 2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:55:10.869429 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868700 2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:55:10.869429 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868705 2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:55:10.869429 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868709 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:55:10.869429 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868712 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:55:10.869429 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868716 2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:55:10.869429 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868719 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:55:10.869429 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868722 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:55:10.869923 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868724 2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:55:10.869923 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868727 2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:55:10.869923 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868730 2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:55:10.869923 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868732 2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:55:10.869923 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868736 2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:55:10.869923 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868739 2579 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:55:10.869923 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868741 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:55:10.869923 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868744 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:55:10.869923 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868746 2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:55:10.869923 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868749 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:55:10.869923 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868751 2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:55:10.869923 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868754 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:55:10.869923 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868756 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:55:10.869923 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868759 2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:55:10.869923 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868761 2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:55:10.869923 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868764 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:55:10.869923 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868766 2579 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:55:10.869923 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868769 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:55:10.869923 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868771 2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:55:10.869923 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868774 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:55:10.870395 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868777 2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:55:10.870395 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868779 2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:55:10.870395 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868782 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:55:10.870395 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868784 2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:55:10.870395 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868787 2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:55:10.870395 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868789 2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:55:10.870395 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868792 2579 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:55:10.870395 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868795 2579 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:55:10.870395 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868798 2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:55:10.870395 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868800 2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:55:10.870395 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868802 2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:55:10.870395 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868807 2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:55:10.870395 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868810 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:55:10.870395 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868813 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:55:10.870395 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868816 2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:55:10.870395 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868818 2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:55:10.870395 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868820 2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:55:10.870395 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868823 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:55:10.870395 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868826 2579 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:55:10.871087 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868828 2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:55:10.871087 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868831 2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:55:10.871087 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868833 2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:55:10.871087 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868836 2579 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:55:10.871087 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868839 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:55:10.871087 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868841 2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:55:10.871087 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868843 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:55:10.871087 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868846 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:55:10.871087 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868848 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:55:10.871087 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868851 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:55:10.871087 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.868854 2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:55:10.871087 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869609 2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:55:10.871087 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869616 2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:55:10.871087 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869619 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:55:10.871087 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869622 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:55:10.871087 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869625 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:55:10.871087 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869628 2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:55:10.871087 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869630 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:55:10.871087 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869633 2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:55:10.871812 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869636 2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:55:10.871812 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869639 2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:55:10.871812 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869642 2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:55:10.871812 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869644 2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:55:10.871812 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869647 2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:55:10.871812 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869650 2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:55:10.871812 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869653 2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:55:10.871812 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869655 2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:55:10.871812 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869657 2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:55:10.871812 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869660 2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:55:10.871812 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869663 2579 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:55:10.871812 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869665 2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:55:10.871812 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869668 2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:55:10.871812 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869671 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:55:10.871812 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869674 2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:55:10.871812 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869677 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:55:10.871812 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869679 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:55:10.871812 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869682 2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:55:10.871812 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869684 2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:55:10.872268 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869686 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:55:10.872268 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869689 2579 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:55:10.872268 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869691 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:55:10.872268 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869696 2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:55:10.872268 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869700 2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:55:10.872268 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869703 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:55:10.872268 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869705 2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:55:10.872268 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869708 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:55:10.872268 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869711 2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:55:10.872268 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869713 2579 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:55:10.872268 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869716 2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:55:10.872268 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869718 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:55:10.872268 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869721 2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:55:10.872268 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869725 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:55:10.872268 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869728 2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:55:10.872268 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869730 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:55:10.872268 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869733 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:55:10.872268 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869737 2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:55:10.872268 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869741 2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:55:10.872741 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869744 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:55:10.872741 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869747 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:55:10.872741 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869750 2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:55:10.872741 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869753 2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:55:10.872741 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869755 2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:55:10.872741 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869758 2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:55:10.872741 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869761 2579 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:55:10.872741 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869763 2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:55:10.872741 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869766 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:55:10.872741 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869769 2579 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:55:10.872741 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869771 2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:55:10.872741 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869774 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:55:10.872741 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869776 2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:55:10.872741 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869780 2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:55:10.872741 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869783 2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:55:10.872741 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869786 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:55:10.872741 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869788 2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:55:10.872741 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869791 2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:55:10.872741 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869793 2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:55:10.872741 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869795 2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:55:10.873227 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869798 2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:55:10.873227 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869801 2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:55:10.873227 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869804 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:55:10.873227 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869806 2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:55:10.873227 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869809 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:55:10.873227 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869811 2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:55:10.873227 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869815 2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:55:10.873227 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869817 2579 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:55:10.873227 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869820 2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:55:10.873227 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869823 2579 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:55:10.873227 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869826 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:55:10.873227 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869828 2579 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:55:10.873227 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869832 2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:55:10.873227 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869834 2579 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:55:10.873227 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869837 2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:55:10.873227 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869839 2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:55:10.873227 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869842 2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:55:10.873227 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869844 2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:55:10.873227 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869847 2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:55:10.873227 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869849 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:55:10.873720 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869852 2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:55:10.873720 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869855 2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:55:10.873720 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869857 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:55:10.873720 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869860 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:55:10.873720 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869862 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:55:10.873720 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869865 2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:55:10.873720 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869868 2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:55:10.873720 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869870 2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:55:10.873720 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869873 2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:55:10.873720 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869875 2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:55:10.873720 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869878 2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:55:10.873720 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869880 2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:55:10.873720 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869883 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:55:10.873720 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869885 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:55:10.873720 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869887 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:55:10.873720 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869890 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:55:10.873720 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869892 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:55:10.873720 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869895 2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:55:10.873720 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869898 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:55:10.873720 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.869901 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:55:10.874229 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870578 2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:55:10.874229 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870590 2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:55:10.874229 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870596 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:55:10.874229 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870601 2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:55:10.874229 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870605 2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:55:10.874229 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870610 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:55:10.874229 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870614 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:55:10.874229 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870618 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:55:10.874229 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870623 2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:55:10.874229 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870628 2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:55:10.874229 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870632 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:55:10.874229 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870639 2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:55:10.874229 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870653 2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:55:10.874229 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870669 2579 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:55:10.874229 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870674 2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:55:10.874229 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870680 2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:55:10.874229 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870686 2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:55:10.874229 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870690 2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:55:10.874229 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870694 2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:55:10.874727 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870699 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:55:10.874727 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870704 2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:55:10.874727 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870708 2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:55:10.874727 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870713 2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:55:10.874727 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870718 2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:55:10.874727 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870727 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:55:10.874727 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870732 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:55:10.874727 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870736 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:55:10.874727 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870743 2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:55:10.874727 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870749 2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:55:10.874727 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870754 2579 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:55:10.874727 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870758 2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:55:10.874727 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870762 2579 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:55:10.874727 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870767 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:55:10.874727 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870771 2579 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:55:10.874727 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870776 2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:55:10.874727 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870780 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:55:10.874727 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870790 2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:55:10.874727 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870794 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:55:10.875185 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870798 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:55:10.875185 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870802 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:55:10.875185 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870807 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:55:10.875185 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870811 2579 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:55:10.875185 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870815 2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:55:10.875185 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870819 2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:55:10.875185 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870823 2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:55:10.875185 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870827 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:55:10.875185 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870834 2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:55:10.875185 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870839 2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:55:10.875185 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870848 2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:55:10.875185 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870852 2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:55:10.875185 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870857 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:55:10.875185 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870861 2579 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:55:10.875185 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870866 2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:55:10.875185 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870870 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:55:10.875185 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870875 2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:55:10.875185 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870879 2579 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:55:10.875185 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870883 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:55:10.875185 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870888 2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:55:10.875663 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870892 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:55:10.875663 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870896 2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:55:10.875663 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870901 2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:55:10.875663 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870910 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:55:10.875663 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870914 2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:55:10.875663 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870919 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:55:10.875663 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870923 2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:55:10.875663 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870927 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:55:10.875663 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870931 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:55:10.875663 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870935 2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:55:10.875663 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870940 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:55:10.875663 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870944 2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:55:10.875663 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870949 2579 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:55:10.875663 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870953 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:55:10.875663 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870957 2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:55:10.875663 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870966 2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:55:10.875663 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870970 2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:55:10.875663 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870975 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:55:10.875663 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870979 2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:55:10.875663 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870983 2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:55:10.876160 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870987 2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:55:10.876160 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870992 2579 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:55:10.876160 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.870997 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:55:10.876160 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871002 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:55:10.876160 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871006 2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:55:10.876160 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871011 2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:55:10.876160 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871015 2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:55:10.876160 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871019 2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:55:10.876160 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871028 2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:55:10.876160 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871033 2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:55:10.876160 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871037 2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:55:10.876160 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871042 2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:55:10.876160 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871046 2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:55:10.876160 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871052 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:55:10.876160 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871057 2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:55:10.876160 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871061 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:55:10.876160 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871065 2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:55:10.876160 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871069 2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:55:10.876160 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871074 2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:55:10.876661 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871078 2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:55:10.876661 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871087 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:55:10.876661 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871091 2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:55:10.876661 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871095 2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:55:10.876661 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871100 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:55:10.876661 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871104 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:55:10.876661 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871109 2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:55:10.876661 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871113 2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:55:10.876661 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.871117 2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:55:10.876661 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871366 2579 flags.go:64] FLAG: --address="0.0.0.0" Oct 31 00:55:10.876661 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871421 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 31 00:55:10.876661 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871609 2579 flags.go:64] FLAG: --anonymous-auth="true" Oct 31 00:55:10.876661 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871618 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 31 00:55:10.876661 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871625 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 31 00:55:10.876661 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871628 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 31 00:55:10.876661 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871633 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 31 00:55:10.876661 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871637 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 31 00:55:10.876661 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871641 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 31 00:55:10.876661 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871644 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 31 00:55:10.876661 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871648 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 31 00:55:10.876661 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871651 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871654 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871657 2579 flags.go:64] FLAG: --cgroup-root="" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871660 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871663 2579 flags.go:64] FLAG: --client-ca-file="" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871666 2579 flags.go:64] FLAG: --cloud-provider="external" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871669 2579 flags.go:64] FLAG: --cluster-dns="[]" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871674 2579 flags.go:64] FLAG: --cluster-domain="" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871677 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871680 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871683 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871686 2579 flags.go:64] FLAG: --container-log-max-files="5" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871690 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871693 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871697 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871700 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871703 2579 flags.go:64] FLAG: --contention-profiling="false" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871706 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871709 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871713 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871716 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871721 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871724 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871728 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871731 2579 flags.go:64] FLAG: --enable-load-reader="false" Oct 31 00:55:10.877170 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871735 2579 flags.go:64] FLAG: --enable-server="true" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871737 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871743 2579 flags.go:64] FLAG: --event-burst="100" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871746 2579 flags.go:64] FLAG: --event-qps="50" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871749 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871752 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871756 2579 flags.go:64] FLAG: --eviction-hard="" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871760 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871763 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871766 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871769 2579 flags.go:64] FLAG: --eviction-soft="" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871772 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871775 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871778 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871781 2579 flags.go:64] FLAG: --experimental-mounter-path="" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871784 2579 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871787 2579 flags.go:64] FLAG: --fail-swap-on="true" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871790 2579 flags.go:64] FLAG: --feature-gates="" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871795 2579 flags.go:64] FLAG: --file-check-frequency="20s" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871798 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871801 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871804 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871808 2579 flags.go:64] FLAG: --healthz-port="10248" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871811 2579 flags.go:64] FLAG: --help="false" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871814 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:55:10.877814 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871818 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871822 2579 flags.go:64] FLAG: --http-check-frequency="20s" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871825 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871832 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871836 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871839 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871842 2579 flags.go:64] FLAG: --image-service-endpoint="" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871845 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871848 2579 flags.go:64] FLAG: --kube-api-burst="100" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871851 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871854 2579 flags.go:64] FLAG: --kube-api-qps="50" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871857 2579 flags.go:64] FLAG: --kube-reserved="" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871860 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871863 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871866 2579 flags.go:64] FLAG: --kubelet-cgroups="" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871869 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871871 2579 flags.go:64] FLAG: --lock-file="" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871875 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871877 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871880 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871886 2579 flags.go:64] FLAG: --log-json-split-stream="false" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871889 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871892 2579 flags.go:64] FLAG: --log-text-split-stream="false" Oct 31 00:55:10.878453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871895 2579 flags.go:64] FLAG: --logging-format="text" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871898 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871902 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871905 2579 flags.go:64] FLAG: --manifest-url="" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871908 2579 flags.go:64] FLAG: --manifest-url-header="" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871913 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871916 2579 flags.go:64] FLAG: --max-open-files="1000000" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871925 2579 flags.go:64] FLAG: --max-pods="110" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871928 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871932 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871934 2579 flags.go:64] FLAG: --memory-manager-policy="None" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871937 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871942 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871945 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871947 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871956 2579 flags.go:64] FLAG: --node-status-max-images="50" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871959 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871962 2579 flags.go:64] FLAG: --oom-score-adj="-999" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871965 2579 flags.go:64] FLAG: --pod-cidr="" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871968 2579 flags.go:64] FLAG: --pod-manifest-path="" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871972 2579 flags.go:64] FLAG: --pod-max-pids="-1" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871975 2579 flags.go:64] FLAG: --pods-per-core="0" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871978 2579 flags.go:64] FLAG: --port="10250" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871981 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871984 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-088292b40cd502275" Oct 31 00:55:10.879022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871987 2579 flags.go:64] FLAG: --qos-reserved="" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871989 2579 flags.go:64] FLAG: --read-only-port="10255" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871992 2579 flags.go:64] FLAG: --register-node="true" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871995 2579 flags.go:64] FLAG: --register-with-taints="" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.871999 2579 flags.go:64] FLAG: --registry-burst="10" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872002 2579 flags.go:64] FLAG: --registry-qps="5" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872005 2579 flags.go:64] FLAG: --reserved-cpus="" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872008 2579 flags.go:64] FLAG: --reserved-memory="" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872012 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872015 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872018 2579 flags.go:64] FLAG: --rotate-certificates="false" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872021 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872024 2579 flags.go:64] FLAG: --runonce="false" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872027 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872030 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872033 2579 flags.go:64] FLAG: --seccomp-default="false" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872036 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872039 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872042 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872047 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872050 2579 flags.go:64] FLAG: --storage-driver-password="root" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872053 2579 flags.go:64] FLAG: --storage-driver-secure="false" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872056 2579 flags.go:64] FLAG: --storage-driver-table="stats" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872059 2579 flags.go:64] FLAG: --storage-driver-user="root" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872062 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872065 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 31 00:55:10.879662 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872068 2579 flags.go:64] FLAG: --system-cgroups="" Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872071 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872077 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872080 2579 flags.go:64] FLAG: --tls-cert-file="" Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872083 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872088 2579 flags.go:64] FLAG: --tls-min-version="" Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872091 2579 flags.go:64] FLAG: --tls-private-key-file="" Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872094 2579 flags.go:64] FLAG: --topology-manager-policy="none" Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872097 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872100 2579 flags.go:64] FLAG: --topology-manager-scope="container" Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872103 2579 flags.go:64] FLAG: --v="2" Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872108 2579 flags.go:64] FLAG: --version="false" Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872112 2579 flags.go:64] FLAG: --vmodule="" Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872116 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872119 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872259 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872264 2579 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872267 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872270 2579 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872273 2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872275 2579 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872281 2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872284 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:55:10.880277 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872287 2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:55:10.880828 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872290 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:55:10.880828 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872294 2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:55:10.880828 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872297 2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:55:10.880828 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872300 2579 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:55:10.880828 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872302 2579 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:55:10.880828 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872305 2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:55:10.880828 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872308 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:55:10.880828 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872310 2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:55:10.880828 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872313 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:55:10.880828 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872315 2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:55:10.880828 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872318 2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:55:10.880828 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872320 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:55:10.880828 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872323 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:55:10.880828 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872325 2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:55:10.880828 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872329 2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:55:10.880828 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872331 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:55:10.880828 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872335 2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:55:10.880828 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872338 2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:55:10.880828 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872340 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:55:10.880828 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872343 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:55:10.881334 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872345 2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:55:10.881334 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872348 2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:55:10.881334 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872350 2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:55:10.881334 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872353 2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:55:10.881334 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872356 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:55:10.881334 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872359 2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:55:10.881334 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872361 2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:55:10.881334 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872364 2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:55:10.881334 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872366 2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:55:10.881334 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872371 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:55:10.881334 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872373 2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:55:10.881334 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872376 2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:55:10.881334 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872379 2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:55:10.881334 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872382 2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:55:10.881334 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872385 2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:55:10.881334 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872388 2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:55:10.881334 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872390 2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:55:10.881334 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872393 2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:55:10.881334 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872395 2579 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:55:10.881334 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872399 2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:55:10.881815 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872401 2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:55:10.881815 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872404 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:55:10.881815 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872407 2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:55:10.881815 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872409 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:55:10.881815 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872412 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:55:10.881815 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872414 2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:55:10.881815 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872417 2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:55:10.881815 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872419 2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:55:10.881815 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872422 2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:55:10.881815 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872425 2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:55:10.881815 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872427 2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:55:10.881815 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872430 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:55:10.881815 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872432 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:55:10.881815 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872435 2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:55:10.881815 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872437 2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:55:10.881815 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872440 2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:55:10.881815 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872442 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:55:10.881815 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872446 2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:55:10.881815 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872451 2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:55:10.882273 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872454 2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:55:10.882273 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872456 2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:55:10.882273 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872460 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:55:10.882273 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872463 2579 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:55:10.882273 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872466 2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:55:10.882273 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872470 2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:55:10.882273 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872475 2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:55:10.882273 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872478 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:55:10.882273 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872480 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:55:10.882273 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872483 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:55:10.882273 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872486 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:55:10.882273 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872488 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:55:10.882273 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872491 2579 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:55:10.882273 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872494 2579 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:55:10.882273 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872496 2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:55:10.882273 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872499 2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:55:10.882273 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872502 2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:55:10.882273 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872504 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:55:10.882273 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872507 2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:55:10.882744 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872510 2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:55:10.882744 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872512 2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:55:10.882744 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872515 2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:55:10.882744 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872517 2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:55:10.882744 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872520 2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:55:10.882744 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872523 2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:55:10.882744 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872526 2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:55:10.882744 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872529 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:55:10.882744 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872531 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:55:10.882744 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872533 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:55:10.882744 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872536 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:55:10.882744 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872539 2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:55:10.882744 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872541 2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:55:10.882744 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872544 2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:55:10.882744 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872546 2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:55:10.882744 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872565 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:55:10.882744 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872568 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:55:10.882744 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872571 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:55:10.882744 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872573 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:55:10.883244 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.872604 2579 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 00:55:10.883244 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872643 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:55:10.883244 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872649 2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:55:10.883244 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872653 2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:55:10.883244 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872657 2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:55:10.883244 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872660 2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:55:10.883244 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872663 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:55:10.883244 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872666 2579 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:55:10.883244 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872668 2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:55:10.883244 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872672 2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:55:10.883244 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872677 2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:55:10.883244 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872679 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:55:10.883244 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872682 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:55:10.883244 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872685 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:55:10.883244 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872688 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:55:10.883625 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872691 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:55:10.883625 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872693 2579 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:55:10.883625 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872696 2579 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:55:10.883625 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872700 2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:55:10.883625 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872702 2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:55:10.883625 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872705 2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:55:10.883625 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872707 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:55:10.883625 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872710 2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:55:10.883625 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872713 2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:55:10.883625 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872716 2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:55:10.883625 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872718 2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:55:10.883625 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872720 2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:55:10.883625 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872723 2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:55:10.883625 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872725 2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:55:10.883625 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872730 2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:55:10.883625 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872733 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:55:10.883625 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872735 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:55:10.883625 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872739 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:55:10.883625 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872742 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:55:10.883625 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872744 2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:55:10.884093 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872747 2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:55:10.884093 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872750 2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:55:10.884093 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872753 2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:55:10.884093 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872756 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:55:10.884093 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872758 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:55:10.884093 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872761 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:55:10.884093 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872763 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:55:10.884093 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872766 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:55:10.884093 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872769 2579 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:55:10.884093 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872771 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:55:10.884093 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872774 2579 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:55:10.884093 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872776 2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:55:10.884093 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872779 2579 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:55:10.884093 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872781 2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:55:10.884093 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872784 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:55:10.884093 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872786 2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:55:10.884093 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872789 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:55:10.884093 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872792 2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:55:10.884093 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872794 2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:55:10.884584 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872797 2579 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:55:10.884584 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872800 2579 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:55:10.884584 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872802 2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:55:10.884584 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872805 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:55:10.884584 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872807 2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:55:10.884584 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872810 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:55:10.884584 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872813 2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:55:10.884584 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872816 2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:55:10.884584 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872819 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:55:10.884584 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872822 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:55:10.884584 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872826 2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:55:10.884584 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872828 2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:55:10.884584 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872831 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:55:10.884584 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872834 2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:55:10.884584 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872836 2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:55:10.884584 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872839 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:55:10.884584 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872842 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:55:10.884584 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872844 2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:55:10.884584 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872847 2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:55:10.884584 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872849 2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:55:10.885073 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872852 2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:55:10.885073 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872855 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:55:10.885073 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872857 2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:55:10.885073 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872860 2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:55:10.885073 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872862 2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:55:10.885073 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872865 2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:55:10.885073 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872867 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:55:10.885073 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872870 2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:55:10.885073 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872872 2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:55:10.885073 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872875 2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:55:10.885073 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872878 2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:55:10.885073 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872881 2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:55:10.885073 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872883 2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:55:10.885073 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872886 2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:55:10.885073 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872888 2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:55:10.885073 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872891 2579 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:55:10.885073 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872893 2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:55:10.885073 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872896 2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:55:10.885073 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872898 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:55:10.885073 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872902 2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:55:10.885615 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872905 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:55:10.885615 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872907 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:55:10.885615 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872911 2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:55:10.885615 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872914 2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:55:10.885615 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872917 2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:55:10.885615 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872919 2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:55:10.885615 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872922 2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:55:10.885615 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872924 2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:55:10.885615 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872928 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:55:10.885615 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872930 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:55:10.885615 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872933 2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:55:10.885615 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872936 2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:55:10.885615 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.872938 2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:55:10.885615 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.879814 2579 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 31 00:55:10.885615 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.879830 2579 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 31 00:55:10.885615 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.879840 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 31 00:55:10.885615 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.879845 2579 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 31 00:55:10.885615 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879899 2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:55:10.885615 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879904 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:55:10.885615 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879907 2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:55:10.886162 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879911 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:55:10.886162 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879914 2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:55:10.886162 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879917 2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:55:10.886162 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879920 2579 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:55:10.886162 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879923 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:55:10.886162 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879925 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:55:10.886162 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879928 2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:55:10.886162 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879931 2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:55:10.886162 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879933 2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:55:10.886162 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879936 2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:55:10.886162 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879939 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:55:10.886162 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879942 2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:55:10.886162 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879944 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:55:10.886162 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879948 2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:55:10.886162 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879953 2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:55:10.886162 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879956 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:55:10.886162 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879959 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:55:10.886162 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879962 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:55:10.886642 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879964 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:55:10.886642 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879967 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:55:10.886642 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879970 2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:55:10.886642 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879972 2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:55:10.886642 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879975 2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:55:10.886642 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879977 2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:55:10.886642 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879980 2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:55:10.886642 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879984 2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:55:10.886642 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879988 2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:55:10.886642 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879991 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:55:10.886642 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879993 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:55:10.886642 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879996 2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:55:10.886642 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.879999 2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:55:10.886642 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880001 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:55:10.886642 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880004 2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:55:10.886642 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880006 2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:55:10.886642 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880009 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:55:10.886642 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880011 2579 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:55:10.886642 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880014 2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:55:10.886642 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880017 2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:55:10.887165 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880019 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:55:10.887165 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880022 2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:55:10.887165 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880025 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:55:10.887165 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880027 2579 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:55:10.887165 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880030 2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:55:10.887165 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880033 2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:55:10.887165 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880035 2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:55:10.887165 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880038 2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:55:10.887165 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880040 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:55:10.887165 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880043 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:55:10.887165 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880046 2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:55:10.887165 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880048 2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:55:10.887165 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880051 2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:55:10.887165 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880054 2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:55:10.887165 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880057 2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:55:10.887165 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880059 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:55:10.887165 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880062 2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:55:10.887165 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880064 2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:55:10.887165 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880067 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:55:10.887635 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880069 2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:55:10.887635 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880072 2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:55:10.887635 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880075 2579 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:55:10.887635 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880078 2579 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:55:10.887635 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880081 2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:55:10.887635 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880083 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:55:10.887635 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880086 2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:55:10.887635 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880088 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:55:10.887635 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880091 2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:55:10.887635 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880093 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:55:10.887635 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880096 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:55:10.887635 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880099 2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:55:10.887635 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880101 2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:55:10.887635 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880104 2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:55:10.887635 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880107 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:55:10.887635 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880109 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:55:10.887635 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880111 2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:55:10.887635 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880114 2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:55:10.887635 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880116 2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:55:10.887635 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880119 2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:55:10.888128 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880121 2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:55:10.888128 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880124 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:55:10.888128 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880126 2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:55:10.888128 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880129 2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:55:10.888128 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880131 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:55:10.888128 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880134 2579 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:55:10.888128 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880136 2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:55:10.888128 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880139 2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:55:10.888128 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880141 2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:55:10.888128 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880144 2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:55:10.888128 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880146 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:55:10.888128 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880149 2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:55:10.888128 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880151 2579 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:55:10.888128 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880154 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:55:10.888128 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880157 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:55:10.888128 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880161 2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:55:10.888128 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880163 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:55:10.888128 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880166 2579 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:55:10.888128 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880168 2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:55:10.888128 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880171 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:55:10.888613 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880173 2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:55:10.888613 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880175 2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:55:10.888613 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880178 2579 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:55:10.888613 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880182 2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:55:10.888613 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880185 2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:55:10.888613 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880188 2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:55:10.888613 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.880216 2579 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 00:55:10.888613 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880350 2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:55:10.888613 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880354 2579 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:55:10.888613 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880357 2579 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:55:10.888613 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880360 2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:55:10.888613 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880362 2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:55:10.888613 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880365 2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:55:10.888613 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880367 2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:55:10.888613 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880370 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:55:10.888613 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880372 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:55:10.889263 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880375 2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:55:10.889263 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880378 2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:55:10.889263 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880380 2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:55:10.889263 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880383 2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:55:10.889263 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880385 2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:55:10.889263 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880388 2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:55:10.889263 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880391 2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:55:10.889263 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880393 2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:55:10.889263 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880396 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:55:10.889263 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880398 2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:55:10.889263 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880401 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:55:10.889263 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880404 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:55:10.889263 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880407 2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:55:10.889263 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880409 2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:55:10.889263 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880412 2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:55:10.889263 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880414 2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:55:10.889263 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880417 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:55:10.889263 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880420 2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:55:10.889263 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880422 2579 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:55:10.889263 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880425 2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:55:10.889973 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880427 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:55:10.889973 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880430 2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:55:10.889973 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880434 2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:55:10.889973 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880437 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:55:10.889973 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880441 2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:55:10.889973 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880445 2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:55:10.889973 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880448 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:55:10.889973 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880451 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:55:10.889973 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880454 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:55:10.889973 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880456 2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:55:10.889973 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880459 2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:55:10.889973 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880461 2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:55:10.889973 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880464 2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:55:10.889973 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880466 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:55:10.889973 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880469 2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:55:10.889973 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880471 2579 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:55:10.889973 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880474 2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:55:10.889973 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880477 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:55:10.889973 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880479 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:55:10.890427 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880482 2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:55:10.890427 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880484 2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:55:10.890427 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880487 2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:55:10.890427 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880490 2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:55:10.890427 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880492 2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:55:10.890427 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880495 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:55:10.890427 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880497 2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:55:10.890427 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880500 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:55:10.890427 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880503 2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:55:10.890427 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880505 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:55:10.890427 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880507 2579 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:55:10.890427 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880510 2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:55:10.890427 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880512 2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:55:10.890427 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880515 2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:55:10.890427 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880517 2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:55:10.890427 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880520 2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:55:10.890427 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880522 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:55:10.890427 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880525 2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:55:10.890427 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880528 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:55:10.891148 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880530 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:55:10.891148 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880533 2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:55:10.891148 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880535 2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:55:10.891148 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880538 2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:55:10.891148 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880540 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:55:10.891148 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880543 2579 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:55:10.891148 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880545 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:55:10.891148 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880548 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:55:10.891148 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880564 2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:55:10.891148 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880567 2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:55:10.891148 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880570 2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:55:10.891148 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880574 2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:55:10.891148 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880576 2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:55:10.891148 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880579 2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:55:10.891148 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880582 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:55:10.891148 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880584 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:55:10.891148 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880587 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:55:10.891148 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880589 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:55:10.891148 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880592 2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:55:10.891719 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880594 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:55:10.891719 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880598 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:55:10.891719 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880600 2579 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:55:10.891719 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880603 2579 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:55:10.891719 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880605 2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:55:10.891719 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880608 2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:55:10.891719 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880610 2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:55:10.891719 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880613 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:55:10.891719 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880615 2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:55:10.891719 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880618 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:55:10.891719 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880620 2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:55:10.891719 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880623 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:55:10.891719 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880625 2579 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:55:10.891719 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880628 2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:55:10.891719 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880630 2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:55:10.891719 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880633 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:55:10.891719 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880635 2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:55:10.891719 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880638 2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:55:10.891719 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880640 2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:55:10.891719 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880643 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:55:10.892183 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.880666 2579 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 00:55:10.892183 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880696 2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:55:10.892183 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880700 2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:55:10.892183 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880704 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:55:10.892183 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880707 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:55:10.892183 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880709 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:55:10.892183 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880712 2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:55:10.892183 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880714 2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:55:10.892183 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880717 2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:55:10.892183 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880720 2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:55:10.892183 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880723 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:55:10.892183 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880725 2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:55:10.892183 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880728 2579 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:55:10.892183 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880730 2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:55:10.892183 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880733 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:55:10.892532 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880736 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:55:10.892532 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880738 2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:55:10.892532 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880741 2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:55:10.892532 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880743 2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:55:10.892532 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880746 2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:55:10.892532 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880748 2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:55:10.892532 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880751 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:55:10.892532 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880754 2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:55:10.892532 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880756 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:55:10.892532 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880759 2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:55:10.892532 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880761 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:55:10.892532 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880764 2579 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:55:10.892532 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880767 2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:55:10.892532 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880769 2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:55:10.892532 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880771 2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:55:10.892532 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880774 2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:55:10.892532 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880777 2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:55:10.892532 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880779 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:55:10.892532 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880782 2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:55:10.893016 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880784 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:55:10.893016 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880787 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:55:10.893016 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880789 2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:55:10.893016 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880792 2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:55:10.893016 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880794 2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:55:10.893016 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880797 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:55:10.893016 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880799 2579 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:55:10.893016 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880802 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:55:10.893016 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880804 2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:55:10.893016 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880807 2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:55:10.893016 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880809 2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:55:10.893016 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880813 2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:55:10.893016 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880817 2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:55:10.893016 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880820 2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:55:10.893016 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880824 2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:55:10.893016 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880827 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:55:10.893016 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880829 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:55:10.893016 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880832 2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:55:10.893016 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880839 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:55:10.893458 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880842 2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:55:10.893458 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880845 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:55:10.893458 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880847 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:55:10.893458 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880850 2579 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:55:10.893458 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880853 2579 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:55:10.893458 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880855 2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:55:10.893458 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880858 2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:55:10.893458 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880860 2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:55:10.893458 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880863 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:55:10.893458 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880865 2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:55:10.893458 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880868 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:55:10.893458 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880871 2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:55:10.893458 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880873 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:55:10.893458 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880876 2579 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:55:10.893458 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880878 2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:55:10.893458 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880881 2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:55:10.893458 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880883 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:55:10.893458 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880886 2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:55:10.893458 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880889 2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:55:10.893458 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880891 2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:55:10.893937 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880894 2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:55:10.893937 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880896 2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:55:10.893937 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880899 2579 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:55:10.893937 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880902 2579 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:55:10.893937 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880904 2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:55:10.893937 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880907 2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:55:10.893937 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880909 2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:55:10.893937 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880912 2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:55:10.893937 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880915 2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:55:10.893937 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880918 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:55:10.893937 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880920 2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:55:10.893937 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880924 2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:55:10.893937 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880927 2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:55:10.893937 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880929 2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:55:10.893937 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880932 2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:55:10.893937 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880934 2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:55:10.893937 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880937 2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:55:10.893937 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880939 2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:55:10.893937 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880942 2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:55:10.893937 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880944 2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:55:10.894450 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880947 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:55:10.894450 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880949 2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:55:10.894450 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880953 2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:55:10.894450 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880956 2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:55:10.894450 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880958 2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:55:10.894450 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880961 2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:55:10.894450 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880963 2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:55:10.894450 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880966 2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:55:10.894450 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880968 2579 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:55:10.894450 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880971 2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:55:10.894450 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880973 2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:55:10.894450 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880976 2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:55:10.894450 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880980 2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:55:10.894450 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:10.880984 2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:55:10.894450 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.881048 2579 server.go:957] "Client rotation is on, will bootstrap in background" Oct 31 00:55:10.894450 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.884011 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 31 00:55:10.894450 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.884998 2579 server.go:1014] "Starting client certificate rotation" Oct 31 00:55:10.894450 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.885111 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 31 00:55:10.894909 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.885975 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 31 00:55:10.894909 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.887168 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 31 00:55:10.894909 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.890206 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 31 00:55:10.901104 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.901089 2579 log.go:25] "Validated CRI v1 runtime API" Oct 31 00:55:10.906744 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.906729 2579 log.go:25] "Validated CRI v1 image API" Oct 31 00:55:10.907643 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.907613 2579 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 31 00:55:10.912303 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.912211 2579 fs.go:135] Filesystem UUIDs: map[26e1a12f-26a1-46c8-8b01-ab5a5c33771b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9fd56436-6f20-4a14-83b0-c6603bbb7c49:/dev/nvme0n1p3] Oct 31 00:55:10.912428 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.912305 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Oct 31 00:55:10.918453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.918344 2579 manager.go:217] Machine: {Timestamp:2026-10-31 00:55:10.91679195 +0000 UTC m=+0.338756473 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100097 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27dd9caf45879e983a03de6a4a70e8 SystemUUID:ec27dd9c-af45-879e-983a-03de6a4a70e8 BootID:4243692a-ab75-4d8f-ae75-cad200410e8d Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e1:0d:a0:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e1:0d:a0:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:01:20:72:cc:1d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 31 00:55:10.919060 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.919049 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 31 00:55:10.919143 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.919131 2579 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 31 00:55:10.920913 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.920896 2579 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 31 00:55:10.922517 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.922494 2579 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 31 00:55:10.922655 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.922519 2579 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-179.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 31 00:55:10.922706 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.922658 2579 topology_manager.go:143] "Creating topology manager with none policy" Oct 31 00:55:10.922706 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.922665 2579 container_manager_linux.go:311] "Creating device plugin manager" Oct 31 00:55:10.922706 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.922688 2579 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 31 00:55:10.923594 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.923584 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 31 00:55:10.925067 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.925058 2579 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 31 00:55:10.929200 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.929188 2579 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 31 00:55:10.929322 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.929313 2579 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 31 00:55:10.929350 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.929344 2579 kubelet.go:493] "Attempting to sync node with API server" Oct 31 00:55:10.929383 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.929357 2579 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 31 00:55:10.929383 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.929374 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 31 00:55:10.929436 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.929385 2579 kubelet.go:405] "Adding apiserver pod source" Oct 31 00:55:10.929436 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.929393 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 31 00:55:10.929711 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.929697 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 31 00:55:10.931989 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.931970 2579 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 31 00:55:10.938796 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.938779 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 31 00:55:10.939697 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.939684 2579 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 31 00:55:10.939743 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.939714 2579 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 31 00:55:10.939874 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.939864 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 31 00:55:10.939904 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.939879 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 31 00:55:10.939904 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.939885 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 31 00:55:10.939904 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.939892 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 31 00:55:10.939904 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.939897 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 31 00:55:10.939904 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.939903 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 31 00:55:10.940585 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.940575 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 31 00:55:10.940585 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.940585 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 31 00:55:10.940648 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.940592 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 31 00:55:10.940648 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.940598 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 31 00:55:10.940648 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.940607 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 31 00:55:10.940648 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.940615 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 31 00:55:10.941558 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.941537 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 31 00:55:10.941596 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.941566 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 31 00:55:10.945305 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.945292 2579 server.go:1263] "Started kubelet" Oct 31 00:55:10.945443 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.945412 2579 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 31 00:55:10.945574 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.945512 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 31 00:55:10.945646 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.945597 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 31 00:55:10.946950 ip-10-0-132-179 systemd[1]: Started Kubernetes Kubelet. Oct 31 00:55:10.947998 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.947017 2579 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 31 00:55:10.948918 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.948905 2579 server.go:317] "Adding debug handlers to kubelet server" Oct 31 00:55:10.952867 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.952848 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-179.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 31 00:55:10.952973 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:10.952891 2579 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-179.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Oct 31 00:55:10.953258 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:10.953233 2579 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 31 00:55:10.955573 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:10.952889 2579 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Oct 31 00:55:10.957421 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:10.953127 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-179.us-east-2.compute.internal.18e3772cce3253c2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-179.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-179.us-east-2.compute.internal,},FirstTimestamp:2026-10-31 00:55:10.945260482 +0000 UTC m=+0.367225005,LastTimestamp:2026-10-31 00:55:10.945260482 +0000 UTC m=+0.367225005,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-179.us-east-2.compute.internal,}" Oct 31 00:55:10.957510 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.957491 2579 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 31 00:55:10.957510 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.957497 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 31 00:55:10.957627 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:10.957613 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-179.us-east-2.compute.internal\" not found" Oct 31 00:55:10.958247 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.958224 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 31 00:55:10.958247 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.958229 2579 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 31 00:55:10.958247 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.958249 2579 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 31 00:55:10.958427 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.958329 2579 reconstruct.go:97] "Volume reconstruction finished" Oct 31 00:55:10.958427 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.958339 2579 reconciler.go:29] "Reconciler: start to sync state" Oct 31 00:55:10.958492 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.958481 2579 factory.go:55] Registering systemd factory Oct 31 00:55:10.958529 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.958497 2579 factory.go:223] Registration of the systemd container factory successfully Oct 31 00:55:10.958726 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.958713 2579 factory.go:153] Registering CRI-O factory Oct 31 00:55:10.958784 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.958732 2579 factory.go:223] Registration of the crio container factory successfully Oct 31 00:55:10.958842 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.958825 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 31 00:55:10.958919 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.958854 2579 factory.go:103] Registering Raw factory Oct 31 00:55:10.958919 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.958874 2579 manager.go:1199] Started watching for new ooms in manager Oct 31 00:55:10.959711 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:10.959689 2579 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-179.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Oct 31 00:55:10.960244 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.960223 2579 manager.go:319] Starting recovery of all containers Oct 31 00:55:10.961041 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.961018 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5lrr8" Oct 31 00:55:10.967496 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.967441 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 31 00:55:10.968640 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.968619 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5lrr8" Oct 31 00:55:10.969520 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.969504 2579 manager.go:324] Recovery completed Oct 31 00:55:10.971713 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:10.971692 2579 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Oct 31 00:55:10.973897 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.973883 2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:55:10.975593 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.975578 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 31 00:55:10.975655 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.975606 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 31 00:55:10.975655 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.975615 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 31 00:55:10.976110 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.976094 2579 cpu_manager.go:226] "Starting" policy="none" Oct 31 00:55:10.976110 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.976108 2579 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 31 00:55:10.976226 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.976126 2579 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 31 00:55:10.976226 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.976099 2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:55:10.976854 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.976839 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 31 00:55:10.976928 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.976865 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 31 00:55:10.976928 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.976877 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 31 00:55:10.978076 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.978061 2579 policy_none.go:50] "Start" Oct 31 00:55:10.978076 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.978079 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 31 00:55:10.978179 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.978092 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 31 00:55:10.980039 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:10.980029 2579 policy_none.go:44] "Start" Oct 31 00:55:11.004253 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.004214 2579 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 31 00:55:11.008190 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.008175 2579 manager.go:341] "Starting Device Plugin manager" Oct 31 00:55:11.008265 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:11.008223 2579 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 31 00:55:11.008265 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.008234 2579 server.go:87] "Starting device plugin registration server" Oct 31 00:55:11.008477 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.008465 2579 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 31 00:55:11.008533 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.008478 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 31 00:55:11.008656 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.008629 2579 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 31 00:55:11.011719 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.008793 2579 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 31 00:55:11.011719 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.008805 2579 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 31 00:55:11.011719 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:11.009301 2579 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 31 00:55:11.011719 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:11.009343 2579 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-179.us-east-2.compute.internal\" not found" Oct 31 00:55:11.037035 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.027985 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 31 00:55:11.037035 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.028004 2579 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 31 00:55:11.037035 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.028020 2579 kubelet.go:2521] "Starting kubelet main sync loop" Oct 31 00:55:11.037035 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:11.028058 2579 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Oct 31 00:55:11.037035 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.030756 2579 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:55:11.109606 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.109580 2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:55:11.110396 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.110377 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 31 00:55:11.110483 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.110409 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 31 00:55:11.110483 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.110421 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 31 00:55:11.110483 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.110442 2579 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:55:11.119593 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.119539 2579 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:55:11.119593 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:11.119576 2579 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-179.us-east-2.compute.internal\": node \"ip-10-0-132-179.us-east-2.compute.internal\" not found" Oct 31 00:55:11.128382 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.128364 2579 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal"] Oct 31 00:55:11.128452 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.128414 2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:55:11.129202 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.129185 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 31 00:55:11.129268 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.129213 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 31 00:55:11.129268 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.129229 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 31 00:55:11.131306 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.131294 2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:55:11.131468 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.131449 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:55:11.131539 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.131478 2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:55:11.132025 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.132009 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 31 00:55:11.132093 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.132014 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 31 00:55:11.132093 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.132052 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 31 00:55:11.132093 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.132062 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 31 00:55:11.132093 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.132032 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 31 00:55:11.132310 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.132102 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 31 00:55:11.133919 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.133904 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:55:11.133970 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.133929 2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:55:11.134525 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.134510 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 31 00:55:11.134609 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.134534 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 31 00:55:11.134609 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.134543 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 31 00:55:11.143072 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:11.143059 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-179.us-east-2.compute.internal\" not found" Oct 31 00:55:11.177878 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:11.177861 2579 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-179.us-east-2.compute.internal\" not found" node="ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:55:11.180238 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:11.180221 2579 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-179.us-east-2.compute.internal\" not found" node="ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:55:11.243641 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:11.243620 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-179.us-east-2.compute.internal\" not found" Oct 31 00:55:11.258851 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.258831 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d8e91b3b436f98c50afdd4fa50ff7ebd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal\" (UID: \"d8e91b3b436f98c50afdd4fa50ff7ebd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:55:11.258920 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.258856 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8e91b3b436f98c50afdd4fa50ff7ebd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal\" (UID: \"d8e91b3b436f98c50afdd4fa50ff7ebd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:55:11.258920 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.258872 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0222b47fe84780a8d4956385717c70a6-config\") pod \"kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal\" (UID: \"0222b47fe84780a8d4956385717c70a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:55:11.343968 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:11.343937 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-179.us-east-2.compute.internal\" not found" Oct 31 00:55:11.359212 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.359190 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0222b47fe84780a8d4956385717c70a6-config\") pod \"kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal\" (UID: \"0222b47fe84780a8d4956385717c70a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:55:11.359271 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.359217 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d8e91b3b436f98c50afdd4fa50ff7ebd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal\" (UID: \"d8e91b3b436f98c50afdd4fa50ff7ebd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:55:11.359271 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.359232 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8e91b3b436f98c50afdd4fa50ff7ebd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal\" (UID: \"d8e91b3b436f98c50afdd4fa50ff7ebd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:55:11.359360 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.359277 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8e91b3b436f98c50afdd4fa50ff7ebd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal\" (UID: \"d8e91b3b436f98c50afdd4fa50ff7ebd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:55:11.359360 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.359278 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0222b47fe84780a8d4956385717c70a6-config\") pod \"kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal\" (UID: \"0222b47fe84780a8d4956385717c70a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:55:11.359360 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.359307 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d8e91b3b436f98c50afdd4fa50ff7ebd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal\" (UID: \"d8e91b3b436f98c50afdd4fa50ff7ebd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:55:11.444611 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:11.444569 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-179.us-east-2.compute.internal\" not found" Oct 31 00:55:11.482941 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.482920 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:55:11.486205 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.486061 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:55:11.545481 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:11.545460 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-179.us-east-2.compute.internal\" not found" Oct 31 00:55:11.645935 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:11.645913 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-179.us-east-2.compute.internal\" not found" Oct 31 00:55:11.746462 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:11.746414 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-179.us-east-2.compute.internal\" not found" Oct 31 00:55:11.846888 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:11.846868 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-179.us-east-2.compute.internal\" not found" Oct 31 00:55:11.884364 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.884347 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 31 00:55:11.884752 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.884458 2579 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 31 00:55:11.947112 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:11.947076 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-179.us-east-2.compute.internal\" not found" Oct 31 00:55:11.975040 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.974997 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 00:50:11 +0000 UTC" deadline="2028-07-03 20:32:18.144650199 +0000 UTC" Oct 31 00:55:11.975040 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:11.975035 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14683h37m6.169618039s" Oct 31 00:55:12.047702 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:12.047649 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-179.us-east-2.compute.internal\" not found" Oct 31 00:55:12.148566 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:12.148511 2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-179.us-east-2.compute.internal\" not found" Oct 31 00:55:12.194935 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:12.194904 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0222b47fe84780a8d4956385717c70a6.slice/crio-c21eb5eb1093fe216589c3bc7ee8119c13ed65eac6f72ecd12aaf93d06829b9c WatchSource:0}: Error finding container c21eb5eb1093fe216589c3bc7ee8119c13ed65eac6f72ecd12aaf93d06829b9c: Status 404 returned error can't find the container with id c21eb5eb1093fe216589c3bc7ee8119c13ed65eac6f72ecd12aaf93d06829b9c Oct 31 00:55:12.195362 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:12.195339 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8e91b3b436f98c50afdd4fa50ff7ebd.slice/crio-166ed07caade26a201d728ceb1829f9bf1f1df0d11160b46bf6fdb4e8ae54655 WatchSource:0}: Error finding container 166ed07caade26a201d728ceb1829f9bf1f1df0d11160b46bf6fdb4e8ae54655: Status 404 returned error can't find the container with id 166ed07caade26a201d728ceb1829f9bf1f1df0d11160b46bf6fdb4e8ae54655 Oct 31 00:55:12.201128 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.201113 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 31 00:55:12.217014 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.216997 2579 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:55:12.258148 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.258117 2579 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:55:12.271564 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.271533 2579 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:55:12.273578 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.273555 2579 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 00:55:12.274786 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.274773 2579 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:55:12.284392 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.284377 2579 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 00:55:12.447668 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.447600 2579 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:55:12.923902 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.923832 2579 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:55:12.931283 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.931261 2579 apiserver.go:52] "Watching apiserver" Oct 31 00:55:12.941534 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.941508 2579 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 31 00:55:12.941952 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.941931 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-r8q7t","kube-system/konnectivity-agent-fzjbb","openshift-cluster-node-tuning-operator/tuned-cbsws","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal","openshift-multus/network-metrics-daemon-4bzzq","openshift-ovn-kubernetes/ovnkube-node-4kgjb","openshift-image-registry/node-ca-6mv8k","openshift-multus/multus-additional-cni-plugins-qbrtn","openshift-network-operator/iptables-alerter-gsdzf","kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6","openshift-dns/node-resolver-twq8q","kube-system/global-pull-secret-syncer-wtcjv","openshift-multus/multus-nl27p"] Oct 31 00:55:12.944482 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.944460 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:12.944626 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:12.944531 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bzzq" podUID="159fdfbd-fdcc-4655-b273-f0964617ed13" Oct 31 00:55:12.946882 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.946860 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:12.949248 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.949224 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:12.949358 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:12.949300 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtcjv" podUID="6d207e59-c491-43cb-a331-5b89a78f470c" Oct 31 00:55:12.951174 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.951151 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 31 00:55:12.951276 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.951247 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 31 00:55:12.951276 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.951251 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 31 00:55:12.951398 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.951298 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dlpqk\"" Oct 31 00:55:12.951625 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.951596 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fzjbb" Oct 31 00:55:12.954099 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.954080 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:12.956646 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.956612 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:12.956748 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:12.956685 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8q7t" podUID="a1a12f14-a3aa-43b0-8ada-4568a87f7186" Oct 31 00:55:12.958495 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.958463 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Oct 31 00:55:12.959161 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.959137 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:12.959161 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.959146 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 31 00:55:12.962190 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.962168 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6mv8k" Oct 31 00:55:12.964254 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.964234 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:12.966714 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.966690 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gsdzf" Oct 31 00:55:12.968483 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.968457 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-run-ovn-kubernetes\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:12.968610 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.968497 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-ovn-node-metrics-cert\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:12.968610 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.968525 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-ovnkube-script-lib\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:12.968610 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.968550 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrtm2\" (UniqueName: \"kubernetes.io/projected/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-kube-api-access-wrtm2\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:12.968610 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.968577 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d207e59-c491-43cb-a331-5b89a78f470c-kubelet-config\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:12.968774 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.968644 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d207e59-c491-43cb-a331-5b89a78f470c-dbus\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:12.968774 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.968676 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33816f29-a274-4bbb-83d7-72820504fee3-konnectivity-ca\") pod \"konnectivity-agent-fzjbb\" (UID: \"33816f29-a274-4bbb-83d7-72820504fee3\") " pod="kube-system/konnectivity-agent-fzjbb" Oct 31 00:55:12.968774 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.968743 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-kubernetes\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:12.968897 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.968778 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-sysctl-d\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:12.968897 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.968815 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-sysctl-conf\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:12.968897 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.968841 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-systemd\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:12.969356 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.969337 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nl27p" Oct 31 00:55:12.969452 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.969396 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnw8h\" (UniqueName: \"kubernetes.io/projected/330d9526-3090-4286-ab5c-db9eb532f4c5-kube-api-access-wnw8h\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:12.969452 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.969441 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-registration-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:12.969589 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.969469 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-run-openvswitch\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:12.969589 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.969514 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-run-ovn\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:12.969589 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.969539 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-node-log\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:12.969751 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.969604 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-cni-netd\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:12.969751 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.969663 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:12.969751 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.969713 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs\") pod \"network-metrics-daemon-4bzzq\" (UID: \"159fdfbd-fdcc-4655-b273-f0964617ed13\") " pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:12.969971 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.969751 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj9gv\" (UniqueName: \"kubernetes.io/projected/159fdfbd-fdcc-4655-b273-f0964617ed13-kube-api-access-tj9gv\") pod \"network-metrics-daemon-4bzzq\" (UID: \"159fdfbd-fdcc-4655-b273-f0964617ed13\") " pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:12.969971 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.969797 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-device-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:12.969971 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.969816 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-lib-modules\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:12.969971 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.969870 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-etc-openvswitch\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:12.969971 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.969921 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-sys-fs\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:12.969971 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.969966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-modprobe-d\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:12.970308 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970003 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktcbp\" (UniqueName: \"kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp\") pod \"network-check-target-r8q7t\" (UID: \"a1a12f14-a3aa-43b0-8ada-4568a87f7186\") " pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:12.970308 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970038 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-kubelet\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:12.970308 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970069 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-slash\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:12.970308 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970103 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-var-lib-kubelet\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:12.970308 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970132 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-var-lib-openvswitch\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:12.970308 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970166 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-log-socket\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:12.970308 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970202 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-cni-bin\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:12.970308 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970237 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-env-overrides\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:12.970308 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970288 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-etc-selinux\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:12.970722 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970328 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-run\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:12.970722 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970363 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-tuned\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:12.970722 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970395 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/330d9526-3090-4286-ab5c-db9eb532f4c5-tmp\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:12.970722 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970473 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-run-systemd\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:12.970722 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970529 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:12.970722 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970572 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-socket-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:12.970722 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970606 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25sgt\" (UniqueName: \"kubernetes.io/projected/3adb1944-49fd-4158-b195-4e80ebfd8f58-kube-api-access-25sgt\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:12.970722 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970628 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-sysconfig\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:12.970722 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970660 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-host\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:12.970722 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970687 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-systemd-units\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:12.971043 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970728 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-run-netns\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:12.971043 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970749 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-ovnkube-config\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:12.971043 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970772 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:12.971043 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970791 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33816f29-a274-4bbb-83d7-72820504fee3-agent-certs\") pod \"konnectivity-agent-fzjbb\" (UID: \"33816f29-a274-4bbb-83d7-72820504fee3\") " pod="kube-system/konnectivity-agent-fzjbb" Oct 31 00:55:12.971043 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.970877 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-sys\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:12.972230 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.972207 2579 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 31 00:55:12.973663 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.973643 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-twq8q" Oct 31 00:55:12.997840 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:12.997819 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4qxs7" Oct 31 00:55:13.007404 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.007379 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4qxs7" Oct 31 00:55:13.032080 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.032039 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal" event={"ID":"0222b47fe84780a8d4956385717c70a6","Type":"ContainerStarted","Data":"c21eb5eb1093fe216589c3bc7ee8119c13ed65eac6f72ecd12aaf93d06829b9c"} Oct 31 00:55:13.033602 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.033194 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" event={"ID":"d8e91b3b436f98c50afdd4fa50ff7ebd","Type":"ContainerStarted","Data":"166ed07caade26a201d728ceb1829f9bf1f1df0d11160b46bf6fdb4e8ae54655"} Oct 31 00:55:13.059609 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.059590 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 31 00:55:13.060081 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.060060 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 31 00:55:13.060187 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.060079 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-jrg45\"" Oct 31 00:55:13.060277 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.060257 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 31 00:55:13.060331 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.060321 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 31 00:55:13.061415 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.061392 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 31 00:55:13.061523 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.061448 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 31 00:55:13.061523 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.061482 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 31 00:55:13.062271 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.062241 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 31 00:55:13.062358 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.062334 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:55:13.062358 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.062331 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xcm4p\"" Oct 31 00:55:13.062474 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.062360 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4j5v2\"" Oct 31 00:55:13.062474 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.062366 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:55:13.062474 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.062361 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 31 00:55:13.062474 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.062370 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 31 00:55:13.062474 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.062383 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 31 00:55:13.062474 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.062415 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m2wnh\"" Oct 31 00:55:13.062474 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.062439 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 31 00:55:13.062777 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.062560 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 31 00:55:13.062777 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.062577 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 31 00:55:13.062777 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.062580 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 31 00:55:13.062777 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.062639 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-xxmpd\"" Oct 31 00:55:13.063733 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.063715 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 31 00:55:13.063824 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.063721 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 31 00:55:13.063824 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.063740 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 31 00:55:13.064579 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.064540 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j9qsc\"" Oct 31 00:55:13.064712 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.064679 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 31 00:55:13.064712 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.064695 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9dpj5\"" Oct 31 00:55:13.064712 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.064687 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 31 00:55:13.064842 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.064722 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 31 00:55:13.064842 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.064737 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 31 00:55:13.064842 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.064749 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-89rf9\"" Oct 31 00:55:13.071231 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071202 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d207e59-c491-43cb-a331-5b89a78f470c-dbus\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:13.071335 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071239 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-kubernetes\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.071335 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071268 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-sysctl-conf\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.071335 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071307 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-run-openvswitch\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.071335 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071331 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-cni-netd\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.071487 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071357 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.071487 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071390 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/58a9ea73-4db8-44ee-83ac-55504736d028-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.071487 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071410 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-kubernetes\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.071487 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071438 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-sysctl-conf\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.071487 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071417 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b0086739-e8c7-4143-b297-87002d2f7dfb-iptables-alerter-script\") pod \"iptables-alerter-gsdzf\" (UID: \"b0086739-e8c7-4143-b297-87002d2f7dfb\") " pod="openshift-network-operator/iptables-alerter-gsdzf" Oct 31 00:55:13.071678 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071497 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7885b2e1-6437-402d-9335-f2b5bb2be17a-cni-binary-copy\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.071678 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071528 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-conf-dir\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.071678 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071493 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-cni-netd\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.071678 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071538 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.071678 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071571 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-run-openvswitch\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.071678 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071613 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d207e59-c491-43cb-a331-5b89a78f470c-dbus\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:13.071678 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071619 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-etc-kubernetes\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.072030 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071683 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-device-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:13.072030 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071708 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-socket-dir-parent\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.072030 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071733 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-daemon-config\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.072030 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071754 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-device-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:13.072030 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071759 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-sys-fs\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:13.072030 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071797 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-modprobe-d\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.072030 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071806 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-sys-fs\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:13.072030 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071828 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktcbp\" (UniqueName: \"kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp\") pod \"network-check-target-r8q7t\" (UID: \"a1a12f14-a3aa-43b0-8ada-4568a87f7186\") " pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:13.072030 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071911 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b23111a-a892-4d92-990d-742a857450fa-host\") pod \"node-ca-6mv8k\" (UID: \"9b23111a-a892-4d92-990d-742a857450fa\") " pod="openshift-image-registry/node-ca-6mv8k" Oct 31 00:55:13.072030 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071923 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-modprobe-d\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.072030 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071939 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txczj\" (UniqueName: \"kubernetes.io/projected/9b23111a-a892-4d92-990d-742a857450fa-kube-api-access-txczj\") pod \"node-ca-6mv8k\" (UID: \"9b23111a-a892-4d92-990d-742a857450fa\") " pod="openshift-image-registry/node-ca-6mv8k" Oct 31 00:55:13.072030 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.071968 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rcsn\" (UniqueName: \"kubernetes.io/projected/f6434cdd-b8a7-4fdb-ab00-53f19ce35b98-kube-api-access-8rcsn\") pod \"node-resolver-twq8q\" (UID: \"f6434cdd-b8a7-4fdb-ab00-53f19ce35b98\") " pod="openshift-dns/node-resolver-twq8q" Oct 31 00:55:13.072030 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072013 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-var-lib-kubelet\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.072692 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072039 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-var-lib-openvswitch\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.072692 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072063 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-log-socket\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.072692 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072090 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/58a9ea73-4db8-44ee-83ac-55504736d028-system-cni-dir\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.072692 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072167 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvd5m\" (UniqueName: \"kubernetes.io/projected/b0086739-e8c7-4143-b297-87002d2f7dfb-kube-api-access-gvd5m\") pod \"iptables-alerter-gsdzf\" (UID: \"b0086739-e8c7-4143-b297-87002d2f7dfb\") " pod="openshift-network-operator/iptables-alerter-gsdzf" Oct 31 00:55:13.072692 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072197 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-run-netns\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.072692 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072203 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-var-lib-openvswitch\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.072692 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072224 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-run-multus-certs\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.072692 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072253 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-run\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.072692 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072264 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-var-lib-kubelet\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.072692 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072279 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-tuned\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.072692 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072321 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-log-socket\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.072692 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072364 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-run\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.072692 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-run-systemd\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.072692 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072436 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6434cdd-b8a7-4fdb-ab00-53f19ce35b98-tmp-dir\") pod \"node-resolver-twq8q\" (UID: \"f6434cdd-b8a7-4fdb-ab00-53f19ce35b98\") " pod="openshift-dns/node-resolver-twq8q" Oct 31 00:55:13.072692 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072463 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-host\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.072692 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072488 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-systemd-units\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.072692 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072524 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-ovnkube-config\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.073537 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072549 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/58a9ea73-4db8-44ee-83ac-55504736d028-cnibin\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.073537 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072572 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-var-lib-cni-bin\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.073537 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072597 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-hostroot\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.073537 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072621 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-systemd-units\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.073537 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072637 2579 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 31 00:55:13.073537 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072684 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33816f29-a274-4bbb-83d7-72820504fee3-agent-certs\") pod \"konnectivity-agent-fzjbb\" (UID: \"33816f29-a274-4bbb-83d7-72820504fee3\") " pod="kube-system/konnectivity-agent-fzjbb" Oct 31 00:55:13.073537 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072713 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-ovn-node-metrics-cert\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.073537 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072742 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-ovnkube-script-lib\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.073537 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072764 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-cnibin\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.073537 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072787 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-run-k8s-cni-cncf-io\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.073537 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072810 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d207e59-c491-43cb-a331-5b89a78f470c-kubelet-config\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:13.073537 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072833 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33816f29-a274-4bbb-83d7-72820504fee3-konnectivity-ca\") pod \"konnectivity-agent-fzjbb\" (UID: \"33816f29-a274-4bbb-83d7-72820504fee3\") " pod="kube-system/konnectivity-agent-fzjbb" Oct 31 00:55:13.073537 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072856 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-sysctl-d\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.073537 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072935 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-run-systemd\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.073537 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072961 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-systemd\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.073537 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.072994 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnw8h\" (UniqueName: \"kubernetes.io/projected/330d9526-3090-4286-ab5c-db9eb532f4c5-kube-api-access-wnw8h\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.073537 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073027 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/58a9ea73-4db8-44ee-83ac-55504736d028-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.074199 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073054 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-registration-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:13.074199 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073077 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-run-ovn\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.074199 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073098 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-node-log\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.074199 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/58a9ea73-4db8-44ee-83ac-55504736d028-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.074199 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073157 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-cni-dir\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.074199 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073181 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs\") pod \"network-metrics-daemon-4bzzq\" (UID: \"159fdfbd-fdcc-4655-b273-f0964617ed13\") " pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:13.074199 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073203 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj9gv\" (UniqueName: \"kubernetes.io/projected/159fdfbd-fdcc-4655-b273-f0964617ed13-kube-api-access-tj9gv\") pod \"network-metrics-daemon-4bzzq\" (UID: \"159fdfbd-fdcc-4655-b273-f0964617ed13\") " pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:13.074199 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073226 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-lib-modules\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.074199 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073306 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-node-log\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.074199 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073327 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-etc-openvswitch\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.074199 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073371 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-registration-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:13.074199 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073373 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-kubelet\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.074199 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073382 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-systemd\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.074199 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073402 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-slash\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.074199 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073432 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-system-cni-dir\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.074199 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:13.073444 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:55:13.074199 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073461 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-var-lib-cni-multus\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.074199 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073492 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-cni-bin\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.075091 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073493 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-run-ovn\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.075091 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:13.073533 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs podName:159fdfbd-fdcc-4655-b273-f0964617ed13 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:13.573504384 +0000 UTC m=+2.995468912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs") pod "network-metrics-daemon-4bzzq" (UID: "159fdfbd-fdcc-4655-b273-f0964617ed13") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:55:13.075091 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073550 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-env-overrides\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.075091 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073576 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-etc-selinux\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:13.075091 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073603 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/330d9526-3090-4286-ab5c-db9eb532f4c5-tmp\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.075091 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073629 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-sysctl-d\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.075091 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073658 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-var-lib-kubelet\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.075091 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073881 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-host\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.075091 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.074004 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-lib-modules\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.075091 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.074037 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-etc-openvswitch\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.075091 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.074065 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-kubelet\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.075091 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.074121 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-slash\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.075091 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.074155 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:13.075091 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.074199 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-socket-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:13.075091 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.074215 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-ovnkube-config\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.075091 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.074261 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-cni-bin\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.075091 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.074306 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:13.076039 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.074350 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33816f29-a274-4bbb-83d7-72820504fee3-konnectivity-ca\") pod \"konnectivity-agent-fzjbb\" (UID: \"33816f29-a274-4bbb-83d7-72820504fee3\") " pod="kube-system/konnectivity-agent-fzjbb" Oct 31 00:55:13.076039 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.074399 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-socket-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:13.076039 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.073985 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d207e59-c491-43cb-a331-5b89a78f470c-kubelet-config\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:13.076039 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.074224 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25sgt\" (UniqueName: \"kubernetes.io/projected/3adb1944-49fd-4158-b195-4e80ebfd8f58-kube-api-access-25sgt\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:13.076039 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.074806 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-sysconfig\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.076039 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.074848 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-run-netns\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.076039 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.074877 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-etc-selinux\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:13.076039 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.074898 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b23111a-a892-4d92-990d-742a857450fa-serviceca\") pod \"node-ca-6mv8k\" (UID: \"9b23111a-a892-4d92-990d-742a857450fa\") " pod="openshift-image-registry/node-ca-6mv8k" Oct 31 00:55:13.076039 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.074929 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b0086739-e8c7-4143-b297-87002d2f7dfb-host-slash\") pod \"iptables-alerter-gsdzf\" (UID: \"b0086739-e8c7-4143-b297-87002d2f7dfb\") " pod="openshift-network-operator/iptables-alerter-gsdzf" Oct 31 00:55:13.076039 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.074955 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6434cdd-b8a7-4fdb-ab00-53f19ce35b98-hosts-file\") pod \"node-resolver-twq8q\" (UID: \"f6434cdd-b8a7-4fdb-ab00-53f19ce35b98\") " pod="openshift-dns/node-resolver-twq8q" Oct 31 00:55:13.076039 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.075747 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-ovnkube-script-lib\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.076039 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.075963 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-env-overrides\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.076658 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.076142 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:13.076658 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.076183 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-sys\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.076658 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.076218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-run-ovn-kubernetes\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.076658 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.076250 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrtm2\" (UniqueName: \"kubernetes.io/projected/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-kube-api-access-wrtm2\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.076658 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.076288 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/58a9ea73-4db8-44ee-83ac-55504736d028-cni-binary-copy\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.076658 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.076326 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4whx4\" (UniqueName: \"kubernetes.io/projected/58a9ea73-4db8-44ee-83ac-55504736d028-kube-api-access-4whx4\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.076658 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.076436 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlnkr\" (UniqueName: \"kubernetes.io/projected/7885b2e1-6437-402d-9335-f2b5bb2be17a-kube-api-access-rlnkr\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.076658 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.076551 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-run-netns\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.076658 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.076605 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-sysconfig\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.077139 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:13.076704 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 00:55:13.077139 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:13.076765 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret podName:6d207e59-c491-43cb-a331-5b89a78f470c nodeName:}" failed. No retries permitted until 2026-10-31 00:55:13.576746729 +0000 UTC m=+2.998711263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret") pod "global-pull-secret-syncer-wtcjv" (UID: "6d207e59-c491-43cb-a331-5b89a78f470c") : object "kube-system"/"original-pull-secret" not registered Oct 31 00:55:13.077139 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.076821 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-sys\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.077139 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.076895 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-run-ovn-kubernetes\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.077682 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.077660 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-ovn-node-metrics-cert\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.077884 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.077862 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/330d9526-3090-4286-ab5c-db9eb532f4c5-tmp\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.078325 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:13.078301 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 00:55:13.078398 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:13.078328 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 00:55:13.078398 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:13.078342 2579 projected.go:196] Error preparing data for projected volume kube-api-access-ktcbp for pod openshift-network-diagnostics/network-check-target-r8q7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:55:13.078521 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:13.078403 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp podName:a1a12f14-a3aa-43b0-8ada-4568a87f7186 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:13.578386435 +0000 UTC m=+3.000350970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ktcbp" (UniqueName: "kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp") pod "network-check-target-r8q7t" (UID: "a1a12f14-a3aa-43b0-8ada-4568a87f7186") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:55:13.080063 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.080037 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-tuned\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.082992 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.081903 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33816f29-a274-4bbb-83d7-72820504fee3-agent-certs\") pod \"konnectivity-agent-fzjbb\" (UID: \"33816f29-a274-4bbb-83d7-72820504fee3\") " pod="kube-system/konnectivity-agent-fzjbb" Oct 31 00:55:13.083836 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.083776 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25sgt\" (UniqueName: \"kubernetes.io/projected/3adb1944-49fd-4158-b195-4e80ebfd8f58-kube-api-access-25sgt\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:13.083943 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.083899 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnw8h\" (UniqueName: \"kubernetes.io/projected/330d9526-3090-4286-ab5c-db9eb532f4c5-kube-api-access-wnw8h\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.086288 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.086263 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj9gv\" (UniqueName: \"kubernetes.io/projected/159fdfbd-fdcc-4655-b273-f0964617ed13-kube-api-access-tj9gv\") pod \"network-metrics-daemon-4bzzq\" (UID: \"159fdfbd-fdcc-4655-b273-f0964617ed13\") " pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:13.086693 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.086672 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrtm2\" (UniqueName: \"kubernetes.io/projected/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-kube-api-access-wrtm2\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.177397 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177332 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-conf-dir\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.177397 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177365 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-etc-kubernetes\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.177397 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177386 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-socket-dir-parent\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.177650 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177401 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-daemon-config\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.177650 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177407 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-conf-dir\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.177650 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177433 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b23111a-a892-4d92-990d-742a857450fa-host\") pod \"node-ca-6mv8k\" (UID: \"9b23111a-a892-4d92-990d-742a857450fa\") " pod="openshift-image-registry/node-ca-6mv8k" Oct 31 00:55:13.177650 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177457 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txczj\" (UniqueName: \"kubernetes.io/projected/9b23111a-a892-4d92-990d-742a857450fa-kube-api-access-txczj\") pod \"node-ca-6mv8k\" (UID: \"9b23111a-a892-4d92-990d-742a857450fa\") " pod="openshift-image-registry/node-ca-6mv8k" Oct 31 00:55:13.177650 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177483 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rcsn\" (UniqueName: \"kubernetes.io/projected/f6434cdd-b8a7-4fdb-ab00-53f19ce35b98-kube-api-access-8rcsn\") pod \"node-resolver-twq8q\" (UID: \"f6434cdd-b8a7-4fdb-ab00-53f19ce35b98\") " pod="openshift-dns/node-resolver-twq8q" Oct 31 00:55:13.177650 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177495 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-socket-dir-parent\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.177650 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177497 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-etc-kubernetes\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.177650 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/58a9ea73-4db8-44ee-83ac-55504736d028-system-cni-dir\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.177650 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177511 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b23111a-a892-4d92-990d-742a857450fa-host\") pod \"node-ca-6mv8k\" (UID: \"9b23111a-a892-4d92-990d-742a857450fa\") " pod="openshift-image-registry/node-ca-6mv8k" Oct 31 00:55:13.177650 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177552 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvd5m\" (UniqueName: \"kubernetes.io/projected/b0086739-e8c7-4143-b297-87002d2f7dfb-kube-api-access-gvd5m\") pod \"iptables-alerter-gsdzf\" (UID: \"b0086739-e8c7-4143-b297-87002d2f7dfb\") " pod="openshift-network-operator/iptables-alerter-gsdzf" Oct 31 00:55:13.177650 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177592 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-run-netns\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.177650 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177563 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/58a9ea73-4db8-44ee-83ac-55504736d028-system-cni-dir\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.177650 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177612 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-run-multus-certs\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.177650 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177646 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-run-multus-certs\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.178333 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177670 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6434cdd-b8a7-4fdb-ab00-53f19ce35b98-tmp-dir\") pod \"node-resolver-twq8q\" (UID: \"f6434cdd-b8a7-4fdb-ab00-53f19ce35b98\") " pod="openshift-dns/node-resolver-twq8q" Oct 31 00:55:13.178333 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177681 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-run-netns\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.178333 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177706 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/58a9ea73-4db8-44ee-83ac-55504736d028-cnibin\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.178333 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177736 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-var-lib-cni-bin\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.178333 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177761 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-hostroot\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.178333 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177787 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-cnibin\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.178333 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177811 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-run-k8s-cni-cncf-io\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.178333 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177844 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/58a9ea73-4db8-44ee-83ac-55504736d028-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.178333 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177860 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-var-lib-cni-bin\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.178333 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177875 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/58a9ea73-4db8-44ee-83ac-55504736d028-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.178333 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177900 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/58a9ea73-4db8-44ee-83ac-55504736d028-cnibin\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.178333 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177904 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-cni-dir\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.178333 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177927 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-cnibin\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.178333 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177944 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-hostroot\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.178333 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177952 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-system-cni-dir\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.178333 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177977 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-daemon-config\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.178333 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178037 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6434cdd-b8a7-4fdb-ab00-53f19ce35b98-tmp-dir\") pod \"node-resolver-twq8q\" (UID: \"f6434cdd-b8a7-4fdb-ab00-53f19ce35b98\") " pod="openshift-dns/node-resolver-twq8q" Oct 31 00:55:13.178333 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178045 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-cni-dir\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.179109 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.177980 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-var-lib-cni-multus\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.179109 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178041 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-system-cni-dir\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.179109 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178073 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-run-k8s-cni-cncf-io\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.179109 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178076 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/58a9ea73-4db8-44ee-83ac-55504736d028-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.179109 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178093 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-var-lib-cni-multus\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.179109 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-var-lib-kubelet\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.179109 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178126 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b23111a-a892-4d92-990d-742a857450fa-serviceca\") pod \"node-ca-6mv8k\" (UID: \"9b23111a-a892-4d92-990d-742a857450fa\") " pod="openshift-image-registry/node-ca-6mv8k" Oct 31 00:55:13.179109 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178133 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-var-lib-kubelet\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.179109 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178141 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b0086739-e8c7-4143-b297-87002d2f7dfb-host-slash\") pod \"iptables-alerter-gsdzf\" (UID: \"b0086739-e8c7-4143-b297-87002d2f7dfb\") " pod="openshift-network-operator/iptables-alerter-gsdzf" Oct 31 00:55:13.179109 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178165 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6434cdd-b8a7-4fdb-ab00-53f19ce35b98-hosts-file\") pod \"node-resolver-twq8q\" (UID: \"f6434cdd-b8a7-4fdb-ab00-53f19ce35b98\") " pod="openshift-dns/node-resolver-twq8q" Oct 31 00:55:13.179109 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178195 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b0086739-e8c7-4143-b297-87002d2f7dfb-host-slash\") pod \"iptables-alerter-gsdzf\" (UID: \"b0086739-e8c7-4143-b297-87002d2f7dfb\") " pod="openshift-network-operator/iptables-alerter-gsdzf" Oct 31 00:55:13.179109 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178206 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/58a9ea73-4db8-44ee-83ac-55504736d028-cni-binary-copy\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.179109 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178258 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6434cdd-b8a7-4fdb-ab00-53f19ce35b98-hosts-file\") pod \"node-resolver-twq8q\" (UID: \"f6434cdd-b8a7-4fdb-ab00-53f19ce35b98\") " pod="openshift-dns/node-resolver-twq8q" Oct 31 00:55:13.179109 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178287 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4whx4\" (UniqueName: \"kubernetes.io/projected/58a9ea73-4db8-44ee-83ac-55504736d028-kube-api-access-4whx4\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.179109 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178315 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlnkr\" (UniqueName: \"kubernetes.io/projected/7885b2e1-6437-402d-9335-f2b5bb2be17a-kube-api-access-rlnkr\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.179109 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178346 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/58a9ea73-4db8-44ee-83ac-55504736d028-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.179109 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178372 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b0086739-e8c7-4143-b297-87002d2f7dfb-iptables-alerter-script\") pod \"iptables-alerter-gsdzf\" (UID: \"b0086739-e8c7-4143-b297-87002d2f7dfb\") " pod="openshift-network-operator/iptables-alerter-gsdzf" Oct 31 00:55:13.179695 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178396 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7885b2e1-6437-402d-9335-f2b5bb2be17a-cni-binary-copy\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.179695 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178560 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/58a9ea73-4db8-44ee-83ac-55504736d028-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.179695 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178591 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b23111a-a892-4d92-990d-742a857450fa-serviceca\") pod \"node-ca-6mv8k\" (UID: \"9b23111a-a892-4d92-990d-742a857450fa\") " pod="openshift-image-registry/node-ca-6mv8k" Oct 31 00:55:13.179695 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178751 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/58a9ea73-4db8-44ee-83ac-55504736d028-cni-binary-copy\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.179695 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.178911 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7885b2e1-6437-402d-9335-f2b5bb2be17a-cni-binary-copy\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.179854 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.179772 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/58a9ea73-4db8-44ee-83ac-55504736d028-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.179854 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.179844 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b0086739-e8c7-4143-b297-87002d2f7dfb-iptables-alerter-script\") pod \"iptables-alerter-gsdzf\" (UID: \"b0086739-e8c7-4143-b297-87002d2f7dfb\") " pod="openshift-network-operator/iptables-alerter-gsdzf" Oct 31 00:55:13.188950 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.188930 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rcsn\" (UniqueName: \"kubernetes.io/projected/f6434cdd-b8a7-4fdb-ab00-53f19ce35b98-kube-api-access-8rcsn\") pod \"node-resolver-twq8q\" (UID: \"f6434cdd-b8a7-4fdb-ab00-53f19ce35b98\") " pod="openshift-dns/node-resolver-twq8q" Oct 31 00:55:13.190153 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.190133 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlnkr\" (UniqueName: \"kubernetes.io/projected/7885b2e1-6437-402d-9335-f2b5bb2be17a-kube-api-access-rlnkr\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.190230 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.190216 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvd5m\" (UniqueName: \"kubernetes.io/projected/b0086739-e8c7-4143-b297-87002d2f7dfb-kube-api-access-gvd5m\") pod \"iptables-alerter-gsdzf\" (UID: \"b0086739-e8c7-4143-b297-87002d2f7dfb\") " pod="openshift-network-operator/iptables-alerter-gsdzf" Oct 31 00:55:13.190426 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.190409 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txczj\" (UniqueName: \"kubernetes.io/projected/9b23111a-a892-4d92-990d-742a857450fa-kube-api-access-txczj\") pod \"node-ca-6mv8k\" (UID: \"9b23111a-a892-4d92-990d-742a857450fa\") " pod="openshift-image-registry/node-ca-6mv8k" Oct 31 00:55:13.190522 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.190501 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4whx4\" (UniqueName: \"kubernetes.io/projected/58a9ea73-4db8-44ee-83ac-55504736d028-kube-api-access-4whx4\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.267953 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.267926 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:55:13.270171 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.270147 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fzjbb" Oct 31 00:55:13.281256 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.281230 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:55:13.283033 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:13.283001 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3adb1944_49fd_4158_b195_4e80ebfd8f58.slice/crio-354fc15ac80d0e1a7d05a61557fd1d6c00a4a67ed851ba9a282f6aa8bd1e2fd2 WatchSource:0}: Error finding container 354fc15ac80d0e1a7d05a61557fd1d6c00a4a67ed851ba9a282f6aa8bd1e2fd2: Status 404 returned error can't find the container with id 354fc15ac80d0e1a7d05a61557fd1d6c00a4a67ed851ba9a282f6aa8bd1e2fd2 Oct 31 00:55:13.283747 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:13.283715 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33816f29_a274_4bbb_83d7_72820504fee3.slice/crio-70788e0e0bd25b9fae1c4ceba2418dbc64b31d36078b88801801710caee38dcb WatchSource:0}: Error finding container 70788e0e0bd25b9fae1c4ceba2418dbc64b31d36078b88801801710caee38dcb: Status 404 returned error can't find the container with id 70788e0e0bd25b9fae1c4ceba2418dbc64b31d36078b88801801710caee38dcb Oct 31 00:55:13.292024 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:13.292002 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod330d9526_3090_4286_ab5c_db9eb532f4c5.slice/crio-cb977b918aa31c1e5112118bee861c456aba22a531e95244c330c60ff5a3f855 WatchSource:0}: Error finding container cb977b918aa31c1e5112118bee861c456aba22a531e95244c330c60ff5a3f855: Status 404 returned error can't find the container with id cb977b918aa31c1e5112118bee861c456aba22a531e95244c330c60ff5a3f855 Oct 31 00:55:13.301344 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.301323 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6mv8k" Oct 31 00:55:13.305158 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.305138 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:13.312098 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:13.312074 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b23111a_a892_4d92_990d_742a857450fa.slice/crio-8740c4c69ef0590c0f9ef9e183dabc84981a93856c967ed1085cf072b83bf963 WatchSource:0}: Error finding container 8740c4c69ef0590c0f9ef9e183dabc84981a93856c967ed1085cf072b83bf963: Status 404 returned error can't find the container with id 8740c4c69ef0590c0f9ef9e183dabc84981a93856c967ed1085cf072b83bf963 Oct 31 00:55:13.315618 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:13.315597 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c6a244e_e29d_492d_a16f_bf1c1ebc5ea5.slice/crio-d1c319e27efaccf939b4525ae53eb20e0206b9380af03c16e39630104f458272 WatchSource:0}: Error finding container d1c319e27efaccf939b4525ae53eb20e0206b9380af03c16e39630104f458272: Status 404 returned error can't find the container with id d1c319e27efaccf939b4525ae53eb20e0206b9380af03c16e39630104f458272 Oct 31 00:55:13.319357 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.319325 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gsdzf" Oct 31 00:55:13.323081 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.323063 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:55:13.326806 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.326776 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nl27p" Oct 31 00:55:13.330161 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:13.330139 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0086739_e8c7_4143_b297_87002d2f7dfb.slice/crio-cc7e25dc0e3412dcca46df370c2ba4c161be97bdcdc6fb57295a313482a3c911 WatchSource:0}: Error finding container cc7e25dc0e3412dcca46df370c2ba4c161be97bdcdc6fb57295a313482a3c911: Status 404 returned error can't find the container with id cc7e25dc0e3412dcca46df370c2ba4c161be97bdcdc6fb57295a313482a3c911 Oct 31 00:55:13.332574 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.332553 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-twq8q" Oct 31 00:55:13.333674 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:13.333556 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a9ea73_4db8_44ee_83ac_55504736d028.slice/crio-b570d68ad7275fbafce394d39b2da7af4d3d396f07bb155bc66e2895d3f25b47 WatchSource:0}: Error finding container b570d68ad7275fbafce394d39b2da7af4d3d396f07bb155bc66e2895d3f25b47: Status 404 returned error can't find the container with id b570d68ad7275fbafce394d39b2da7af4d3d396f07bb155bc66e2895d3f25b47 Oct 31 00:55:13.339773 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:13.339754 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7885b2e1_6437_402d_9335_f2b5bb2be17a.slice/crio-d06ebfd727a4b1a42b9bfc7d2e249d1cb64ad9ccbc71624dadd566ced112104d WatchSource:0}: Error finding container d06ebfd727a4b1a42b9bfc7d2e249d1cb64ad9ccbc71624dadd566ced112104d: Status 404 returned error can't find the container with id d06ebfd727a4b1a42b9bfc7d2e249d1cb64ad9ccbc71624dadd566ced112104d Oct 31 00:55:13.345687 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:13.345642 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6434cdd_b8a7_4fdb_ab00_53f19ce35b98.slice/crio-511046d629e07bb8d2c40a6f46cb60c3c0ba11a1e830e30568d299700028528e WatchSource:0}: Error finding container 511046d629e07bb8d2c40a6f46cb60c3c0ba11a1e830e30568d299700028528e: Status 404 returned error can't find the container with id 511046d629e07bb8d2c40a6f46cb60c3c0ba11a1e830e30568d299700028528e Oct 31 00:55:13.581880 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.581804 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktcbp\" (UniqueName: \"kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp\") pod \"network-check-target-r8q7t\" (UID: \"a1a12f14-a3aa-43b0-8ada-4568a87f7186\") " pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:13.581880 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.581857 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs\") pod \"network-metrics-daemon-4bzzq\" (UID: \"159fdfbd-fdcc-4655-b273-f0964617ed13\") " pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:13.582065 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:13.581897 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:13.582065 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:13.581973 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 00:55:13.582065 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:13.581993 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 00:55:13.582065 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:13.582010 2579 projected.go:196] Error preparing data for projected volume kube-api-access-ktcbp for pod openshift-network-diagnostics/network-check-target-r8q7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:55:13.582065 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:13.582010 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:55:13.582065 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:13.582010 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 00:55:13.582289 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:13.582069 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs podName:159fdfbd-fdcc-4655-b273-f0964617ed13 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:14.582053393 +0000 UTC m=+4.004017922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs") pod "network-metrics-daemon-4bzzq" (UID: "159fdfbd-fdcc-4655-b273-f0964617ed13") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:55:13.582289 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:13.582089 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp podName:a1a12f14-a3aa-43b0-8ada-4568a87f7186 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:14.582078844 +0000 UTC m=+4.004043356 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ktcbp" (UniqueName: "kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp") pod "network-check-target-r8q7t" (UID: "a1a12f14-a3aa-43b0-8ada-4568a87f7186") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:55:13.582289 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:13.582106 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret podName:6d207e59-c491-43cb-a331-5b89a78f470c nodeName:}" failed. No retries permitted until 2026-10-31 00:55:14.582096956 +0000 UTC m=+4.004061468 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret") pod "global-pull-secret-syncer-wtcjv" (UID: "6d207e59-c491-43cb-a331-5b89a78f470c") : object "kube-system"/"original-pull-secret" not registered Oct 31 00:55:14.011563 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:14.011404 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 00:50:13 +0000 UTC" deadline="2028-04-07 07:07:32.765439894 +0000 UTC" Oct 31 00:55:14.011563 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:14.011464 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12582h12m18.753979261s" Oct 31 00:55:14.029453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:14.028725 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:14.029453 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:14.028871 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8q7t" podUID="a1a12f14-a3aa-43b0-8ada-4568a87f7186" Oct 31 00:55:14.029453 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:14.029282 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:14.029453 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:14.029384 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtcjv" podUID="6d207e59-c491-43cb-a331-5b89a78f470c" Oct 31 00:55:14.039335 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:14.039270 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6mv8k" event={"ID":"9b23111a-a892-4d92-990d-742a857450fa","Type":"ContainerStarted","Data":"8740c4c69ef0590c0f9ef9e183dabc84981a93856c967ed1085cf072b83bf963"} Oct 31 00:55:14.041400 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:14.041373 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cbsws" event={"ID":"330d9526-3090-4286-ab5c-db9eb532f4c5","Type":"ContainerStarted","Data":"cb977b918aa31c1e5112118bee861c456aba22a531e95244c330c60ff5a3f855"} Oct 31 00:55:14.058374 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:14.058341 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fzjbb" event={"ID":"33816f29-a274-4bbb-83d7-72820504fee3","Type":"ContainerStarted","Data":"70788e0e0bd25b9fae1c4ceba2418dbc64b31d36078b88801801710caee38dcb"} Oct 31 00:55:14.070058 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:14.070029 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nl27p" event={"ID":"7885b2e1-6437-402d-9335-f2b5bb2be17a","Type":"ContainerStarted","Data":"d06ebfd727a4b1a42b9bfc7d2e249d1cb64ad9ccbc71624dadd566ced112104d"} Oct 31 00:55:14.075623 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:14.075536 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbrtn" event={"ID":"58a9ea73-4db8-44ee-83ac-55504736d028","Type":"ContainerStarted","Data":"b570d68ad7275fbafce394d39b2da7af4d3d396f07bb155bc66e2895d3f25b47"} Oct 31 00:55:14.080749 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:14.080721 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" event={"ID":"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5","Type":"ContainerStarted","Data":"d1c319e27efaccf939b4525ae53eb20e0206b9380af03c16e39630104f458272"} Oct 31 00:55:14.085365 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:14.085335 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" event={"ID":"3adb1944-49fd-4158-b195-4e80ebfd8f58","Type":"ContainerStarted","Data":"354fc15ac80d0e1a7d05a61557fd1d6c00a4a67ed851ba9a282f6aa8bd1e2fd2"} Oct 31 00:55:14.087704 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:14.087676 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-twq8q" event={"ID":"f6434cdd-b8a7-4fdb-ab00-53f19ce35b98","Type":"ContainerStarted","Data":"511046d629e07bb8d2c40a6f46cb60c3c0ba11a1e830e30568d299700028528e"} Oct 31 00:55:14.091102 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:14.091075 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gsdzf" event={"ID":"b0086739-e8c7-4143-b297-87002d2f7dfb","Type":"ContainerStarted","Data":"cc7e25dc0e3412dcca46df370c2ba4c161be97bdcdc6fb57295a313482a3c911"} Oct 31 00:55:14.590149 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:14.589168 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:14.590149 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:14.589230 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktcbp\" (UniqueName: \"kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp\") pod \"network-check-target-r8q7t\" (UID: \"a1a12f14-a3aa-43b0-8ada-4568a87f7186\") " pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:14.590149 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:14.589282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs\") pod \"network-metrics-daemon-4bzzq\" (UID: \"159fdfbd-fdcc-4655-b273-f0964617ed13\") " pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:14.590149 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:14.589411 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:55:14.590149 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:14.589473 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs podName:159fdfbd-fdcc-4655-b273-f0964617ed13 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:16.589455505 +0000 UTC m=+6.011420032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs") pod "network-metrics-daemon-4bzzq" (UID: "159fdfbd-fdcc-4655-b273-f0964617ed13") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:55:14.590149 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:14.589893 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 00:55:14.590149 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:14.589951 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret podName:6d207e59-c491-43cb-a331-5b89a78f470c nodeName:}" failed. No retries permitted until 2026-10-31 00:55:16.589935481 +0000 UTC m=+6.011900008 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret") pod "global-pull-secret-syncer-wtcjv" (UID: "6d207e59-c491-43cb-a331-5b89a78f470c") : object "kube-system"/"original-pull-secret" not registered Oct 31 00:55:14.590149 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:14.590038 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 00:55:14.590149 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:14.590053 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 00:55:14.590149 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:14.590066 2579 projected.go:196] Error preparing data for projected volume kube-api-access-ktcbp for pod openshift-network-diagnostics/network-check-target-r8q7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:55:14.590149 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:14.590103 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp podName:a1a12f14-a3aa-43b0-8ada-4568a87f7186 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:16.590091019 +0000 UTC m=+6.012055545 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ktcbp" (UniqueName: "kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp") pod "network-check-target-r8q7t" (UID: "a1a12f14-a3aa-43b0-8ada-4568a87f7186") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:55:15.012368 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:15.012266 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 00:50:13 +0000 UTC" deadline="2028-05-28 17:45:52.321554678 +0000 UTC" Oct 31 00:55:15.012368 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:15.012317 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13816h50m37.309240567s" Oct 31 00:55:15.032275 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:15.032242 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:15.032423 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:15.032397 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bzzq" podUID="159fdfbd-fdcc-4655-b273-f0964617ed13" Oct 31 00:55:16.029311 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:16.029067 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:16.029769 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:16.029490 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8q7t" podUID="a1a12f14-a3aa-43b0-8ada-4568a87f7186" Oct 31 00:55:16.029910 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:16.029864 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:16.029999 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:16.029977 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtcjv" podUID="6d207e59-c491-43cb-a331-5b89a78f470c" Oct 31 00:55:16.105011 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:16.104045 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal" event={"ID":"0222b47fe84780a8d4956385717c70a6","Type":"ContainerStarted","Data":"7182ee49e1cca425bc7e912464f04030ff83f980b15a8c76a649c70c95739d2b"} Oct 31 00:55:16.108015 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:16.107983 2579 generic.go:356] "Generic (PLEG): container finished" podID="d8e91b3b436f98c50afdd4fa50ff7ebd" containerID="517820daec75189a43a495d15d663b6a3af0e119baeca473ef63a16f33da02cb" exitCode=0 Oct 31 00:55:16.108160 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:16.108034 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" event={"ID":"d8e91b3b436f98c50afdd4fa50ff7ebd","Type":"ContainerDied","Data":"517820daec75189a43a495d15d663b6a3af0e119baeca473ef63a16f33da02cb"} Oct 31 00:55:16.144206 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:16.144152 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal" podStartSLOduration=3.144133232 podStartE2EDuration="3.144133232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:55:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:55:16.126354326 +0000 UTC m=+5.548318882" watchObservedRunningTime="2026-10-31 00:55:16.144133232 +0000 UTC m=+5.566097768" Oct 31 00:55:16.604715 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:16.604672 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs\") pod \"network-metrics-daemon-4bzzq\" (UID: \"159fdfbd-fdcc-4655-b273-f0964617ed13\") " pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:16.604915 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:16.604741 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:16.604915 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:16.604783 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktcbp\" (UniqueName: \"kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp\") pod \"network-check-target-r8q7t\" (UID: \"a1a12f14-a3aa-43b0-8ada-4568a87f7186\") " pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:16.605034 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:16.604930 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 00:55:16.605034 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:16.604954 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 00:55:16.605034 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:16.604968 2579 projected.go:196] Error preparing data for projected volume kube-api-access-ktcbp for pod openshift-network-diagnostics/network-check-target-r8q7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:55:16.605034 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:16.605025 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp podName:a1a12f14-a3aa-43b0-8ada-4568a87f7186 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:20.605007348 +0000 UTC m=+10.026971878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ktcbp" (UniqueName: "kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp") pod "network-check-target-r8q7t" (UID: "a1a12f14-a3aa-43b0-8ada-4568a87f7186") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:55:16.605462 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:16.605441 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:55:16.605536 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:16.605505 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs podName:159fdfbd-fdcc-4655-b273-f0964617ed13 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:20.605487501 +0000 UTC m=+10.027452027 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs") pod "network-metrics-daemon-4bzzq" (UID: "159fdfbd-fdcc-4655-b273-f0964617ed13") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:55:16.605603 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:16.605572 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 00:55:16.605684 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:16.605606 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret podName:6d207e59-c491-43cb-a331-5b89a78f470c nodeName:}" failed. No retries permitted until 2026-10-31 00:55:20.605595627 +0000 UTC m=+10.027560159 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret") pod "global-pull-secret-syncer-wtcjv" (UID: "6d207e59-c491-43cb-a331-5b89a78f470c") : object "kube-system"/"original-pull-secret" not registered Oct 31 00:55:17.031263 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:17.031230 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:17.031814 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:17.031390 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bzzq" podUID="159fdfbd-fdcc-4655-b273-f0964617ed13" Oct 31 00:55:17.115406 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:17.115363 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" event={"ID":"d8e91b3b436f98c50afdd4fa50ff7ebd","Type":"ContainerStarted","Data":"e6d159dd51822082c3ba944956da8e9b34dce5378ffccf43f62fdf8dfa44b7b0"} Oct 31 00:55:17.118982 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:17.118941 2579 generic.go:356] "Generic (PLEG): container finished" podID="58a9ea73-4db8-44ee-83ac-55504736d028" containerID="8d6a00b144a0b346f4859f3dcd6ec6fb8ce601dde3f352fb7315056731e85728" exitCode=0 Oct 31 00:55:17.119874 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:17.119850 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbrtn" event={"ID":"58a9ea73-4db8-44ee-83ac-55504736d028","Type":"ContainerDied","Data":"8d6a00b144a0b346f4859f3dcd6ec6fb8ce601dde3f352fb7315056731e85728"} Oct 31 00:55:17.134103 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:17.133951 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" podStartSLOduration=4.133936757 podStartE2EDuration="4.133936757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:55:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:55:17.133155112 +0000 UTC m=+6.555119649" watchObservedRunningTime="2026-10-31 00:55:17.133936757 +0000 UTC m=+6.555901292" Oct 31 00:55:18.028731 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:18.028659 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:18.028890 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:18.028752 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8q7t" podUID="a1a12f14-a3aa-43b0-8ada-4568a87f7186" Oct 31 00:55:18.029083 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:18.029039 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:18.029159 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:18.029102 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtcjv" podUID="6d207e59-c491-43cb-a331-5b89a78f470c" Oct 31 00:55:18.125261 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:18.125172 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fzjbb" event={"ID":"33816f29-a274-4bbb-83d7-72820504fee3","Type":"ContainerStarted","Data":"546917cd709093afa47c64b89f9b90c3298cfce1c4ef9a8e83182a0d267c5403"} Oct 31 00:55:18.928724 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:18.928691 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fzjbb" Oct 31 00:55:18.933448 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:18.933424 2579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fzjbb" Oct 31 00:55:18.935426 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:18.935403 2579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fzjbb" Oct 31 00:55:18.953550 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:18.953498 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fzjbb" podStartSLOduration=2.586165339 podStartE2EDuration="6.953407328s" totalImagesPullingTime="4.367241989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:55:18.143222664 +0000 UTC m=+7.565187226" watchObservedRunningTime="2026-10-31 00:55:18.953407328 +0000 UTC m=+8.375371867" Oct 31 00:55:19.031122 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:19.031088 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:19.031270 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:19.031245 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bzzq" podUID="159fdfbd-fdcc-4655-b273-f0964617ed13" Oct 31 00:55:19.129651 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:19.129600 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" event={"ID":"3adb1944-49fd-4158-b195-4e80ebfd8f58","Type":"ContainerStarted","Data":"f747248d10b0f3a68e168decdf7d42e4b79059764b0f58751d8f6df2c9ffd151"} Oct 31 00:55:19.133993 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:19.133928 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6mv8k" event={"ID":"9b23111a-a892-4d92-990d-742a857450fa","Type":"ContainerStarted","Data":"a3f8ac2cff331be396541d3cf1ece1d0a6d57e4c097b474b30209e9196e8516e"} Oct 31 00:55:19.134797 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:19.134760 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fzjbb" Oct 31 00:55:19.154400 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:19.154312 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6mv8k" podStartSLOduration=1.870527777 podStartE2EDuration="7.154294815s" totalImagesPullingTime="5.283767038s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:55:19.153751353 +0000 UTC m=+8.575715893" watchObservedRunningTime="2026-10-31 00:55:19.154294815 +0000 UTC m=+8.576259352" Oct 31 00:55:20.029304 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:20.029259 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:20.029470 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:20.029397 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8q7t" podUID="a1a12f14-a3aa-43b0-8ada-4568a87f7186" Oct 31 00:55:20.029963 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:20.029935 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:20.030098 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:20.030070 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtcjv" podUID="6d207e59-c491-43cb-a331-5b89a78f470c" Oct 31 00:55:20.640710 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:20.640662 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:20.641147 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:20.640798 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktcbp\" (UniqueName: \"kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp\") pod \"network-check-target-r8q7t\" (UID: \"a1a12f14-a3aa-43b0-8ada-4568a87f7186\") " pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:20.641147 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:20.640870 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs\") pod \"network-metrics-daemon-4bzzq\" (UID: \"159fdfbd-fdcc-4655-b273-f0964617ed13\") " pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:20.641147 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:20.641020 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:55:20.641147 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:20.641133 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs podName:159fdfbd-fdcc-4655-b273-f0964617ed13 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:28.641094627 +0000 UTC m=+18.063059139 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs") pod "network-metrics-daemon-4bzzq" (UID: "159fdfbd-fdcc-4655-b273-f0964617ed13") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:55:20.641520 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:20.641462 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 00:55:20.641615 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:20.641533 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret podName:6d207e59-c491-43cb-a331-5b89a78f470c nodeName:}" failed. No retries permitted until 2026-10-31 00:55:28.641515683 +0000 UTC m=+18.063480198 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret") pod "global-pull-secret-syncer-wtcjv" (UID: "6d207e59-c491-43cb-a331-5b89a78f470c") : object "kube-system"/"original-pull-secret" not registered Oct 31 00:55:20.641615 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:20.641613 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 00:55:20.641746 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:20.641626 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 00:55:20.641746 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:20.641659 2579 projected.go:196] Error preparing data for projected volume kube-api-access-ktcbp for pod openshift-network-diagnostics/network-check-target-r8q7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:55:20.641746 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:20.641700 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp podName:a1a12f14-a3aa-43b0-8ada-4568a87f7186 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:28.641687068 +0000 UTC m=+18.063651581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ktcbp" (UniqueName: "kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp") pod "network-check-target-r8q7t" (UID: "a1a12f14-a3aa-43b0-8ada-4568a87f7186") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:55:20.877219 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:20.877172 2579 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 31 00:55:21.016286 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:21.014455 2579 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T00:55:20.877196568Z","UUID":"3c8ea4a0-bf74-43ad-8575-4f2f6ba9bab7","Handler":null,"Name":"","Endpoint":""} Oct 31 00:55:21.030688 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:21.029901 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 31 00:55:21.030688 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:21.029948 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 31 00:55:21.038182 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:21.038151 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:21.039223 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:21.038363 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bzzq" podUID="159fdfbd-fdcc-4655-b273-f0964617ed13" Oct 31 00:55:21.143693 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:21.143617 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" event={"ID":"3adb1944-49fd-4158-b195-4e80ebfd8f58","Type":"ContainerStarted","Data":"66497b2460b9279680ed33a81625b64dcbe30d0b03c43426cf1de67cf75b3eab"} Oct 31 00:55:22.029164 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:22.029137 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:22.029554 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:22.029230 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8q7t" podUID="a1a12f14-a3aa-43b0-8ada-4568a87f7186" Oct 31 00:55:22.029554 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:22.029534 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:22.029658 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:22.029620 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtcjv" podUID="6d207e59-c491-43cb-a331-5b89a78f470c" Oct 31 00:55:22.147282 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:22.147072 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nl27p" event={"ID":"7885b2e1-6437-402d-9335-f2b5bb2be17a","Type":"ContainerStarted","Data":"4366863e90cb9bf355ff6ba66ff740d18fca7f6264128f94b9088ed96010e863"} Oct 31 00:55:22.149920 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:22.149850 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbrtn" event={"ID":"58a9ea73-4db8-44ee-83ac-55504736d028","Type":"ContainerStarted","Data":"63fd89da8b674d4ea3ed037d0c1cf4bd0eb3ac014a1c2cd3bdf5c60cd6f88ab7"} Oct 31 00:55:22.151991 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:22.151967 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-twq8q" event={"ID":"f6434cdd-b8a7-4fdb-ab00-53f19ce35b98","Type":"ContainerStarted","Data":"3bb1aba61d26b636731747ac9316fbb2365ca9690521fbc855de8a4b71c92f8a"} Oct 31 00:55:22.168331 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:22.168284 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-nl27p" podStartSLOduration=2.351697561 podStartE2EDuration="10.168271295s" totalImagesPullingTime="7.816573734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:55:22.167825042 +0000 UTC m=+11.589789578" watchObservedRunningTime="2026-10-31 00:55:22.168271295 +0000 UTC m=+11.590235829" Oct 31 00:55:23.030785 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:23.030701 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:23.031231 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:23.030855 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bzzq" podUID="159fdfbd-fdcc-4655-b273-f0964617ed13" Oct 31 00:55:23.156440 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:23.156412 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gsdzf" event={"ID":"b0086739-e8c7-4143-b297-87002d2f7dfb","Type":"ContainerStarted","Data":"3f8b7e87e963c45f71a847ea3dd455e4907967428cd358e6469a7b50260117b3"} Oct 31 00:55:23.158494 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:23.158468 2579 generic.go:356] "Generic (PLEG): container finished" podID="58a9ea73-4db8-44ee-83ac-55504736d028" containerID="63fd89da8b674d4ea3ed037d0c1cf4bd0eb3ac014a1c2cd3bdf5c60cd6f88ab7" exitCode=0 Oct 31 00:55:23.158631 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:23.158540 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbrtn" event={"ID":"58a9ea73-4db8-44ee-83ac-55504736d028","Type":"ContainerDied","Data":"63fd89da8b674d4ea3ed037d0c1cf4bd0eb3ac014a1c2cd3bdf5c60cd6f88ab7"} Oct 31 00:55:23.161015 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:23.160987 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" event={"ID":"3adb1944-49fd-4158-b195-4e80ebfd8f58","Type":"ContainerStarted","Data":"f243c89bce2139df5274af28dcd5c3d8efa7020b7385f77cfcac6641673e2327"} Oct 31 00:55:23.171949 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:23.171891 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gsdzf" podStartSLOduration=3.346078251 podStartE2EDuration="11.1718769s" totalImagesPullingTime="7.825798649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:55:23.171321273 +0000 UTC m=+12.593285806" watchObservedRunningTime="2026-10-31 00:55:23.1718769 +0000 UTC m=+12.593841435" Oct 31 00:55:23.172133 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:23.172108 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-twq8q" podStartSLOduration=3.044783767 podStartE2EDuration="11.172101383s" totalImagesPullingTime="8.127317616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:55:22.221168068 +0000 UTC m=+11.643132607" watchObservedRunningTime="2026-10-31 00:55:23.172101383 +0000 UTC m=+12.594065919" Oct 31 00:55:23.210635 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:23.210590 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" podStartSLOduration=3.789935634 podStartE2EDuration="12.210577716s" totalImagesPullingTime="8.420642082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:55:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:55:23.189674855 +0000 UTC m=+12.611639389" watchObservedRunningTime="2026-10-31 00:55:23.210577716 +0000 UTC m=+12.632542276" Oct 31 00:55:24.028699 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:24.028677 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:24.028796 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:24.028770 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtcjv" podUID="6d207e59-c491-43cb-a331-5b89a78f470c" Oct 31 00:55:24.028863 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:24.028852 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:24.028919 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:24.028905 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8q7t" podUID="a1a12f14-a3aa-43b0-8ada-4568a87f7186" Oct 31 00:55:24.164887 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:24.164860 2579 generic.go:356] "Generic (PLEG): container finished" podID="58a9ea73-4db8-44ee-83ac-55504736d028" containerID="f1b57e461d8ba2a6cc04df6479684ebbff35820efe43a0ad4f10ee78f8b6ef22" exitCode=0 Oct 31 00:55:24.165441 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:24.164941 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbrtn" event={"ID":"58a9ea73-4db8-44ee-83ac-55504736d028","Type":"ContainerDied","Data":"f1b57e461d8ba2a6cc04df6479684ebbff35820efe43a0ad4f10ee78f8b6ef22"} Oct 31 00:55:24.166632 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:24.166597 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cbsws" event={"ID":"330d9526-3090-4286-ab5c-db9eb532f4c5","Type":"ContainerStarted","Data":"0131433cd5a92d77d12be752ea026d00c50ab29d4e30826f87d9c203a9dd79c8"} Oct 31 00:55:24.205802 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:24.205738 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cbsws" podStartSLOduration=1.8913902519999999 podStartE2EDuration="12.205725809s" totalImagesPullingTime="10.314335557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:55:24.20562268 +0000 UTC m=+13.627587209" watchObservedRunningTime="2026-10-31 00:55:24.205725809 +0000 UTC m=+13.627690341" Oct 31 00:55:25.028684 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:25.028644 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:25.028807 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:25.028770 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bzzq" podUID="159fdfbd-fdcc-4655-b273-f0964617ed13" Oct 31 00:55:25.171688 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:25.171087 2579 generic.go:356] "Generic (PLEG): container finished" podID="58a9ea73-4db8-44ee-83ac-55504736d028" containerID="75f198f5c49509add9b6e3aacd6ec61b09dce49fcbc3018821ed92975b9eeda8" exitCode=0 Oct 31 00:55:25.171688 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:25.171136 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbrtn" event={"ID":"58a9ea73-4db8-44ee-83ac-55504736d028","Type":"ContainerDied","Data":"75f198f5c49509add9b6e3aacd6ec61b09dce49fcbc3018821ed92975b9eeda8"} Oct 31 00:55:26.028572 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:26.028356 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:26.028715 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:26.028546 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:26.028715 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:26.028676 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtcjv" podUID="6d207e59-c491-43cb-a331-5b89a78f470c" Oct 31 00:55:26.028777 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:26.028724 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8q7t" podUID="a1a12f14-a3aa-43b0-8ada-4568a87f7186" Oct 31 00:55:27.029264 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:27.029233 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:27.029687 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:27.029368 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bzzq" podUID="159fdfbd-fdcc-4655-b273-f0964617ed13" Oct 31 00:55:27.178354 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:27.178322 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbrtn" event={"ID":"58a9ea73-4db8-44ee-83ac-55504736d028","Type":"ContainerStarted","Data":"5cf2038ea5fe42865c10f9d5103a271d4d2160855491d1023fafe537417aa4c6"} Oct 31 00:55:28.028735 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:28.028703 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:28.029018 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:28.028702 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:28.029018 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:28.028835 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtcjv" podUID="6d207e59-c491-43cb-a331-5b89a78f470c" Oct 31 00:55:28.029018 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:28.028902 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8q7t" podUID="a1a12f14-a3aa-43b0-8ada-4568a87f7186" Oct 31 00:55:28.184312 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:28.184254 2579 generic.go:356] "Generic (PLEG): container finished" podID="58a9ea73-4db8-44ee-83ac-55504736d028" containerID="5cf2038ea5fe42865c10f9d5103a271d4d2160855491d1023fafe537417aa4c6" exitCode=0 Oct 31 00:55:28.184769 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:28.184339 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbrtn" event={"ID":"58a9ea73-4db8-44ee-83ac-55504736d028","Type":"ContainerDied","Data":"5cf2038ea5fe42865c10f9d5103a271d4d2160855491d1023fafe537417aa4c6"} Oct 31 00:55:28.702201 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:28.702162 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs\") pod \"network-metrics-daemon-4bzzq\" (UID: \"159fdfbd-fdcc-4655-b273-f0964617ed13\") " pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:28.702201 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:28.702210 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:28.702442 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:28.702241 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktcbp\" (UniqueName: \"kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp\") pod \"network-check-target-r8q7t\" (UID: \"a1a12f14-a3aa-43b0-8ada-4568a87f7186\") " pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:28.702442 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:28.702321 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:55:28.702442 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:28.702364 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 31 00:55:28.702442 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:28.702373 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 00:55:28.702442 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:28.702400 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs podName:159fdfbd-fdcc-4655-b273-f0964617ed13 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:44.702382327 +0000 UTC m=+34.124346839 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs") pod "network-metrics-daemon-4bzzq" (UID: "159fdfbd-fdcc-4655-b273-f0964617ed13") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:55:28.702442 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:28.702422 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret podName:6d207e59-c491-43cb-a331-5b89a78f470c nodeName:}" failed. No retries permitted until 2026-10-31 00:55:44.702410471 +0000 UTC m=+34.124375013 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret") pod "global-pull-secret-syncer-wtcjv" (UID: "6d207e59-c491-43cb-a331-5b89a78f470c") : object "kube-system"/"original-pull-secret" not registered Oct 31 00:55:28.702442 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:28.702380 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 31 00:55:28.702442 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:28.702440 2579 projected.go:196] Error preparing data for projected volume kube-api-access-ktcbp for pod openshift-network-diagnostics/network-check-target-r8q7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:55:28.702867 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:28.702473 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp podName:a1a12f14-a3aa-43b0-8ada-4568a87f7186 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:44.702463632 +0000 UTC m=+34.124428157 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ktcbp" (UniqueName: "kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp") pod "network-check-target-r8q7t" (UID: "a1a12f14-a3aa-43b0-8ada-4568a87f7186") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 31 00:55:29.028427 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:29.028359 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:29.028593 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:29.028501 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bzzq" podUID="159fdfbd-fdcc-4655-b273-f0964617ed13" Oct 31 00:55:29.190136 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:29.190103 2579 generic.go:356] "Generic (PLEG): container finished" podID="58a9ea73-4db8-44ee-83ac-55504736d028" containerID="f11ece74ec58928153e860f27a359ac81fb04177942e78fffd155e9484719d4e" exitCode=0 Oct 31 00:55:29.190525 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:29.190154 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbrtn" event={"ID":"58a9ea73-4db8-44ee-83ac-55504736d028","Type":"ContainerDied","Data":"f11ece74ec58928153e860f27a359ac81fb04177942e78fffd155e9484719d4e"} Oct 31 00:55:30.028725 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:30.028686 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:30.028725 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:30.028728 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:30.028963 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:30.028821 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtcjv" podUID="6d207e59-c491-43cb-a331-5b89a78f470c" Oct 31 00:55:30.029014 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:30.028969 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8q7t" podUID="a1a12f14-a3aa-43b0-8ada-4568a87f7186" Oct 31 00:55:30.196026 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:30.195994 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbrtn" event={"ID":"58a9ea73-4db8-44ee-83ac-55504736d028","Type":"ContainerStarted","Data":"970dd099a74a41be7a2eb7ef2e5106c57a92f84d907304918d55475a453b6439"} Oct 31 00:55:30.218640 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:30.218595 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qbrtn" podStartSLOduration=7.162740389 podStartE2EDuration="18.218582856s" totalImagesPullingTime="11.055842467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:55:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:55:30.216747185 +0000 UTC m=+19.638711719" watchObservedRunningTime="2026-10-31 00:55:30.218582856 +0000 UTC m=+19.640547392" Oct 31 00:55:31.029352 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:31.029323 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:31.029490 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:31.029447 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bzzq" podUID="159fdfbd-fdcc-4655-b273-f0964617ed13" Oct 31 00:55:31.199613 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:31.199584 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" event={"ID":"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5","Type":"ContainerStarted","Data":"44e92c225598265fdfdb36139b6548f7dda7179343fb8ba808c7d7af9596889e"} Oct 31 00:55:32.029073 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:32.028892 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:32.029216 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:32.028928 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:32.029216 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:32.029134 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtcjv" podUID="6d207e59-c491-43cb-a331-5b89a78f470c" Oct 31 00:55:32.029216 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:32.029205 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8q7t" podUID="a1a12f14-a3aa-43b0-8ada-4568a87f7186" Oct 31 00:55:32.204851 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:32.204818 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" event={"ID":"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5","Type":"ContainerStarted","Data":"fd6a8b37abe0edc062bf292ec6e1a4bd644b2140d5684c289cd0a752f1a9c1dd"} Oct 31 00:55:32.205307 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:32.204891 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" event={"ID":"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5","Type":"ContainerStarted","Data":"c828c12d3e2b53a3907a1287eedd16c36c344b62cea9d12b1899c10b16f37ed3"} Oct 31 00:55:32.205307 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:32.204941 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" event={"ID":"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5","Type":"ContainerStarted","Data":"0b0bec32d649158d07b08fe8e92d6a6ff77feb30299f37f617014af0a5b6c091"} Oct 31 00:55:32.205307 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:32.204992 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" event={"ID":"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5","Type":"ContainerStarted","Data":"ce93cf455d92b05316e0d8d7a923ab75526d603b4e3e90a68017534f6a75d82b"} Oct 31 00:55:32.205307 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:32.205034 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" event={"ID":"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5","Type":"ContainerStarted","Data":"3bf48653578a4d78dd048703c686c6923d0f83dc2dbe3a2e09f4938ba5067315"} Oct 31 00:55:33.028932 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:33.028902 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:33.029113 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:33.029024 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bzzq" podUID="159fdfbd-fdcc-4655-b273-f0964617ed13" Oct 31 00:55:34.029161 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:34.029139 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:34.029493 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:34.029138 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:34.029493 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:34.029228 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtcjv" podUID="6d207e59-c491-43cb-a331-5b89a78f470c" Oct 31 00:55:34.029493 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:34.029309 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8q7t" podUID="a1a12f14-a3aa-43b0-8ada-4568a87f7186" Oct 31 00:55:34.211224 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:34.211199 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" event={"ID":"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5","Type":"ContainerStarted","Data":"2ed183b0c75b90e1e9312f3dfe03984c6888c2275cf614bcce63e1b44c46b227"} Oct 31 00:55:35.028969 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:35.028942 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:35.029177 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:35.029038 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bzzq" podUID="159fdfbd-fdcc-4655-b273-f0964617ed13" Oct 31 00:55:36.028371 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:36.028337 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:36.028522 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:36.028337 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:36.028522 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:36.028443 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtcjv" podUID="6d207e59-c491-43cb-a331-5b89a78f470c" Oct 31 00:55:36.028522 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:36.028502 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8q7t" podUID="a1a12f14-a3aa-43b0-8ada-4568a87f7186" Oct 31 00:55:36.221068 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:36.221037 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" event={"ID":"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5","Type":"ContainerStarted","Data":"375e6b5bfa2714c3d2234d629685ce10dfa472a47c28801b334193369273a9dc"} Oct 31 00:55:36.221902 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:36.221285 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:36.235967 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:36.235943 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:36.249282 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:36.249249 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" podStartSLOduration=6.466786182 podStartE2EDuration="24.249238701s" totalImagesPullingTime="17.782452519s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:55:36.248299389 +0000 UTC m=+25.670263921" watchObservedRunningTime="2026-10-31 00:55:36.249238701 +0000 UTC m=+25.671203232" Oct 31 00:55:37.028195 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:37.028168 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:37.028340 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:37.028273 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bzzq" podUID="159fdfbd-fdcc-4655-b273-f0964617ed13" Oct 31 00:55:37.224425 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:37.224393 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:37.224878 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:37.224614 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wtcjv"] Oct 31 00:55:37.224878 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:37.224671 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:37.224878 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:37.224761 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:37.225037 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:37.224889 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtcjv" podUID="6d207e59-c491-43cb-a331-5b89a78f470c" Oct 31 00:55:37.227979 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:37.227940 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r8q7t"] Oct 31 00:55:37.228103 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:37.228043 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:37.228157 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:37.228129 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8q7t" podUID="a1a12f14-a3aa-43b0-8ada-4568a87f7186" Oct 31 00:55:37.228764 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:37.228742 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4bzzq"] Oct 31 00:55:37.228885 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:37.228821 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:37.228946 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:37.228909 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bzzq" podUID="159fdfbd-fdcc-4655-b273-f0964617ed13" Oct 31 00:55:37.240469 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:37.240451 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:55:39.028393 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:39.028356 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:39.028866 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:39.028356 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:39.028866 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:39.028473 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bzzq" podUID="159fdfbd-fdcc-4655-b273-f0964617ed13" Oct 31 00:55:39.028866 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:39.028359 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:39.028866 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:39.028532 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtcjv" podUID="6d207e59-c491-43cb-a331-5b89a78f470c" Oct 31 00:55:39.028866 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:39.028636 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8q7t" podUID="a1a12f14-a3aa-43b0-8ada-4568a87f7186" Oct 31 00:55:41.029371 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:41.029198 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:41.029764 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:41.029432 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bzzq" podUID="159fdfbd-fdcc-4655-b273-f0964617ed13" Oct 31 00:55:41.029764 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:41.029279 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:41.029764 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:41.029487 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8q7t" podUID="a1a12f14-a3aa-43b0-8ada-4568a87f7186" Oct 31 00:55:41.029764 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:41.029262 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:41.029764 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:41.029541 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtcjv" podUID="6d207e59-c491-43cb-a331-5b89a78f470c" Oct 31 00:55:43.028408 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:43.028377 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:43.028909 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:43.028439 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:43.028909 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:43.028452 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:43.028909 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:43.028537 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtcjv" podUID="6d207e59-c491-43cb-a331-5b89a78f470c" Oct 31 00:55:43.028909 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:43.028606 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bzzq" podUID="159fdfbd-fdcc-4655-b273-f0964617ed13" Oct 31 00:55:43.028909 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:43.028702 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8q7t" podUID="a1a12f14-a3aa-43b0-8ada-4568a87f7186" Oct 31 00:55:43.921736 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:43.921712 2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeReady" Oct 31 00:55:43.921848 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:43.921799 2579 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Oct 31 00:55:43.957865 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:43.957844 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-s8pvr"] Oct 31 00:55:43.980911 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:43.980887 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-md87z"] Oct 31 00:55:43.981181 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:43.980995 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-s8pvr" Oct 31 00:55:43.988454 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:43.988435 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Oct 31 00:55:43.994856 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:43.994822 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-l8fz4"] Oct 31 00:55:43.998323 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:43.997466 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-md87z" Oct 31 00:55:43.998323 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:43.997622 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Oct 31 00:55:44.011117 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.011093 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-786bfcf6b7-n7gm9"] Oct 31 00:55:44.011277 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.011218 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-l8fz4" Oct 31 00:55:44.023522 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.023503 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-7sfl6"] Oct 31 00:55:44.023622 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.023608 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.027391 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.027376 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Oct 31 00:55:44.027533 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.027459 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Oct 31 00:55:44.027689 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.027676 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xgrpm\"" Oct 31 00:55:44.027826 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.027811 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Oct 31 00:55:44.043627 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.043609 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-788b97d875-vrvqf"] Oct 31 00:55:44.043971 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.043713 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:55:44.077109 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.077090 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl"] Oct 31 00:55:44.077218 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.077204 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:44.087711 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.087691 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 31 00:55:44.087711 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.087707 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Oct 31 00:55:44.087711 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.087692 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 31 00:55:44.087895 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.087881 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Oct 31 00:55:44.087936 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.087887 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Oct 31 00:55:44.087936 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.087888 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Oct 31 00:55:44.091285 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.091270 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-qtvqf"] Oct 31 00:55:44.091384 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.091370 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:55:44.098828 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.098810 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Oct 31 00:55:44.098960 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.098946 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Oct 31 00:55:44.105521 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.105504 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp"] Oct 31 00:55:44.105630 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.105616 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:55:44.118146 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.118125 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fccb0eb9-af8a-494e-b629-37a428d87ea5-image-registry-private-configuration\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.118295 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.118274 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcpm8\" (UniqueName: \"kubernetes.io/projected/e4573d06-669b-4764-9609-9bdc204c419a-kube-api-access-mcpm8\") pod \"kas-connection-checker-685895c7c9-md87z\" (UID: \"e4573d06-669b-4764-9609-9bdc204c419a\") " pod="kube-system/kas-connection-checker-685895c7c9-md87z" Oct 31 00:55:44.118365 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.118337 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-certificates\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.118458 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.118436 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-bound-sa-token\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.118494 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.118474 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8f7j\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-kube-api-access-m8f7j\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.118544 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.118500 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n55jw\" (UniqueName: \"kubernetes.io/projected/314bbfb5-1511-4a13-9a52-9bee729f1b2e-kube-api-access-n55jw\") pod \"kas-connection-checker-685895c7c9-l8fz4\" (UID: \"314bbfb5-1511-4a13-9a52-9bee729f1b2e\") " pod="kube-system/kas-connection-checker-685895c7c9-l8fz4" Oct 31 00:55:44.118605 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.118587 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fccb0eb9-af8a-494e-b629-37a428d87ea5-trusted-ca\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.118640 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.118609 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6dda3bac-470c-46f8-b510-8a73f6dc76c6-tmp\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:55:44.118640 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.118625 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6dda3bac-470c-46f8-b510-8a73f6dc76c6-serving-cert\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:55:44.118713 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.118696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fccb0eb9-af8a-494e-b629-37a428d87ea5-installation-pull-secrets\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.118765 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.118722 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.118765 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.118724 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wffrk"] Oct 31 00:55:44.118864 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.118801 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:55:44.118864 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.118809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dda3bac-470c-46f8-b510-8a73f6dc76c6-service-ca-bundle\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:55:44.118864 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.118845 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dda3bac-470c-46f8-b510-8a73f6dc76c6-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:55:44.119004 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.118873 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6dda3bac-470c-46f8-b510-8a73f6dc76c6-snapshots\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:55:44.119004 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.118898 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tccp5\" (UniqueName: \"kubernetes.io/projected/6dda3bac-470c-46f8-b510-8a73f6dc76c6-kube-api-access-tccp5\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:55:44.119004 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.118941 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fccb0eb9-af8a-494e-b629-37a428d87ea5-ca-trust-extracted\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.119004 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.118965 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lzml\" (UniqueName: \"kubernetes.io/projected/d050f2b3-1f51-4f94-8d13-075aa3288bd1-kube-api-access-5lzml\") pod \"kas-connection-checker-685895c7c9-s8pvr\" (UID: \"d050f2b3-1f51-4f94-8d13-075aa3288bd1\") " pod="kube-system/kas-connection-checker-685895c7c9-s8pvr" Oct 31 00:55:44.127871 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.127853 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Oct 31 00:55:44.128227 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.128209 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Oct 31 00:55:44.128295 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.128215 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Oct 31 00:55:44.128295 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.128261 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Oct 31 00:55:44.128295 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.128272 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Oct 31 00:55:44.128295 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.128285 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-z766m\"" Oct 31 00:55:44.128295 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.128293 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Oct 31 00:55:44.128474 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.128299 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Oct 31 00:55:44.128474 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.128309 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dxd8s\"" Oct 31 00:55:44.128474 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.128336 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4k65v\"" Oct 31 00:55:44.128474 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.128385 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-b7f5d\"" Oct 31 00:55:44.128474 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.128432 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-x6mdk\"" Oct 31 00:55:44.132732 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.132718 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb"] Oct 31 00:55:44.132827 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.132814 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wffrk" Oct 31 00:55:44.156622 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.156606 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l"] Oct 31 00:55:44.156720 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.156708 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" Oct 31 00:55:44.170609 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.170594 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-fb9mh"] Oct 31 00:55:44.170708 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.170695 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" Oct 31 00:55:44.188291 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.188269 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 31 00:55:44.188614 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.188598 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Oct 31 00:55:44.188673 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.188645 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:55:44.188673 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.188654 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Oct 31 00:55:44.188673 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.188664 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Oct 31 00:55:44.188927 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.188912 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:55:44.189018 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.188963 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Oct 31 00:55:44.189056 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.189046 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Oct 31 00:55:44.189098 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.189057 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:55:44.189152 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.189135 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Oct 31 00:55:44.189185 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.189151 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 31 00:55:44.189185 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.189137 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:55:44.189185 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.189176 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Oct 31 00:55:44.189280 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.189213 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Oct 31 00:55:44.189280 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.189244 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:55:44.189280 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.189272 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Oct 31 00:55:44.194077 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.194061 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Oct 31 00:55:44.194810 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.194795 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68f7b65f66-27ggn"] Oct 31 00:55:44.194914 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.194901 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-fb9mh" Oct 31 00:55:44.196218 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.196204 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Oct 31 00:55:44.208651 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.208631 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-jwv8k"] Oct 31 00:55:44.209302 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.209272 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.219524 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.219506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcpm8\" (UniqueName: \"kubernetes.io/projected/e4573d06-669b-4764-9609-9bdc204c419a-kube-api-access-mcpm8\") pod \"kas-connection-checker-685895c7c9-md87z\" (UID: \"e4573d06-669b-4764-9609-9bdc204c419a\") " pod="kube-system/kas-connection-checker-685895c7c9-md87z" Oct 31 00:55:44.219621 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.219531 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-stats-auth\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:44.219621 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.219564 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rsxrp\" (UID: \"9fb838b9-ac5c-4029-9f11-98b610e5b375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:55:44.219621 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.219594 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6dda3bac-470c-46f8-b510-8a73f6dc76c6-serving-cert\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:55:44.219732 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.219638 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-trusted-ca\") pod \"console-operator-7cd56b8dbc-qtvqf\" (UID: \"50554e95-e3c9-4f06-84ca-dd86c85bcf8a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:55:44.219791 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.219773 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:44.219829 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.219802 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a3528e4-8866-4d92-889c-db7d8a7271b4-config\") pod \"service-ca-operator-544d749c8c-wd5gb\" (UID: \"9a3528e4-8866-4d92-889c-db7d8a7271b4\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" Oct 31 00:55:44.219861 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.219844 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.219897 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.219871 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-serving-cert\") pod \"console-operator-7cd56b8dbc-qtvqf\" (UID: \"50554e95-e3c9-4f06-84ca-dd86c85bcf8a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:55:44.219927 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.219898 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-rsxrp\" (UID: \"9fb838b9-ac5c-4029-9f11-98b610e5b375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:55:44.219927 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.219921 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dda3bac-470c-46f8-b510-8a73f6dc76c6-service-ca-bundle\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:55:44.219998 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.219933 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 31 00:55:44.219998 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.219942 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-default-certificate\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:44.219998 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.219948 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-786bfcf6b7-n7gm9: secret "image-registry-tls" not found Oct 31 00:55:44.219998 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.219989 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dda3bac-470c-46f8-b510-8a73f6dc76c6-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:55:44.220126 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.219999 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls podName:fccb0eb9-af8a-494e-b629-37a428d87ea5 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:44.719982392 +0000 UTC m=+34.141946906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls") pod "image-registry-786bfcf6b7-n7gm9" (UID: "fccb0eb9-af8a-494e-b629-37a428d87ea5") : secret "image-registry-tls" not found Oct 31 00:55:44.220172 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.220151 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fe4d93b4-1929-4fbe-9bf3-834f03268472-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-znxnl\" (UID: \"fe4d93b4-1929-4fbe-9bf3-834f03268472\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:55:44.220223 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.220192 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-metrics-certs\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:44.220283 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.220262 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-config\") pod \"console-operator-7cd56b8dbc-qtvqf\" (UID: \"50554e95-e3c9-4f06-84ca-dd86c85bcf8a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:55:44.220379 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.220361 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lzml\" (UniqueName: \"kubernetes.io/projected/d050f2b3-1f51-4f94-8d13-075aa3288bd1-kube-api-access-5lzml\") pod \"kas-connection-checker-685895c7c9-s8pvr\" (UID: \"d050f2b3-1f51-4f94-8d13-075aa3288bd1\") " pod="kube-system/kas-connection-checker-685895c7c9-s8pvr" Oct 31 00:55:44.220439 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.220414 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fccb0eb9-af8a-494e-b629-37a428d87ea5-image-registry-private-configuration\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.220493 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.220453 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67qqz\" (UniqueName: \"kubernetes.io/projected/fe4d93b4-1929-4fbe-9bf3-834f03268472-kube-api-access-67qqz\") pod \"cluster-monitoring-operator-884576c57-znxnl\" (UID: \"fe4d93b4-1929-4fbe-9bf3-834f03268472\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:55:44.220544 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.220487 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsv9v\" (UniqueName: \"kubernetes.io/projected/05787044-8eb5-4158-a092-69f7266871fb-kube-api-access-fsv9v\") pod \"volume-data-source-validator-58c9f5f46d-wffrk\" (UID: \"05787044-8eb5-4158-a092-69f7266871fb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wffrk" Oct 31 00:55:44.220544 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.220523 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nhbc\" (UniqueName: \"kubernetes.io/projected/9fb838b9-ac5c-4029-9f11-98b610e5b375-kube-api-access-7nhbc\") pod \"cluster-samples-operator-6ddb6c8b94-rsxrp\" (UID: \"9fb838b9-ac5c-4029-9f11-98b610e5b375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:55:44.220667 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.220655 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-certificates\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.220794 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.220770 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-bound-sa-token\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.220854 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.220826 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dda3bac-470c-46f8-b510-8a73f6dc76c6-service-ca-bundle\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:55:44.220902 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.220827 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8f7j\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-kube-api-access-m8f7j\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.220902 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.220898 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6dda3bac-470c-46f8-b510-8a73f6dc76c6-tmp\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:55:44.221008 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.220946 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n55jw\" (UniqueName: \"kubernetes.io/projected/314bbfb5-1511-4a13-9a52-9bee729f1b2e-kube-api-access-n55jw\") pod \"kas-connection-checker-685895c7c9-l8fz4\" (UID: \"314bbfb5-1511-4a13-9a52-9bee729f1b2e\") " pod="kube-system/kas-connection-checker-685895c7c9-l8fz4" Oct 31 00:55:44.221008 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.220970 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fccb0eb9-af8a-494e-b629-37a428d87ea5-trusted-ca\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.221114 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.221027 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jgr2\" (UniqueName: \"kubernetes.io/projected/9a3528e4-8866-4d92-889c-db7d8a7271b4-kube-api-access-6jgr2\") pod \"service-ca-operator-544d749c8c-wd5gb\" (UID: \"9a3528e4-8866-4d92-889c-db7d8a7271b4\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" Oct 31 00:55:44.221114 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.221061 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a3528e4-8866-4d92-889c-db7d8a7271b4-serving-cert\") pod \"service-ca-operator-544d749c8c-wd5gb\" (UID: \"9a3528e4-8866-4d92-889c-db7d8a7271b4\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" Oct 31 00:55:44.221114 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.221086 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fccb0eb9-af8a-494e-b629-37a428d87ea5-installation-pull-secrets\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.221114 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.221105 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9gzn\" (UniqueName: \"kubernetes.io/projected/e51caef4-2776-4216-9143-2c07435c062b-kube-api-access-l9gzn\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:44.221307 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.221133 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-znxnl\" (UID: \"fe4d93b4-1929-4fbe-9bf3-834f03268472\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:55:44.221307 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.221162 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6dda3bac-470c-46f8-b510-8a73f6dc76c6-snapshots\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:55:44.221307 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.221197 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-certificates\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.221307 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.221196 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tccp5\" (UniqueName: \"kubernetes.io/projected/6dda3bac-470c-46f8-b510-8a73f6dc76c6-kube-api-access-tccp5\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:55:44.221513 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.221340 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dda3bac-470c-46f8-b510-8a73f6dc76c6-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:55:44.221635 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.221512 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rmxd\" (UniqueName: \"kubernetes.io/projected/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-kube-api-access-2rmxd\") pod \"console-operator-7cd56b8dbc-qtvqf\" (UID: \"50554e95-e3c9-4f06-84ca-dd86c85bcf8a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:55:44.221694 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.221641 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fccb0eb9-af8a-494e-b629-37a428d87ea5-ca-trust-extracted\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.221961 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.221936 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6dda3bac-470c-46f8-b510-8a73f6dc76c6-tmp\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:55:44.222207 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.222186 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fccb0eb9-af8a-494e-b629-37a428d87ea5-ca-trust-extracted\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.222277 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.222196 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6dda3bac-470c-46f8-b510-8a73f6dc76c6-snapshots\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:55:44.222447 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.222426 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fccb0eb9-af8a-494e-b629-37a428d87ea5-trusted-ca\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.223873 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.223853 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6dda3bac-470c-46f8-b510-8a73f6dc76c6-serving-cert\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:55:44.224050 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.224034 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fccb0eb9-af8a-494e-b629-37a428d87ea5-installation-pull-secrets\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.224112 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.224040 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fccb0eb9-af8a-494e-b629-37a428d87ea5-image-registry-private-configuration\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.227678 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.227660 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcpm8\" (UniqueName: \"kubernetes.io/projected/e4573d06-669b-4764-9609-9bdc204c419a-kube-api-access-mcpm8\") pod \"kas-connection-checker-685895c7c9-md87z\" (UID: \"e4573d06-669b-4764-9609-9bdc204c419a\") " pod="kube-system/kas-connection-checker-685895c7c9-md87z" Oct 31 00:55:44.228301 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.228280 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Oct 31 00:55:44.228301 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.228287 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Oct 31 00:55:44.229859 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.228304 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-plh8z\"" Oct 31 00:55:44.229859 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.228327 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Oct 31 00:55:44.229859 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.228326 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-9n8qj\"" Oct 31 00:55:44.229859 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.228342 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-v2vnh\"" Oct 31 00:55:44.229859 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.229207 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9nr5w\"" Oct 31 00:55:44.230262 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.230233 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-s8pvr"] Oct 31 00:55:44.230363 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.230279 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wqhkd"] Oct 31 00:55:44.230728 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.230698 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-jwv8k" Oct 31 00:55:44.237402 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.237365 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lzml\" (UniqueName: \"kubernetes.io/projected/d050f2b3-1f51-4f94-8d13-075aa3288bd1-kube-api-access-5lzml\") pod \"kas-connection-checker-685895c7c9-s8pvr\" (UID: \"d050f2b3-1f51-4f94-8d13-075aa3288bd1\") " pod="kube-system/kas-connection-checker-685895c7c9-s8pvr" Oct 31 00:55:44.237402 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.237378 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n55jw\" (UniqueName: \"kubernetes.io/projected/314bbfb5-1511-4a13-9a52-9bee729f1b2e-kube-api-access-n55jw\") pod \"kas-connection-checker-685895c7c9-l8fz4\" (UID: \"314bbfb5-1511-4a13-9a52-9bee729f1b2e\") " pod="kube-system/kas-connection-checker-685895c7c9-l8fz4" Oct 31 00:55:44.237786 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.237768 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tccp5\" (UniqueName: \"kubernetes.io/projected/6dda3bac-470c-46f8-b510-8a73f6dc76c6-kube-api-access-tccp5\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:55:44.238533 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.238517 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-bound-sa-token\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.238902 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.238885 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8f7j\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-kube-api-access-m8f7j\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.261892 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.261875 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-md87z"] Oct 31 00:55:44.261971 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.261903 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-l8fz4"] Oct 31 00:55:44.261971 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.261917 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kg2kz"] Oct 31 00:55:44.262037 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.261977 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wqhkd" Oct 31 00:55:44.275032 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.275014 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-7sfl6"] Oct 31 00:55:44.275093 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.275040 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-786bfcf6b7-n7gm9"] Oct 31 00:55:44.275093 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.275056 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl"] Oct 31 00:55:44.275093 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.275068 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp"] Oct 31 00:55:44.275093 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.275083 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-qtvqf"] Oct 31 00:55:44.275219 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.275096 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wffrk"] Oct 31 00:55:44.275219 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.275110 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb"] Oct 31 00:55:44.275219 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.275125 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-jwv8k"] Oct 31 00:55:44.275219 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.275138 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l"] Oct 31 00:55:44.275219 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.275151 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68f7b65f66-27ggn"] Oct 31 00:55:44.275219 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.275163 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kg2kz"] Oct 31 00:55:44.275219 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.275109 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kg2kz" Oct 31 00:55:44.275443 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.275178 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-fb9mh"] Oct 31 00:55:44.275443 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.275303 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wqhkd"] Oct 31 00:55:44.275443 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.275335 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-788b97d875-vrvqf"] Oct 31 00:55:44.287988 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.287970 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 31 00:55:44.287988 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.287975 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 31 00:55:44.288129 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.288038 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 31 00:55:44.288129 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.288068 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Oct 31 00:55:44.288220 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.288160 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 31 00:55:44.288220 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.288198 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 31 00:55:44.320308 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.320289 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-s8pvr" Oct 31 00:55:44.322536 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.322522 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-stats-auth\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:44.322597 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.322548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42d46af4-addb-42c6-a15f-d1b717fb91b8-cert\") pod \"ingress-canary-wqhkd\" (UID: \"42d46af4-addb-42c6-a15f-d1b717fb91b8\") " pod="openshift-ingress-canary/ingress-canary-wqhkd" Oct 31 00:55:44.322597 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.322582 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw5wp\" (UniqueName: \"kubernetes.io/projected/51be789d-183b-4988-9099-d5d33ad634c4-kube-api-access-mw5wp\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l\" (UID: \"51be789d-183b-4988-9099-d5d33ad634c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" Oct 31 00:55:44.322659 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.322622 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rsxrp\" (UID: \"9fb838b9-ac5c-4029-9f11-98b610e5b375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:55:44.322758 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.322742 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41065dd3-8325-4037-9713-849501465bee-ca-trust-extracted\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.322791 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.322761 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 31 00:55:44.322791 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.322767 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41065dd3-8325-4037-9713-849501465bee-trusted-ca\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.322791 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.322787 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-bound-sa-token\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.322880 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.322815 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls podName:9fb838b9-ac5c-4029-9f11-98b610e5b375 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:44.822798227 +0000 UTC m=+34.244762751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-rsxrp" (UID: "9fb838b9-ac5c-4029-9f11-98b610e5b375") : secret "samples-operator-tls" not found Oct 31 00:55:44.322880 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.322860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-trusted-ca\") pod \"console-operator-7cd56b8dbc-qtvqf\" (UID: \"50554e95-e3c9-4f06-84ca-dd86c85bcf8a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:55:44.322969 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.322886 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st48t\" (UniqueName: \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-kube-api-access-st48t\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.322969 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.322903 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fb9mh\" (UID: \"a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fb9mh" Oct 31 00:55:44.322969 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.322930 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:44.323110 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.322981 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a3528e4-8866-4d92-889c-db7d8a7271b4-config\") pod \"service-ca-operator-544d749c8c-wd5gb\" (UID: \"9a3528e4-8866-4d92-889c-db7d8a7271b4\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" Oct 31 00:55:44.323110 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.323104 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle podName:e51caef4-2776-4216-9143-2c07435c062b nodeName:}" failed. No retries permitted until 2026-10-31 00:55:44.823086116 +0000 UTC m=+34.245050645 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle") pod "router-default-788b97d875-vrvqf" (UID: "e51caef4-2776-4216-9143-2c07435c062b") : configmap references non-existent config key: service-ca.crt Oct 31 00:55:44.323224 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.323126 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-serving-cert\") pod \"console-operator-7cd56b8dbc-qtvqf\" (UID: \"50554e95-e3c9-4f06-84ca-dd86c85bcf8a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:55:44.323224 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.323154 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51be789d-183b-4988-9099-d5d33ad634c4-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l\" (UID: \"51be789d-183b-4988-9099-d5d33ad634c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" Oct 31 00:55:44.323224 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.323185 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-rsxrp\" (UID: \"9fb838b9-ac5c-4029-9f11-98b610e5b375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:55:44.323224 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.323215 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41065dd3-8325-4037-9713-849501465bee-installation-pull-secrets\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.323409 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.323295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-default-certificate\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:44.323409 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.323328 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fe4d93b4-1929-4fbe-9bf3-834f03268472-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-znxnl\" (UID: \"fe4d93b4-1929-4fbe-9bf3-834f03268472\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:55:44.323409 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.323352 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-metrics-certs\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:44.323409 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.323377 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-config\") pod \"console-operator-7cd56b8dbc-qtvqf\" (UID: \"50554e95-e3c9-4f06-84ca-dd86c85bcf8a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:55:44.323409 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.323407 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmvgr\" (UniqueName: \"kubernetes.io/projected/42d46af4-addb-42c6-a15f-d1b717fb91b8-kube-api-access-gmvgr\") pod \"ingress-canary-wqhkd\" (UID: \"42d46af4-addb-42c6-a15f-d1b717fb91b8\") " pod="openshift-ingress-canary/ingress-canary-wqhkd" Oct 31 00:55:44.323674 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.323452 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67qqz\" (UniqueName: \"kubernetes.io/projected/fe4d93b4-1929-4fbe-9bf3-834f03268472-kube-api-access-67qqz\") pod \"cluster-monitoring-operator-884576c57-znxnl\" (UID: \"fe4d93b4-1929-4fbe-9bf3-834f03268472\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:55:44.323674 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.323481 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsv9v\" (UniqueName: \"kubernetes.io/projected/05787044-8eb5-4158-a092-69f7266871fb-kube-api-access-fsv9v\") pod \"volume-data-source-validator-58c9f5f46d-wffrk\" (UID: \"05787044-8eb5-4158-a092-69f7266871fb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wffrk" Oct 31 00:55:44.323674 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.323510 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg55m\" (UniqueName: \"kubernetes.io/projected/b686e125-10ef-4399-b811-42858a543682-kube-api-access-gg55m\") pod \"network-check-source-6f78d59f99-jwv8k\" (UID: \"b686e125-10ef-4399-b811-42858a543682\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-jwv8k" Oct 31 00:55:44.323674 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.323538 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nhbc\" (UniqueName: \"kubernetes.io/projected/9fb838b9-ac5c-4029-9f11-98b610e5b375-kube-api-access-7nhbc\") pod \"cluster-samples-operator-6ddb6c8b94-rsxrp\" (UID: \"9fb838b9-ac5c-4029-9f11-98b610e5b375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:55:44.323674 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.323549 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a3528e4-8866-4d92-889c-db7d8a7271b4-config\") pod \"service-ca-operator-544d749c8c-wd5gb\" (UID: \"9a3528e4-8866-4d92-889c-db7d8a7271b4\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" Oct 31 00:55:44.323674 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.323629 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41065dd3-8325-4037-9713-849501465bee-registry-certificates\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.323674 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.323667 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jgr2\" (UniqueName: \"kubernetes.io/projected/9a3528e4-8866-4d92-889c-db7d8a7271b4-kube-api-access-6jgr2\") pod \"service-ca-operator-544d749c8c-wd5gb\" (UID: \"9a3528e4-8866-4d92-889c-db7d8a7271b4\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" Oct 31 00:55:44.324007 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.323692 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-nginx-conf\") pod \"networking-console-plugin-86c478bb88-fb9mh\" (UID: \"a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fb9mh" Oct 31 00:55:44.324007 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.323694 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-trusted-ca\") pod \"console-operator-7cd56b8dbc-qtvqf\" (UID: \"50554e95-e3c9-4f06-84ca-dd86c85bcf8a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:55:44.324007 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.323895 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-rsxrp\" (UID: \"9fb838b9-ac5c-4029-9f11-98b610e5b375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:55:44.324007 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.323977 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a3528e4-8866-4d92-889c-db7d8a7271b4-serving-cert\") pod \"service-ca-operator-544d749c8c-wd5gb\" (UID: \"9a3528e4-8866-4d92-889c-db7d8a7271b4\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" Oct 31 00:55:44.324215 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.324014 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9gzn\" (UniqueName: \"kubernetes.io/projected/e51caef4-2776-4216-9143-2c07435c062b-kube-api-access-l9gzn\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:44.324215 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.324037 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 31 00:55:44.324215 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.324046 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.324215 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.324082 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-metrics-certs podName:e51caef4-2776-4216-9143-2c07435c062b nodeName:}" failed. No retries permitted until 2026-10-31 00:55:44.824067562 +0000 UTC m=+34.246032085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-metrics-certs") pod "router-default-788b97d875-vrvqf" (UID: "e51caef4-2776-4216-9143-2c07435c062b") : secret "router-metrics-certs-default" not found Oct 31 00:55:44.324215 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.324102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-znxnl\" (UID: \"fe4d93b4-1929-4fbe-9bf3-834f03268472\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:55:44.324215 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.324139 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51be789d-183b-4988-9099-d5d33ad634c4-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l\" (UID: \"51be789d-183b-4988-9099-d5d33ad634c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" Oct 31 00:55:44.324215 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.324166 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41065dd3-8325-4037-9713-849501465bee-image-registry-private-configuration\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.324215 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.324202 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rmxd\" (UniqueName: \"kubernetes.io/projected/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-kube-api-access-2rmxd\") pod \"console-operator-7cd56b8dbc-qtvqf\" (UID: \"50554e95-e3c9-4f06-84ca-dd86c85bcf8a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:55:44.324641 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.324315 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-config\") pod \"console-operator-7cd56b8dbc-qtvqf\" (UID: \"50554e95-e3c9-4f06-84ca-dd86c85bcf8a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:55:44.324798 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.324762 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fe4d93b4-1929-4fbe-9bf3-834f03268472-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-znxnl\" (UID: \"fe4d93b4-1929-4fbe-9bf3-834f03268472\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:55:44.324893 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.324877 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 31 00:55:44.324956 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.324946 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls podName:fe4d93b4-1929-4fbe-9bf3-834f03268472 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:44.824931288 +0000 UTC m=+34.246895814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-znxnl" (UID: "fe4d93b4-1929-4fbe-9bf3-834f03268472") : secret "cluster-monitoring-operator-tls" not found Oct 31 00:55:44.325252 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.325233 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-stats-auth\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:44.325358 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.325338 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-serving-cert\") pod \"console-operator-7cd56b8dbc-qtvqf\" (UID: \"50554e95-e3c9-4f06-84ca-dd86c85bcf8a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:55:44.326061 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.326042 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a3528e4-8866-4d92-889c-db7d8a7271b4-serving-cert\") pod \"service-ca-operator-544d749c8c-wd5gb\" (UID: \"9a3528e4-8866-4d92-889c-db7d8a7271b4\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" Oct 31 00:55:44.326685 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.326665 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-default-certificate\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:44.327727 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.327713 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-md87z" Oct 31 00:55:44.328112 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.328096 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-72bs2\"" Oct 31 00:55:44.328187 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.328173 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 31 00:55:44.328421 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.328403 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-58wnq\"" Oct 31 00:55:44.328421 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.328417 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-46xb4\"" Oct 31 00:55:44.328515 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.328410 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 31 00:55:44.332396 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.332371 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9gzn\" (UniqueName: \"kubernetes.io/projected/e51caef4-2776-4216-9143-2c07435c062b-kube-api-access-l9gzn\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:44.332646 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.332630 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nhbc\" (UniqueName: \"kubernetes.io/projected/9fb838b9-ac5c-4029-9f11-98b610e5b375-kube-api-access-7nhbc\") pod \"cluster-samples-operator-6ddb6c8b94-rsxrp\" (UID: \"9fb838b9-ac5c-4029-9f11-98b610e5b375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:55:44.333243 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.333224 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsv9v\" (UniqueName: \"kubernetes.io/projected/05787044-8eb5-4158-a092-69f7266871fb-kube-api-access-fsv9v\") pod \"volume-data-source-validator-58c9f5f46d-wffrk\" (UID: \"05787044-8eb5-4158-a092-69f7266871fb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wffrk" Oct 31 00:55:44.333377 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.333364 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67qqz\" (UniqueName: \"kubernetes.io/projected/fe4d93b4-1929-4fbe-9bf3-834f03268472-kube-api-access-67qqz\") pod \"cluster-monitoring-operator-884576c57-znxnl\" (UID: \"fe4d93b4-1929-4fbe-9bf3-834f03268472\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:55:44.333670 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.333655 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jgr2\" (UniqueName: \"kubernetes.io/projected/9a3528e4-8866-4d92-889c-db7d8a7271b4-kube-api-access-6jgr2\") pod \"service-ca-operator-544d749c8c-wd5gb\" (UID: \"9a3528e4-8866-4d92-889c-db7d8a7271b4\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" Oct 31 00:55:44.344021 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.344007 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-l8fz4" Oct 31 00:55:44.347694 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.347675 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rmxd\" (UniqueName: \"kubernetes.io/projected/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-kube-api-access-2rmxd\") pod \"console-operator-7cd56b8dbc-qtvqf\" (UID: \"50554e95-e3c9-4f06-84ca-dd86c85bcf8a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:55:44.388233 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.388207 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:55:44.424880 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.424637 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42d46af4-addb-42c6-a15f-d1b717fb91b8-cert\") pod \"ingress-canary-wqhkd\" (UID: \"42d46af4-addb-42c6-a15f-d1b717fb91b8\") " pod="openshift-ingress-canary/ingress-canary-wqhkd" Oct 31 00:55:44.424992 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.424916 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw5wp\" (UniqueName: \"kubernetes.io/projected/51be789d-183b-4988-9099-d5d33ad634c4-kube-api-access-mw5wp\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l\" (UID: \"51be789d-183b-4988-9099-d5d33ad634c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" Oct 31 00:55:44.424992 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.424970 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41065dd3-8325-4037-9713-849501465bee-ca-trust-extracted\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.425077 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.424995 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41065dd3-8325-4037-9713-849501465bee-trusted-ca\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.425077 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.425034 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-bound-sa-token\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.425077 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.425063 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/edf682ca-dae8-42a1-a573-0995bbb7188d-config-volume\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:55:44.425225 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.425093 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st48t\" (UniqueName: \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-kube-api-access-st48t\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.425490 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.425431 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fb9mh\" (UID: \"a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fb9mh" Oct 31 00:55:44.425599 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.425580 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51be789d-183b-4988-9099-d5d33ad634c4-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l\" (UID: \"51be789d-183b-4988-9099-d5d33ad634c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" Oct 31 00:55:44.425683 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.425612 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 31 00:55:44.425683 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.425638 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41065dd3-8325-4037-9713-849501465bee-installation-pull-secrets\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.425780 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.425698 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert podName:a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:44.925666542 +0000 UTC m=+34.347631071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fb9mh" (UID: "a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51") : secret "networking-console-plugin-cert" not found Oct 31 00:55:44.425780 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.425724 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41065dd3-8325-4037-9713-849501465bee-ca-trust-extracted\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.425780 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.425761 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmvgr\" (UniqueName: \"kubernetes.io/projected/42d46af4-addb-42c6-a15f-d1b717fb91b8-kube-api-access-gmvgr\") pod \"ingress-canary-wqhkd\" (UID: \"42d46af4-addb-42c6-a15f-d1b717fb91b8\") " pod="openshift-ingress-canary/ingress-canary-wqhkd" Oct 31 00:55:44.425946 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.425828 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg55m\" (UniqueName: \"kubernetes.io/projected/b686e125-10ef-4399-b811-42858a543682-kube-api-access-gg55m\") pod \"network-check-source-6f78d59f99-jwv8k\" (UID: \"b686e125-10ef-4399-b811-42858a543682\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-jwv8k" Oct 31 00:55:44.425946 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.425858 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edf682ca-dae8-42a1-a573-0995bbb7188d-tmp-dir\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:55:44.425946 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.425934 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41065dd3-8325-4037-9713-849501465bee-registry-certificates\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.426088 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.426010 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks7rn\" (UniqueName: \"kubernetes.io/projected/edf682ca-dae8-42a1-a573-0995bbb7188d-kube-api-access-ks7rn\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:55:44.426088 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.426059 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-nginx-conf\") pod \"networking-console-plugin-86c478bb88-fb9mh\" (UID: \"a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fb9mh" Oct 31 00:55:44.426185 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.426086 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41065dd3-8325-4037-9713-849501465bee-trusted-ca\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.426248 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.426230 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.426299 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.426290 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51be789d-183b-4988-9099-d5d33ad634c4-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l\" (UID: \"51be789d-183b-4988-9099-d5d33ad634c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" Oct 31 00:55:44.426351 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.426308 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41065dd3-8325-4037-9713-849501465bee-image-registry-private-configuration\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.427590 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.426481 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 31 00:55:44.427590 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.426497 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68f7b65f66-27ggn: secret "image-registry-tls" not found Oct 31 00:55:44.427590 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.426546 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls podName:41065dd3-8325-4037-9713-849501465bee nodeName:}" failed. No retries permitted until 2026-10-31 00:55:44.926529469 +0000 UTC m=+34.348493988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls") pod "image-registry-68f7b65f66-27ggn" (UID: "41065dd3-8325-4037-9713-849501465bee") : secret "image-registry-tls" not found Oct 31 00:55:44.427590 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.426640 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41065dd3-8325-4037-9713-849501465bee-registry-certificates\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.427590 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.427177 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51be789d-183b-4988-9099-d5d33ad634c4-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l\" (UID: \"51be789d-183b-4988-9099-d5d33ad634c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" Oct 31 00:55:44.427590 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.427265 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-nginx-conf\") pod \"networking-console-plugin-86c478bb88-fb9mh\" (UID: \"a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fb9mh" Oct 31 00:55:44.428346 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.428327 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:55:44.429315 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.429143 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:55:44.429705 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.429627 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42d46af4-addb-42c6-a15f-d1b717fb91b8-cert\") pod \"ingress-canary-wqhkd\" (UID: \"42d46af4-addb-42c6-a15f-d1b717fb91b8\") " pod="openshift-ingress-canary/ingress-canary-wqhkd" Oct 31 00:55:44.429705 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.429650 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51be789d-183b-4988-9099-d5d33ad634c4-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l\" (UID: \"51be789d-183b-4988-9099-d5d33ad634c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" Oct 31 00:55:44.430000 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.429979 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41065dd3-8325-4037-9713-849501465bee-installation-pull-secrets\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.430335 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.430316 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41065dd3-8325-4037-9713-849501465bee-image-registry-private-configuration\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.436250 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.436220 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-bound-sa-token\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.437310 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.437275 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg55m\" (UniqueName: \"kubernetes.io/projected/b686e125-10ef-4399-b811-42858a543682-kube-api-access-gg55m\") pod \"network-check-source-6f78d59f99-jwv8k\" (UID: \"b686e125-10ef-4399-b811-42858a543682\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-jwv8k" Oct 31 00:55:44.441513 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.441492 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-st48t\" (UniqueName: \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-kube-api-access-st48t\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.443068 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.443044 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw5wp\" (UniqueName: \"kubernetes.io/projected/51be789d-183b-4988-9099-d5d33ad634c4-kube-api-access-mw5wp\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l\" (UID: \"51be789d-183b-4988-9099-d5d33ad634c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" Oct 31 00:55:44.444397 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.444240 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmvgr\" (UniqueName: \"kubernetes.io/projected/42d46af4-addb-42c6-a15f-d1b717fb91b8-kube-api-access-gmvgr\") pod \"ingress-canary-wqhkd\" (UID: \"42d46af4-addb-42c6-a15f-d1b717fb91b8\") " pod="openshift-ingress-canary/ingress-canary-wqhkd" Oct 31 00:55:44.485914 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.485875 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wffrk" Oct 31 00:55:44.506222 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.506196 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" Oct 31 00:55:44.529683 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.529654 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edf682ca-dae8-42a1-a573-0995bbb7188d-tmp-dir\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:55:44.529759 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.529718 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks7rn\" (UniqueName: \"kubernetes.io/projected/edf682ca-dae8-42a1-a573-0995bbb7188d-kube-api-access-ks7rn\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:55:44.529813 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.529793 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:55:44.529877 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.529863 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/edf682ca-dae8-42a1-a573-0995bbb7188d-config-volume\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:55:44.530445 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.530118 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 31 00:55:44.530445 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.530203 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls podName:edf682ca-dae8-42a1-a573-0995bbb7188d nodeName:}" failed. No retries permitted until 2026-10-31 00:55:45.030175419 +0000 UTC m=+34.452139946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls") pod "dns-default-kg2kz" (UID: "edf682ca-dae8-42a1-a573-0995bbb7188d") : secret "dns-default-metrics-tls" not found Oct 31 00:55:44.530630 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.530510 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/edf682ca-dae8-42a1-a573-0995bbb7188d-config-volume\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:55:44.530630 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.530522 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edf682ca-dae8-42a1-a573-0995bbb7188d-tmp-dir\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:55:44.542101 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.542074 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks7rn\" (UniqueName: \"kubernetes.io/projected/edf682ca-dae8-42a1-a573-0995bbb7188d-kube-api-access-ks7rn\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:55:44.553672 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.553615 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" Oct 31 00:55:44.588120 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.588093 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-jwv8k" Oct 31 00:55:44.624809 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.624783 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wqhkd" Oct 31 00:55:44.670911 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.670887 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-md87z"] Oct 31 00:55:44.674589 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.674508 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-s8pvr"] Oct 31 00:55:44.675676 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.675392 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-l8fz4"] Oct 31 00:55:44.677054 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:44.676816 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4573d06_669b_4764_9609_9bdc204c419a.slice/crio-b1c4990622b03017c61e7ec684aa2a18adf42cbe971ec9ac605343d7d346ae8c WatchSource:0}: Error finding container b1c4990622b03017c61e7ec684aa2a18adf42cbe971ec9ac605343d7d346ae8c: Status 404 returned error can't find the container with id b1c4990622b03017c61e7ec684aa2a18adf42cbe971ec9ac605343d7d346ae8c Oct 31 00:55:44.679131 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:44.678660 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod314bbfb5_1511_4a13_9a52_9bee729f1b2e.slice/crio-0b70fccbbc03bc8d398592b7eaa1f8c681a4e478cb6cddd930b838ec69648206 WatchSource:0}: Error finding container 0b70fccbbc03bc8d398592b7eaa1f8c681a4e478cb6cddd930b838ec69648206: Status 404 returned error can't find the container with id 0b70fccbbc03bc8d398592b7eaa1f8c681a4e478cb6cddd930b838ec69648206 Oct 31 00:55:44.679712 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:44.679694 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd050f2b3_1f51_4f94_8d13_075aa3288bd1.slice/crio-be2cb70fe3c74712d7df80d215733b281a66e0dba88f5e7633c84720eca0a90b WatchSource:0}: Error finding container be2cb70fe3c74712d7df80d215733b281a66e0dba88f5e7633c84720eca0a90b: Status 404 returned error can't find the container with id be2cb70fe3c74712d7df80d215733b281a66e0dba88f5e7633c84720eca0a90b Oct 31 00:55:44.694993 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.694927 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-7sfl6"] Oct 31 00:55:44.698159 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:44.698129 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dda3bac_470c_46f8_b510_8a73f6dc76c6.slice/crio-ffdf3e696376dd3a528363ea11f4813e9ee0e7b058dbf654d99bcccf5733f4b6 WatchSource:0}: Error finding container ffdf3e696376dd3a528363ea11f4813e9ee0e7b058dbf654d99bcccf5733f4b6: Status 404 returned error can't find the container with id ffdf3e696376dd3a528363ea11f4813e9ee0e7b058dbf654d99bcccf5733f4b6 Oct 31 00:55:44.734045 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.732607 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:44.734045 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.732676 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktcbp\" (UniqueName: \"kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp\") pod \"network-check-target-r8q7t\" (UID: \"a1a12f14-a3aa-43b0-8ada-4568a87f7186\") " pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:44.734045 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.732831 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:44.734045 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.732888 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs\") pod \"network-metrics-daemon-4bzzq\" (UID: \"159fdfbd-fdcc-4655-b273-f0964617ed13\") " pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:44.734045 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.733032 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:55:44.734045 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.733089 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs podName:159fdfbd-fdcc-4655-b273-f0964617ed13 nodeName:}" failed. No retries permitted until 2026-10-31 00:56:16.733071941 +0000 UTC m=+66.155036452 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs") pod "network-metrics-daemon-4bzzq" (UID: "159fdfbd-fdcc-4655-b273-f0964617ed13") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 31 00:55:44.734045 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.733472 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 31 00:55:44.734045 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.733522 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret podName:6d207e59-c491-43cb-a331-5b89a78f470c nodeName:}" failed. No retries permitted until 2026-10-31 00:56:16.733506092 +0000 UTC m=+66.155470604 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret") pod "global-pull-secret-syncer-wtcjv" (UID: "6d207e59-c491-43cb-a331-5b89a78f470c") : object "kube-system"/"original-pull-secret" not registered Oct 31 00:55:44.734589 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.734340 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-qtvqf"] Oct 31 00:55:44.734589 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.734404 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 31 00:55:44.734589 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.734423 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-786bfcf6b7-n7gm9: secret "image-registry-tls" not found Oct 31 00:55:44.734589 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.734471 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls podName:fccb0eb9-af8a-494e-b629-37a428d87ea5 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:45.734453182 +0000 UTC m=+35.156417706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls") pod "image-registry-786bfcf6b7-n7gm9" (UID: "fccb0eb9-af8a-494e-b629-37a428d87ea5") : secret "image-registry-tls" not found Oct 31 00:55:44.737031 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.737004 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktcbp\" (UniqueName: \"kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp\") pod \"network-check-target-r8q7t\" (UID: \"a1a12f14-a3aa-43b0-8ada-4568a87f7186\") " pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:44.738879 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:44.738854 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50554e95_e3c9_4f06_84ca_dd86c85bcf8a.slice/crio-2104fbd04fee4ec819bbfaf482e72c2fb86a731e88288e50f6c97eca1c2bf6e0 WatchSource:0}: Error finding container 2104fbd04fee4ec819bbfaf482e72c2fb86a731e88288e50f6c97eca1c2bf6e0: Status 404 returned error can't find the container with id 2104fbd04fee4ec819bbfaf482e72c2fb86a731e88288e50f6c97eca1c2bf6e0 Oct 31 00:55:44.765446 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.764699 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wffrk"] Oct 31 00:55:44.771268 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:44.771236 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05787044_8eb5_4158_a092_69f7266871fb.slice/crio-e2270aa8fda01802802363dc62d4765a2089b071a4dc109bd9541e7562a7afee WatchSource:0}: Error finding container e2270aa8fda01802802363dc62d4765a2089b071a4dc109bd9541e7562a7afee: Status 404 returned error can't find the container with id e2270aa8fda01802802363dc62d4765a2089b071a4dc109bd9541e7562a7afee Oct 31 00:55:44.791790 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.790262 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb"] Oct 31 00:55:44.801529 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:44.801037 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a3528e4_8866_4d92_889c_db7d8a7271b4.slice/crio-034a5b503f54141e3a56cc53c0c3d91105ec9a38c7538cbf41ee7a7eace549d9 WatchSource:0}: Error finding container 034a5b503f54141e3a56cc53c0c3d91105ec9a38c7538cbf41ee7a7eace549d9: Status 404 returned error can't find the container with id 034a5b503f54141e3a56cc53c0c3d91105ec9a38c7538cbf41ee7a7eace549d9 Oct 31 00:55:44.831365 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.831346 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l"] Oct 31 00:55:44.833319 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.833296 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-znxnl\" (UID: \"fe4d93b4-1929-4fbe-9bf3-834f03268472\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:55:44.833415 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.833341 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rsxrp\" (UID: \"9fb838b9-ac5c-4029-9f11-98b610e5b375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:55:44.833415 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.833372 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:44.833415 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.833399 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-metrics-certs\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:44.833547 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.833489 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 31 00:55:44.833547 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.833541 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-metrics-certs podName:e51caef4-2776-4216-9143-2c07435c062b nodeName:}" failed. No retries permitted until 2026-10-31 00:55:45.833524461 +0000 UTC m=+35.255488987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-metrics-certs") pod "router-default-788b97d875-vrvqf" (UID: "e51caef4-2776-4216-9143-2c07435c062b") : secret "router-metrics-certs-default" not found Oct 31 00:55:44.833673 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.833589 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 31 00:55:44.833673 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.833630 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls podName:9fb838b9-ac5c-4029-9f11-98b610e5b375 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:45.833618683 +0000 UTC m=+35.255583216 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-rsxrp" (UID: "9fb838b9-ac5c-4029-9f11-98b610e5b375") : secret "samples-operator-tls" not found Oct 31 00:55:44.833673 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.833653 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 31 00:55:44.833792 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:44.833675 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51be789d_183b_4988_9099_d5d33ad634c4.slice/crio-0ec69a84f19a38cfb1a6aa7224d2730314a7a9d3212fca4f63932fa0afe5c66b WatchSource:0}: Error finding container 0ec69a84f19a38cfb1a6aa7224d2730314a7a9d3212fca4f63932fa0afe5c66b: Status 404 returned error can't find the container with id 0ec69a84f19a38cfb1a6aa7224d2730314a7a9d3212fca4f63932fa0afe5c66b Oct 31 00:55:44.833792 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.833709 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls podName:fe4d93b4-1929-4fbe-9bf3-834f03268472 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:45.833690456 +0000 UTC m=+35.255654983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-znxnl" (UID: "fe4d93b4-1929-4fbe-9bf3-834f03268472") : secret "cluster-monitoring-operator-tls" not found Oct 31 00:55:44.833792 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.833727 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle podName:e51caef4-2776-4216-9143-2c07435c062b nodeName:}" failed. No retries permitted until 2026-10-31 00:55:45.833720778 +0000 UTC m=+35.255685326 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle") pod "router-default-788b97d875-vrvqf" (UID: "e51caef4-2776-4216-9143-2c07435c062b") : configmap references non-existent config key: service-ca.crt Oct 31 00:55:44.874339 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.874316 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-jwv8k"] Oct 31 00:55:44.876284 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:44.876260 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb686e125_10ef_4399_b811_42858a543682.slice/crio-854f8ddceeea905e740290da5f9cbb66218b5da287949628742ca469425c69aa WatchSource:0}: Error finding container 854f8ddceeea905e740290da5f9cbb66218b5da287949628742ca469425c69aa: Status 404 returned error can't find the container with id 854f8ddceeea905e740290da5f9cbb66218b5da287949628742ca469425c69aa Oct 31 00:55:44.926259 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.926180 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wqhkd"] Oct 31 00:55:44.928681 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:44.928657 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d46af4_addb_42c6_a15f_d1b717fb91b8.slice/crio-7479eff13b042006c3acd658daf8e57fd5b91e2d2c98cba23f205dd61d80c154 WatchSource:0}: Error finding container 7479eff13b042006c3acd658daf8e57fd5b91e2d2c98cba23f205dd61d80c154: Status 404 returned error can't find the container with id 7479eff13b042006c3acd658daf8e57fd5b91e2d2c98cba23f205dd61d80c154 Oct 31 00:55:44.934461 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.934443 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:44.934543 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:44.934511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fb9mh\" (UID: \"a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fb9mh" Oct 31 00:55:44.934612 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.934595 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 31 00:55:44.934659 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.934613 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68f7b65f66-27ggn: secret "image-registry-tls" not found Oct 31 00:55:44.934659 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.934641 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 31 00:55:44.934726 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.934662 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls podName:41065dd3-8325-4037-9713-849501465bee nodeName:}" failed. No retries permitted until 2026-10-31 00:55:45.934649241 +0000 UTC m=+35.356613765 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls") pod "image-registry-68f7b65f66-27ggn" (UID: "41065dd3-8325-4037-9713-849501465bee") : secret "image-registry-tls" not found Oct 31 00:55:44.934726 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:44.934681 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert podName:a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:45.93467111 +0000 UTC m=+35.356635633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fb9mh" (UID: "a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51") : secret "networking-console-plugin-cert" not found Oct 31 00:55:45.028693 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.028664 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:55:45.028693 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.028692 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:55:45.029209 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.029189 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:45.034025 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.033133 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-xb7hg\"" Oct 31 00:55:45.034025 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.033220 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 31 00:55:45.034025 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.033278 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 31 00:55:45.034025 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.033394 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-gczx4\"" Oct 31 00:55:45.034025 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.033419 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-89pfs\"" Oct 31 00:55:45.035446 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.035419 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:55:45.035532 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:45.035471 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 31 00:55:45.035593 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:45.035534 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls podName:edf682ca-dae8-42a1-a573-0995bbb7188d nodeName:}" failed. No retries permitted until 2026-10-31 00:55:46.035516077 +0000 UTC m=+35.457480605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls") pod "dns-default-kg2kz" (UID: "edf682ca-dae8-42a1-a573-0995bbb7188d") : secret "dns-default-metrics-tls" not found Oct 31 00:55:45.058359 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.058342 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:45.170784 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.170759 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r8q7t"] Oct 31 00:55:45.173489 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:55:45.173463 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a12f14_a3aa_43b0_8ada_4568a87f7186.slice/crio-77501eedb58e5542a24e2aab078b4d7ad14ec809de93d1ccd806262557dc3b37 WatchSource:0}: Error finding container 77501eedb58e5542a24e2aab078b4d7ad14ec809de93d1ccd806262557dc3b37: Status 404 returned error can't find the container with id 77501eedb58e5542a24e2aab078b4d7ad14ec809de93d1ccd806262557dc3b37 Oct 31 00:55:45.240940 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.240908 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-jwv8k" event={"ID":"b686e125-10ef-4399-b811-42858a543682","Type":"ContainerStarted","Data":"854f8ddceeea905e740290da5f9cbb66218b5da287949628742ca469425c69aa"} Oct 31 00:55:45.242065 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.242035 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-7sfl6" event={"ID":"6dda3bac-470c-46f8-b510-8a73f6dc76c6","Type":"ContainerStarted","Data":"ffdf3e696376dd3a528363ea11f4813e9ee0e7b058dbf654d99bcccf5733f4b6"} Oct 31 00:55:45.243332 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.243304 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-s8pvr" event={"ID":"d050f2b3-1f51-4f94-8d13-075aa3288bd1","Type":"ContainerStarted","Data":"60ead283d02fe784ff3f7d546bf657726aa5668c709491c2f727106d47019650"} Oct 31 00:55:45.243435 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.243364 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-s8pvr" event={"ID":"d050f2b3-1f51-4f94-8d13-075aa3288bd1","Type":"ContainerStarted","Data":"be2cb70fe3c74712d7df80d215733b281a66e0dba88f5e7633c84720eca0a90b"} Oct 31 00:55:45.244468 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.244447 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wqhkd" event={"ID":"42d46af4-addb-42c6-a15f-d1b717fb91b8","Type":"ContainerStarted","Data":"7479eff13b042006c3acd658daf8e57fd5b91e2d2c98cba23f205dd61d80c154"} Oct 31 00:55:45.245588 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.245567 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" event={"ID":"9a3528e4-8866-4d92-889c-db7d8a7271b4","Type":"ContainerStarted","Data":"034a5b503f54141e3a56cc53c0c3d91105ec9a38c7538cbf41ee7a7eace549d9"} Oct 31 00:55:45.246948 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.246925 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-md87z" event={"ID":"e4573d06-669b-4764-9609-9bdc204c419a","Type":"ContainerStarted","Data":"09147cd643b311a67074efdeef6b0a5251c39a9c195cf252e68e9a63186ef578"} Oct 31 00:55:45.247037 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.246963 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-md87z" event={"ID":"e4573d06-669b-4764-9609-9bdc204c419a","Type":"ContainerStarted","Data":"b1c4990622b03017c61e7ec684aa2a18adf42cbe971ec9ac605343d7d346ae8c"} Oct 31 00:55:45.248112 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.248092 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" event={"ID":"50554e95-e3c9-4f06-84ca-dd86c85bcf8a","Type":"ContainerStarted","Data":"2104fbd04fee4ec819bbfaf482e72c2fb86a731e88288e50f6c97eca1c2bf6e0"} Oct 31 00:55:45.249472 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.249451 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-l8fz4" event={"ID":"314bbfb5-1511-4a13-9a52-9bee729f1b2e","Type":"ContainerStarted","Data":"5099554350becf374ea0b993d60f0e12f78f45bc43349141bfac9fae099e6b0c"} Oct 31 00:55:45.249618 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.249490 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-l8fz4" event={"ID":"314bbfb5-1511-4a13-9a52-9bee729f1b2e","Type":"ContainerStarted","Data":"0b70fccbbc03bc8d398592b7eaa1f8c681a4e478cb6cddd930b838ec69648206"} Oct 31 00:55:45.250827 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.250803 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r8q7t" event={"ID":"a1a12f14-a3aa-43b0-8ada-4568a87f7186","Type":"ContainerStarted","Data":"77501eedb58e5542a24e2aab078b4d7ad14ec809de93d1ccd806262557dc3b37"} Oct 31 00:55:45.251932 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.251906 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" event={"ID":"51be789d-183b-4988-9099-d5d33ad634c4","Type":"ContainerStarted","Data":"0ec69a84f19a38cfb1a6aa7224d2730314a7a9d3212fca4f63932fa0afe5c66b"} Oct 31 00:55:45.253029 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.253012 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wffrk" event={"ID":"05787044-8eb5-4158-a092-69f7266871fb","Type":"ContainerStarted","Data":"e2270aa8fda01802802363dc62d4765a2089b071a4dc109bd9541e7562a7afee"} Oct 31 00:55:45.259208 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.259170 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-s8pvr" podStartSLOduration=408.259160084 podStartE2EDuration="6m48.259160084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:48:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:55:45.258059862 +0000 UTC m=+34.680024396" watchObservedRunningTime="2026-10-31 00:55:45.259160084 +0000 UTC m=+34.681124617" Oct 31 00:55:45.275270 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.275232 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-md87z" podStartSLOduration=408.275221694 podStartE2EDuration="6m48.275221694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:48:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:55:45.274364439 +0000 UTC m=+34.696328998" watchObservedRunningTime="2026-10-31 00:55:45.275221694 +0000 UTC m=+34.697186225" Oct 31 00:55:45.743256 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.743218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:45.743431 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:45.743379 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 31 00:55:45.743431 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:45.743394 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-786bfcf6b7-n7gm9: secret "image-registry-tls" not found Oct 31 00:55:45.743570 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:45.743453 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls podName:fccb0eb9-af8a-494e-b629-37a428d87ea5 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:47.743434201 +0000 UTC m=+37.165398725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls") pod "image-registry-786bfcf6b7-n7gm9" (UID: "fccb0eb9-af8a-494e-b629-37a428d87ea5") : secret "image-registry-tls" not found Oct 31 00:55:45.844593 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.844538 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rsxrp\" (UID: \"9fb838b9-ac5c-4029-9f11-98b610e5b375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:55:45.844739 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.844642 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:45.844739 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.844699 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-metrics-certs\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:45.844823 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.844807 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-znxnl\" (UID: \"fe4d93b4-1929-4fbe-9bf3-834f03268472\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:55:45.844990 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:45.844975 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 31 00:55:45.845051 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:45.845040 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls podName:fe4d93b4-1929-4fbe-9bf3-834f03268472 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:47.845021403 +0000 UTC m=+37.266985919 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-znxnl" (UID: "fe4d93b4-1929-4fbe-9bf3-834f03268472") : secret "cluster-monitoring-operator-tls" not found Oct 31 00:55:45.845458 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:45.845439 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 31 00:55:45.845528 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:45.845498 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls podName:9fb838b9-ac5c-4029-9f11-98b610e5b375 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:47.845482257 +0000 UTC m=+37.267446790 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-rsxrp" (UID: "9fb838b9-ac5c-4029-9f11-98b610e5b375") : secret "samples-operator-tls" not found Oct 31 00:55:45.845617 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:45.845589 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle podName:e51caef4-2776-4216-9143-2c07435c062b nodeName:}" failed. No retries permitted until 2026-10-31 00:55:47.845578043 +0000 UTC m=+37.267542556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle") pod "router-default-788b97d875-vrvqf" (UID: "e51caef4-2776-4216-9143-2c07435c062b") : configmap references non-existent config key: service-ca.crt Oct 31 00:55:45.845684 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:45.845674 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 31 00:55:45.845744 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:45.845711 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-metrics-certs podName:e51caef4-2776-4216-9143-2c07435c062b nodeName:}" failed. No retries permitted until 2026-10-31 00:55:47.845700743 +0000 UTC m=+37.267665259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-metrics-certs") pod "router-default-788b97d875-vrvqf" (UID: "e51caef4-2776-4216-9143-2c07435c062b") : secret "router-metrics-certs-default" not found Oct 31 00:55:45.945730 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.945693 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:45.945901 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:45.945834 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fb9mh\" (UID: \"a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fb9mh" Oct 31 00:55:45.946036 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:45.946005 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 31 00:55:45.946096 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:45.946070 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert podName:a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:47.946052137 +0000 UTC m=+37.368016649 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fb9mh" (UID: "a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51") : secret "networking-console-plugin-cert" not found Oct 31 00:55:45.946395 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:45.946378 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 31 00:55:45.946395 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:45.946395 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68f7b65f66-27ggn: secret "image-registry-tls" not found Oct 31 00:55:45.946532 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:45.946428 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls podName:41065dd3-8325-4037-9713-849501465bee nodeName:}" failed. No retries permitted until 2026-10-31 00:55:47.946418373 +0000 UTC m=+37.368382883 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls") pod "image-registry-68f7b65f66-27ggn" (UID: "41065dd3-8325-4037-9713-849501465bee") : secret "image-registry-tls" not found Oct 31 00:55:46.046483 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:46.046414 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:55:46.046628 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:46.046616 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 31 00:55:46.046684 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:46.046678 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls podName:edf682ca-dae8-42a1-a573-0995bbb7188d nodeName:}" failed. No retries permitted until 2026-10-31 00:55:48.046660647 +0000 UTC m=+37.468625161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls") pod "dns-default-kg2kz" (UID: "edf682ca-dae8-42a1-a573-0995bbb7188d") : secret "dns-default-metrics-tls" not found Oct 31 00:55:47.267617 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:47.267521 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wffrk" event={"ID":"05787044-8eb5-4158-a092-69f7266871fb","Type":"ContainerStarted","Data":"30866ac2a0a34b41c3e49913c681bfe48e6a4ca27dcdd48a9bf84b36a87d3434"} Oct 31 00:55:47.285595 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:47.284954 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wffrk" podStartSLOduration=378.149167041 podStartE2EDuration="6m20.284936894s" totalImagesPullingTime="2.135769853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:55:47.284053439 +0000 UTC m=+36.706017984" watchObservedRunningTime="2026-10-31 00:55:47.284936894 +0000 UTC m=+36.706901427" Oct 31 00:55:47.286429 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:47.285961 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-l8fz4" podStartSLOduration=410.285944332 podStartE2EDuration="6m50.285944332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:48:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:55:45.290115663 +0000 UTC m=+34.712080221" watchObservedRunningTime="2026-10-31 00:55:47.285944332 +0000 UTC m=+36.707908866" Oct 31 00:55:47.764796 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:47.764754 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:47.764978 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:47.764955 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 31 00:55:47.765041 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:47.764982 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-786bfcf6b7-n7gm9: secret "image-registry-tls" not found Oct 31 00:55:47.765093 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:47.765060 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls podName:fccb0eb9-af8a-494e-b629-37a428d87ea5 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:51.765025684 +0000 UTC m=+41.186990207 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls") pod "image-registry-786bfcf6b7-n7gm9" (UID: "fccb0eb9-af8a-494e-b629-37a428d87ea5") : secret "image-registry-tls" not found Oct 31 00:55:47.865706 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:47.865614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-metrics-certs\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:47.865937 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:47.865737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-znxnl\" (UID: \"fe4d93b4-1929-4fbe-9bf3-834f03268472\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:55:47.865937 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:47.865798 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rsxrp\" (UID: \"9fb838b9-ac5c-4029-9f11-98b610e5b375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:55:47.865937 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:47.865844 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:47.866175 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:47.865995 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle podName:e51caef4-2776-4216-9143-2c07435c062b nodeName:}" failed. No retries permitted until 2026-10-31 00:55:51.865968894 +0000 UTC m=+41.287933423 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle") pod "router-default-788b97d875-vrvqf" (UID: "e51caef4-2776-4216-9143-2c07435c062b") : configmap references non-existent config key: service-ca.crt Oct 31 00:55:47.866464 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:47.866394 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 31 00:55:47.866464 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:47.866449 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-metrics-certs podName:e51caef4-2776-4216-9143-2c07435c062b nodeName:}" failed. No retries permitted until 2026-10-31 00:55:51.866433733 +0000 UTC m=+41.288398243 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-metrics-certs") pod "router-default-788b97d875-vrvqf" (UID: "e51caef4-2776-4216-9143-2c07435c062b") : secret "router-metrics-certs-default" not found Oct 31 00:55:47.866778 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:47.866505 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 31 00:55:47.866778 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:47.866542 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls podName:fe4d93b4-1929-4fbe-9bf3-834f03268472 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:51.866530537 +0000 UTC m=+41.288495047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-znxnl" (UID: "fe4d93b4-1929-4fbe-9bf3-834f03268472") : secret "cluster-monitoring-operator-tls" not found Oct 31 00:55:47.866778 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:47.866619 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 31 00:55:47.866778 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:47.866654 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls podName:9fb838b9-ac5c-4029-9f11-98b610e5b375 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:51.866644048 +0000 UTC m=+41.288608564 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-rsxrp" (UID: "9fb838b9-ac5c-4029-9f11-98b610e5b375") : secret "samples-operator-tls" not found Oct 31 00:55:47.967188 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:47.966252 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:47.967188 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:47.966380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fb9mh\" (UID: \"a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fb9mh" Oct 31 00:55:47.967188 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:47.966627 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 31 00:55:47.967188 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:47.966690 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert podName:a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:51.966671587 +0000 UTC m=+41.388636103 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fb9mh" (UID: "a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51") : secret "networking-console-plugin-cert" not found Oct 31 00:55:47.967188 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:47.967074 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 31 00:55:47.967188 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:47.967088 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68f7b65f66-27ggn: secret "image-registry-tls" not found Oct 31 00:55:47.967188 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:47.967150 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls podName:41065dd3-8325-4037-9713-849501465bee nodeName:}" failed. No retries permitted until 2026-10-31 00:55:51.967133689 +0000 UTC m=+41.389098205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls") pod "image-registry-68f7b65f66-27ggn" (UID: "41065dd3-8325-4037-9713-849501465bee") : secret "image-registry-tls" not found Oct 31 00:55:48.067465 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:48.067429 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:55:48.067663 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:48.067647 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 31 00:55:48.067724 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:48.067710 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls podName:edf682ca-dae8-42a1-a573-0995bbb7188d nodeName:}" failed. No retries permitted until 2026-10-31 00:55:52.06769185 +0000 UTC m=+41.489656376 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls") pod "dns-default-kg2kz" (UID: "edf682ca-dae8-42a1-a573-0995bbb7188d") : secret "dns-default-metrics-tls" not found Oct 31 00:55:49.276902 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:49.276685 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/0.log" Oct 31 00:55:49.277320 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:49.276926 2579 generic.go:356] "Generic (PLEG): container finished" podID="50554e95-e3c9-4f06-84ca-dd86c85bcf8a" containerID="d044010d18b57354b9b773650a78b08ddb1edfb5a87aee58f06345f83c2c5c47" exitCode=255 Oct 31 00:55:49.277320 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:49.277027 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" event={"ID":"50554e95-e3c9-4f06-84ca-dd86c85bcf8a","Type":"ContainerDied","Data":"d044010d18b57354b9b773650a78b08ddb1edfb5a87aee58f06345f83c2c5c47"} Oct 31 00:55:49.277320 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:49.277242 2579 scope.go:122] "RemoveContainer" containerID="d044010d18b57354b9b773650a78b08ddb1edfb5a87aee58f06345f83c2c5c47" Oct 31 00:55:50.284416 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:50.284383 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/1.log" Oct 31 00:55:50.285392 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:50.285027 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/0.log" Oct 31 00:55:50.285392 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:50.285062 2579 generic.go:356] "Generic (PLEG): container finished" podID="50554e95-e3c9-4f06-84ca-dd86c85bcf8a" containerID="fc3eea3b3dbedee8a2622cc589a65c73f1195478bf203060dfca8c7396bea6d9" exitCode=255 Oct 31 00:55:50.285392 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:50.285320 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" event={"ID":"50554e95-e3c9-4f06-84ca-dd86c85bcf8a","Type":"ContainerDied","Data":"fc3eea3b3dbedee8a2622cc589a65c73f1195478bf203060dfca8c7396bea6d9"} Oct 31 00:55:50.285579 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:50.285422 2579 scope.go:122] "RemoveContainer" containerID="d044010d18b57354b9b773650a78b08ddb1edfb5a87aee58f06345f83c2c5c47" Oct 31 00:55:50.285579 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:50.285441 2579 scope.go:122] "RemoveContainer" containerID="fc3eea3b3dbedee8a2622cc589a65c73f1195478bf203060dfca8c7396bea6d9" Oct 31 00:55:50.285905 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:50.285707 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-qtvqf_openshift-console-operator(50554e95-e3c9-4f06-84ca-dd86c85bcf8a)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" podUID="50554e95-e3c9-4f06-84ca-dd86c85bcf8a" Oct 31 00:55:50.287526 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:50.287474 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" event={"ID":"51be789d-183b-4988-9099-d5d33ad634c4","Type":"ContainerStarted","Data":"a2046ceacffcedfc643fcf20a12c3a87961bc913984f249761db25bc7324de09"} Oct 31 00:55:50.290349 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:50.290306 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wqhkd" event={"ID":"42d46af4-addb-42c6-a15f-d1b717fb91b8","Type":"ContainerStarted","Data":"72fe3af87a6d55ee73b2d74be5e0afa0b054e78fe5ccdb9319bd50ebf2a25588"} Oct 31 00:55:50.325602 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:50.325530 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wqhkd" podStartSLOduration=2.180971557 podStartE2EDuration="7.325514863s" totalImagesPullingTime="5.144543306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:55:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:55:50.324393144 +0000 UTC m=+39.746357701" watchObservedRunningTime="2026-10-31 00:55:50.325514863 +0000 UTC m=+39.747479395" Oct 31 00:55:50.347950 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:50.347899 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" podStartSLOduration=378.899176295 podStartE2EDuration="6m23.347886236s" totalImagesPullingTime="4.448709941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:55:50.347405368 +0000 UTC m=+39.769369926" watchObservedRunningTime="2026-10-31 00:55:50.347886236 +0000 UTC m=+39.769850770" Oct 31 00:55:50.409011 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:50.408977 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-bfx9m"] Oct 31 00:55:50.422860 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:50.422753 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-bfx9m"] Oct 31 00:55:50.422984 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:50.422927 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bfx9m" Oct 31 00:55:50.522941 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:50.522911 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 31 00:55:50.522941 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:50.522941 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 31 00:55:50.523146 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:50.522986 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ht5gb\"" Oct 31 00:55:50.607591 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:50.607541 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb4g2\" (UniqueName: \"kubernetes.io/projected/b93a7d1a-904e-4d81-a425-f4d3b3055354-kube-api-access-kb4g2\") pod \"migrator-66df5d496b-bfx9m\" (UID: \"b93a7d1a-904e-4d81-a425-f4d3b3055354\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bfx9m" Oct 31 00:55:50.708334 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:50.708259 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb4g2\" (UniqueName: \"kubernetes.io/projected/b93a7d1a-904e-4d81-a425-f4d3b3055354-kube-api-access-kb4g2\") pod \"migrator-66df5d496b-bfx9m\" (UID: \"b93a7d1a-904e-4d81-a425-f4d3b3055354\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bfx9m" Oct 31 00:55:50.731473 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:50.731291 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb4g2\" (UniqueName: \"kubernetes.io/projected/b93a7d1a-904e-4d81-a425-f4d3b3055354-kube-api-access-kb4g2\") pod \"migrator-66df5d496b-bfx9m\" (UID: \"b93a7d1a-904e-4d81-a425-f4d3b3055354\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bfx9m" Oct 31 00:55:50.759153 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:50.759127 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bfx9m" Oct 31 00:55:51.170442 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:51.170415 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-bfx9m"] Oct 31 00:55:51.295038 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:51.294780 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r8q7t" event={"ID":"a1a12f14-a3aa-43b0-8ada-4568a87f7186","Type":"ContainerStarted","Data":"a8b99e6d922ff44485f80069c7ed9704ae23f44dd0cbe0f0ea26943b0f51eba9"} Oct 31 00:55:51.295038 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:51.295035 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:55:51.296778 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:51.296750 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-jwv8k" event={"ID":"b686e125-10ef-4399-b811-42858a543682","Type":"ContainerStarted","Data":"4dcf51492240ecfd26b61c50c384f65fb04be9568b94edbd8e3168fa5977e4a2"} Oct 31 00:55:51.298034 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:51.298002 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bfx9m" event={"ID":"b93a7d1a-904e-4d81-a425-f4d3b3055354","Type":"ContainerStarted","Data":"32eee51493c70164676708ebd1d346d8bd51f0f5ddb6236e4a40fc331e63f728"} Oct 31 00:55:51.299340 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:51.299320 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" event={"ID":"9a3528e4-8866-4d92-889c-db7d8a7271b4","Type":"ContainerStarted","Data":"946b457d52a466a15f132a463705e1e7b85399c05d67f412f3fb78c224738a28"} Oct 31 00:55:51.301026 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:51.301008 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/1.log" Oct 31 00:55:51.301506 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:51.301490 2579 scope.go:122] "RemoveContainer" containerID="fc3eea3b3dbedee8a2622cc589a65c73f1195478bf203060dfca8c7396bea6d9" Oct 31 00:55:51.301662 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:51.301645 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-qtvqf_openshift-console-operator(50554e95-e3c9-4f06-84ca-dd86c85bcf8a)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" podUID="50554e95-e3c9-4f06-84ca-dd86c85bcf8a" Oct 31 00:55:51.314391 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:51.314346 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r8q7t" podStartSLOduration=33.590357124 podStartE2EDuration="39.314334399s" totalImagesPullingTime="5.723977275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:55:51.312609788 +0000 UTC m=+40.734574319" watchObservedRunningTime="2026-10-31 00:55:51.314334399 +0000 UTC m=+40.736298932" Oct 31 00:55:51.347766 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:51.347732 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-jwv8k" podStartSLOduration=375.07920354 podStartE2EDuration="6m21.347721156s" totalImagesPullingTime="6.268517616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:49:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:55:51.346608714 +0000 UTC m=+40.768573246" watchObservedRunningTime="2026-10-31 00:55:51.347721156 +0000 UTC m=+40.769685687" Oct 31 00:55:51.364760 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:51.364724 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" podStartSLOduration=378.262753664 podStartE2EDuration="6m24.364712686s" totalImagesPullingTime="6.101959022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:55:51.364092222 +0000 UTC m=+40.786056781" watchObservedRunningTime="2026-10-31 00:55:51.364712686 +0000 UTC m=+40.786677219" Oct 31 00:55:51.818810 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:51.818093 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:51.818810 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:51.818370 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 31 00:55:51.818810 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:51.818386 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-786bfcf6b7-n7gm9: secret "image-registry-tls" not found Oct 31 00:55:51.818810 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:51.818443 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls podName:fccb0eb9-af8a-494e-b629-37a428d87ea5 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:59.818425014 +0000 UTC m=+49.240389528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls") pod "image-registry-786bfcf6b7-n7gm9" (UID: "fccb0eb9-af8a-494e-b629-37a428d87ea5") : secret "image-registry-tls" not found Oct 31 00:55:51.919927 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:51.919628 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-znxnl\" (UID: \"fe4d93b4-1929-4fbe-9bf3-834f03268472\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:55:51.919927 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:51.919693 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rsxrp\" (UID: \"9fb838b9-ac5c-4029-9f11-98b610e5b375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:55:51.919927 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:51.919740 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:51.919927 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:51.919779 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 31 00:55:51.919927 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:51.919787 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-metrics-certs\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:51.919927 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:51.919844 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls podName:fe4d93b4-1929-4fbe-9bf3-834f03268472 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:59.919826536 +0000 UTC m=+49.341791059 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-znxnl" (UID: "fe4d93b4-1929-4fbe-9bf3-834f03268472") : secret "cluster-monitoring-operator-tls" not found Oct 31 00:55:51.919927 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:51.919856 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 31 00:55:51.919927 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:51.919885 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 31 00:55:51.919927 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:51.919927 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls podName:9fb838b9-ac5c-4029-9f11-98b610e5b375 nodeName:}" failed. No retries permitted until 2026-10-31 00:55:59.919909902 +0000 UTC m=+49.341874429 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-rsxrp" (UID: "9fb838b9-ac5c-4029-9f11-98b610e5b375") : secret "samples-operator-tls" not found Oct 31 00:55:51.920416 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:51.919947 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-metrics-certs podName:e51caef4-2776-4216-9143-2c07435c062b nodeName:}" failed. No retries permitted until 2026-10-31 00:55:59.91993766 +0000 UTC m=+49.341902174 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-metrics-certs") pod "router-default-788b97d875-vrvqf" (UID: "e51caef4-2776-4216-9143-2c07435c062b") : secret "router-metrics-certs-default" not found Oct 31 00:55:51.920416 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:51.919963 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle podName:e51caef4-2776-4216-9143-2c07435c062b nodeName:}" failed. No retries permitted until 2026-10-31 00:55:59.919953389 +0000 UTC m=+49.341917906 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle") pod "router-default-788b97d875-vrvqf" (UID: "e51caef4-2776-4216-9143-2c07435c062b") : configmap references non-existent config key: service-ca.crt Oct 31 00:55:52.020873 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:52.020843 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:55:52.021050 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:52.020931 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fb9mh\" (UID: \"a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fb9mh" Oct 31 00:55:52.021050 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:52.020964 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 31 00:55:52.021050 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:52.020988 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68f7b65f66-27ggn: secret "image-registry-tls" not found Oct 31 00:55:52.021050 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:52.021045 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls podName:41065dd3-8325-4037-9713-849501465bee nodeName:}" failed. No retries permitted until 2026-10-31 00:56:00.021029446 +0000 UTC m=+49.442993957 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls") pod "image-registry-68f7b65f66-27ggn" (UID: "41065dd3-8325-4037-9713-849501465bee") : secret "image-registry-tls" not found Oct 31 00:55:52.021281 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:52.021087 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 31 00:55:52.021281 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:52.021161 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert podName:a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51 nodeName:}" failed. No retries permitted until 2026-10-31 00:56:00.021143039 +0000 UTC m=+49.443107566 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fb9mh" (UID: "a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51") : secret "networking-console-plugin-cert" not found Oct 31 00:55:52.121973 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:52.121942 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:55:52.122189 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:52.122172 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 31 00:55:52.122261 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:52.122238 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls podName:edf682ca-dae8-42a1-a573-0995bbb7188d nodeName:}" failed. No retries permitted until 2026-10-31 00:56:00.122224532 +0000 UTC m=+49.544189058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls") pod "dns-default-kg2kz" (UID: "edf682ca-dae8-42a1-a573-0995bbb7188d") : secret "dns-default-metrics-tls" not found Oct 31 00:55:53.310050 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:53.310015 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bfx9m" event={"ID":"b93a7d1a-904e-4d81-a425-f4d3b3055354","Type":"ContainerStarted","Data":"0637679bc5c3fd0696d777dc466a4cbaa2adc32eb488ec82c645171b8a1bf502"} Oct 31 00:55:53.332612 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:53.332544 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bfx9m" podStartSLOduration=1.790945314 podStartE2EDuration="3.332531779s" totalImagesPullingTime="1.541586465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:55:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:55:53.330001969 +0000 UTC m=+42.751966516" watchObservedRunningTime="2026-10-31 00:55:53.332531779 +0000 UTC m=+42.754496311" Oct 31 00:55:54.430655 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:54.430620 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:55:54.431154 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:54.430681 2579 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:55:54.431154 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:54.431042 2579 scope.go:122] "RemoveContainer" containerID="fc3eea3b3dbedee8a2622cc589a65c73f1195478bf203060dfca8c7396bea6d9" Oct 31 00:55:54.431269 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:54.431245 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-qtvqf_openshift-console-operator(50554e95-e3c9-4f06-84ca-dd86c85bcf8a)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" podUID="50554e95-e3c9-4f06-84ca-dd86c85bcf8a" Oct 31 00:55:56.136443 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:56.136409 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzjbb_33816f29-a274-4bbb-83d7-72820504fee3/konnectivity-agent/0.log" limit=1024 Oct 31 00:55:56.505815 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:56.505581 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzjbb_33816f29-a274-4bbb-83d7-72820504fee3/konnectivity-agent/0.log" limit=1024 Oct 31 00:55:56.624529 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:56.624500 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzjbb_33816f29-a274-4bbb-83d7-72820504fee3/konnectivity-agent/0.log" limit=1024 Oct 31 00:55:59.882266 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:59.882236 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:55:59.882653 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:59.882368 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 31 00:55:59.882653 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:59.882385 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-786bfcf6b7-n7gm9: secret "image-registry-tls" not found Oct 31 00:55:59.882653 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:59.882438 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls podName:fccb0eb9-af8a-494e-b629-37a428d87ea5 nodeName:}" failed. No retries permitted until 2026-10-31 00:56:15.882422316 +0000 UTC m=+65.304386826 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls") pod "image-registry-786bfcf6b7-n7gm9" (UID: "fccb0eb9-af8a-494e-b629-37a428d87ea5") : secret "image-registry-tls" not found Oct 31 00:55:59.983045 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:59.983017 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-znxnl\" (UID: \"fe4d93b4-1929-4fbe-9bf3-834f03268472\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:55:59.983178 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:59.983061 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rsxrp\" (UID: \"9fb838b9-ac5c-4029-9f11-98b610e5b375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:55:59.983178 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:59.983155 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 31 00:55:59.983291 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:59.983188 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:59.983291 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:59.983198 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls podName:9fb838b9-ac5c-4029-9f11-98b610e5b375 nodeName:}" failed. No retries permitted until 2026-10-31 00:56:15.983187165 +0000 UTC m=+65.405151676 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-rsxrp" (UID: "9fb838b9-ac5c-4029-9f11-98b610e5b375") : secret "samples-operator-tls" not found Oct 31 00:55:59.983291 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:59.983201 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 31 00:55:59.983291 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:59.983244 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-metrics-certs\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:55:59.983291 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:59.983262 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls podName:fe4d93b4-1929-4fbe-9bf3-834f03268472 nodeName:}" failed. No retries permitted until 2026-10-31 00:56:15.983244635 +0000 UTC m=+65.405209162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-znxnl" (UID: "fe4d93b4-1929-4fbe-9bf3-834f03268472") : secret "cluster-monitoring-operator-tls" not found Oct 31 00:55:59.983484 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:55:59.983326 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle podName:e51caef4-2776-4216-9143-2c07435c062b nodeName:}" failed. No retries permitted until 2026-10-31 00:56:15.983311024 +0000 UTC m=+65.405275551 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle") pod "router-default-788b97d875-vrvqf" (UID: "e51caef4-2776-4216-9143-2c07435c062b") : configmap references non-existent config key: service-ca.crt Oct 31 00:55:59.987203 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:55:59.987183 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-metrics-certs\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:00.083626 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:00.083602 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fb9mh\" (UID: \"a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fb9mh" Oct 31 00:56:00.083767 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:00.083690 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:56:00.083767 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:56:00.083738 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 31 00:56:00.083869 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:56:00.083798 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert podName:a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51 nodeName:}" failed. No retries permitted until 2026-10-31 00:56:16.083783387 +0000 UTC m=+65.505747914 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fb9mh" (UID: "a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51") : secret "networking-console-plugin-cert" not found Oct 31 00:56:00.083869 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:56:00.083862 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 31 00:56:00.083970 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:56:00.083880 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68f7b65f66-27ggn: secret "image-registry-tls" not found Oct 31 00:56:00.083970 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:56:00.083933 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls podName:41065dd3-8325-4037-9713-849501465bee nodeName:}" failed. No retries permitted until 2026-10-31 00:56:16.083916623 +0000 UTC m=+65.505881147 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls") pod "image-registry-68f7b65f66-27ggn" (UID: "41065dd3-8325-4037-9713-849501465bee") : secret "image-registry-tls" not found Oct 31 00:56:00.184364 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:00.184308 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:56:00.184464 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:56:00.184400 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 31 00:56:00.184464 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:56:00.184442 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls podName:edf682ca-dae8-42a1-a573-0995bbb7188d nodeName:}" failed. No retries permitted until 2026-10-31 00:56:16.184432823 +0000 UTC m=+65.606397333 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls") pod "dns-default-kg2kz" (UID: "edf682ca-dae8-42a1-a573-0995bbb7188d") : secret "dns-default-metrics-tls" not found Oct 31 00:56:01.030271 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:01.030246 2579 scope.go:122] "RemoveContainer" containerID="fc3eea3b3dbedee8a2622cc589a65c73f1195478bf203060dfca8c7396bea6d9" Oct 31 00:56:01.336860 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:01.336791 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/1.log" Oct 31 00:56:01.336860 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:01.336848 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" event={"ID":"50554e95-e3c9-4f06-84ca-dd86c85bcf8a","Type":"ContainerStarted","Data":"0b78c434b7c4d6dfd81734c71e28856b573b83932cb33379f60defdc0f074cac"} Oct 31 00:56:01.337197 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:01.337169 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:56:01.344424 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:01.344317 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:56:01.358026 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:01.357983 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" podStartSLOduration=390.189581668 podStartE2EDuration="6m34.357969137s" totalImagesPullingTime="4.168387469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:56:01.35732532 +0000 UTC m=+50.779289882" watchObservedRunningTime="2026-10-31 00:56:01.357969137 +0000 UTC m=+50.779933668" Oct 31 00:56:03.344786 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:03.344703 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-7sfl6" event={"ID":"6dda3bac-470c-46f8-b510-8a73f6dc76c6","Type":"ContainerStarted","Data":"b00a290acfe998e127ec71d0107eb5de897b8e9390fb36b62e6c00bfdcc2f211"} Oct 31 00:56:03.368742 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:03.368697 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-7sfl6" podStartSLOduration=378.130776288 podStartE2EDuration="6m36.368683679s" totalImagesPullingTime="18.237907391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:56:03.367678995 +0000 UTC m=+52.789643539" watchObservedRunningTime="2026-10-31 00:56:03.368683679 +0000 UTC m=+52.790648211" Oct 31 00:56:08.361649 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:08.361614 2579 generic.go:356] "Generic (PLEG): container finished" podID="6dda3bac-470c-46f8-b510-8a73f6dc76c6" containerID="b00a290acfe998e127ec71d0107eb5de897b8e9390fb36b62e6c00bfdcc2f211" exitCode=0 Oct 31 00:56:08.361975 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:08.361689 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-7sfl6" event={"ID":"6dda3bac-470c-46f8-b510-8a73f6dc76c6","Type":"ContainerDied","Data":"b00a290acfe998e127ec71d0107eb5de897b8e9390fb36b62e6c00bfdcc2f211"} Oct 31 00:56:08.362016 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:08.362000 2579 scope.go:122] "RemoveContainer" containerID="b00a290acfe998e127ec71d0107eb5de897b8e9390fb36b62e6c00bfdcc2f211" Oct 31 00:56:09.237993 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:09.237967 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:09.366766 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:09.366734 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-7sfl6" event={"ID":"6dda3bac-470c-46f8-b510-8a73f6dc76c6","Type":"ContainerStarted","Data":"907deca131797486a2fec190a99edbb3971506f920c4595b8b1355dc4bb22acb"} Oct 31 00:56:15.131499 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.131463 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-kgzkz-wqj59"] Oct 31 00:56:15.135739 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.135719 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-gqgf7-x4kfr"] Oct 31 00:56:15.135855 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.135840 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:15.138361 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.138343 2579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68f7b65f66-27ggn"] Oct 31 00:56:15.138472 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.138457 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:15.138529 ip-10-0-132-179 kubenswrapper[2579]: E1031 00:56:15.138488 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" podUID="41065dd3-8325-4037-9713-849501465bee" Oct 31 00:56:15.154125 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.154100 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-kgzkz-wqj59"] Oct 31 00:56:15.154230 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.154142 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-gqgf7-x4kfr"] Oct 31 00:56:15.182704 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.182678 2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-66jgl"] Oct 31 00:56:15.185655 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.185640 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:15.201406 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.201385 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3737c365-6bb7-4e45-a487-5a6ed8eda295-archives-path\") pod \"periodic-gathering-gqgf7-x4kfr\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:15.201489 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.201426 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z68r\" (UniqueName: \"kubernetes.io/projected/3737c365-6bb7-4e45-a487-5a6ed8eda295-kube-api-access-4z68r\") pod \"periodic-gathering-gqgf7-x4kfr\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:15.201489 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.201451 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-service-ca-bundle\") pod \"periodic-gathering-kgzkz-wqj59\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:15.201577 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.201502 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-trusted-ca-bundle\") pod \"periodic-gathering-kgzkz-wqj59\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:15.201615 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.201596 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-archives-path\") pod \"periodic-gathering-kgzkz-wqj59\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:15.201647 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.201622 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msq52\" (UniqueName: \"kubernetes.io/projected/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-kube-api-access-msq52\") pod \"periodic-gathering-kgzkz-wqj59\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:15.201647 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.201642 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3737c365-6bb7-4e45-a487-5a6ed8eda295-trusted-ca-bundle\") pod \"periodic-gathering-gqgf7-x4kfr\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:15.201717 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.201660 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3737c365-6bb7-4e45-a487-5a6ed8eda295-service-ca-bundle\") pod \"periodic-gathering-gqgf7-x4kfr\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:15.216478 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.216459 2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 31 00:56:15.230173 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.230154 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 31 00:56:15.230303 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.230288 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p5vm9\"" Oct 31 00:56:15.230618 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.230601 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-66jgl"] Oct 31 00:56:15.302718 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.302694 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-service-ca-bundle\") pod \"periodic-gathering-kgzkz-wqj59\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:15.302863 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.302722 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-trusted-ca-bundle\") pod \"periodic-gathering-kgzkz-wqj59\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:15.302863 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.302758 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-archives-path\") pod \"periodic-gathering-kgzkz-wqj59\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:15.302863 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.302775 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msq52\" (UniqueName: \"kubernetes.io/projected/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-kube-api-access-msq52\") pod \"periodic-gathering-kgzkz-wqj59\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:15.302863 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.302798 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3737c365-6bb7-4e45-a487-5a6ed8eda295-trusted-ca-bundle\") pod \"periodic-gathering-gqgf7-x4kfr\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:15.302863 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.302825 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-data-volume\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:15.302863 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.302853 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3737c365-6bb7-4e45-a487-5a6ed8eda295-service-ca-bundle\") pod \"periodic-gathering-gqgf7-x4kfr\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:15.303172 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.302895 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xldv4\" (UniqueName: \"kubernetes.io/projected/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-kube-api-access-xldv4\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:15.303172 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.303036 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-crio-socket\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:15.303271 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.303169 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-archives-path\") pod \"periodic-gathering-kgzkz-wqj59\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:15.303271 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.303195 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3737c365-6bb7-4e45-a487-5a6ed8eda295-archives-path\") pod \"periodic-gathering-gqgf7-x4kfr\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:15.303271 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.303229 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:15.303417 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.303277 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:15.303417 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.303323 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z68r\" (UniqueName: \"kubernetes.io/projected/3737c365-6bb7-4e45-a487-5a6ed8eda295-kube-api-access-4z68r\") pod \"periodic-gathering-gqgf7-x4kfr\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:15.303538 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.303521 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-service-ca-bundle\") pod \"periodic-gathering-kgzkz-wqj59\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:15.303627 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.303573 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3737c365-6bb7-4e45-a487-5a6ed8eda295-archives-path\") pod \"periodic-gathering-gqgf7-x4kfr\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:15.303690 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.303644 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3737c365-6bb7-4e45-a487-5a6ed8eda295-service-ca-bundle\") pod \"periodic-gathering-gqgf7-x4kfr\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:15.303745 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.303694 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-trusted-ca-bundle\") pod \"periodic-gathering-kgzkz-wqj59\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:15.303912 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.303892 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3737c365-6bb7-4e45-a487-5a6ed8eda295-trusted-ca-bundle\") pod \"periodic-gathering-gqgf7-x4kfr\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:15.326190 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.326158 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msq52\" (UniqueName: \"kubernetes.io/projected/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-kube-api-access-msq52\") pod \"periodic-gathering-kgzkz-wqj59\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:15.326965 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.326947 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z68r\" (UniqueName: \"kubernetes.io/projected/3737c365-6bb7-4e45-a487-5a6ed8eda295-kube-api-access-4z68r\") pod \"periodic-gathering-gqgf7-x4kfr\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:15.384969 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.384911 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:56:15.396061 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.396040 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:56:15.404307 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.404280 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:15.404407 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.404328 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:15.404471 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.404420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-data-volume\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:15.404526 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.404468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xldv4\" (UniqueName: \"kubernetes.io/projected/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-kube-api-access-xldv4\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:15.404610 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.404523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-crio-socket\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:15.404769 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.404755 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-crio-socket\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:15.404832 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.404794 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-data-volume\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:15.404890 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.404875 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:15.406359 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.406343 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:15.417820 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.417800 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xldv4\" (UniqueName: \"kubernetes.io/projected/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-kube-api-access-xldv4\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:15.448008 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.447991 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:15.452716 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.452697 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:15.499899 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.499840 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:15.505834 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.505806 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/41065dd3-8325-4037-9713-849501465bee-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41065dd3-8325-4037-9713-849501465bee-image-registry-private-configuration\") pod \"41065dd3-8325-4037-9713-849501465bee\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " Oct 31 00:56:15.505965 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.505947 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/41065dd3-8325-4037-9713-849501465bee-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41065dd3-8325-4037-9713-849501465bee-trusted-ca\") pod \"41065dd3-8325-4037-9713-849501465bee\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " Oct 31 00:56:15.506021 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.505999 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-bound-sa-token\") pod \"41065dd3-8325-4037-9713-849501465bee\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " Oct 31 00:56:15.507138 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.506071 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/41065dd3-8325-4037-9713-849501465bee-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41065dd3-8325-4037-9713-849501465bee-ca-trust-extracted\") pod \"41065dd3-8325-4037-9713-849501465bee\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " Oct 31 00:56:15.507138 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.506303 2579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41065dd3-8325-4037-9713-849501465bee-ca-trust-extracted" pod "41065dd3-8325-4037-9713-849501465bee" (UID: "41065dd3-8325-4037-9713-849501465bee"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:56:15.507138 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.506308 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/41065dd3-8325-4037-9713-849501465bee-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41065dd3-8325-4037-9713-849501465bee-installation-pull-secrets\") pod \"41065dd3-8325-4037-9713-849501465bee\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " Oct 31 00:56:15.507138 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.506385 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/41065dd3-8325-4037-9713-849501465bee-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41065dd3-8325-4037-9713-849501465bee-registry-certificates\") pod \"41065dd3-8325-4037-9713-849501465bee\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " Oct 31 00:56:15.507138 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.506416 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-kube-api-access-st48t\" (UniqueName: \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-kube-api-access-st48t\") pod \"41065dd3-8325-4037-9713-849501465bee\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " Oct 31 00:56:15.507138 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.506680 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41065dd3-8325-4037-9713-849501465bee-ca-trust-extracted\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:56:15.507138 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.507104 2579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41065dd3-8325-4037-9713-849501465bee-registry-certificates" pod "41065dd3-8325-4037-9713-849501465bee" (UID: "41065dd3-8325-4037-9713-849501465bee"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:56:15.507575 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.507538 2579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41065dd3-8325-4037-9713-849501465bee-trusted-ca" pod "41065dd3-8325-4037-9713-849501465bee" (UID: "41065dd3-8325-4037-9713-849501465bee"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:56:15.513362 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.513253 2579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41065dd3-8325-4037-9713-849501465bee-image-registry-private-configuration" pod "41065dd3-8325-4037-9713-849501465bee" (UID: "41065dd3-8325-4037-9713-849501465bee"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:56:15.513718 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.513692 2579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41065dd3-8325-4037-9713-849501465bee-installation-pull-secrets" pod "41065dd3-8325-4037-9713-849501465bee" (UID: "41065dd3-8325-4037-9713-849501465bee"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:56:15.513828 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.513804 2579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-bound-sa-token" pod "41065dd3-8325-4037-9713-849501465bee" (UID: "41065dd3-8325-4037-9713-849501465bee"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:56:15.517644 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.515732 2579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-kube-api-access-st48t" pod "41065dd3-8325-4037-9713-849501465bee" (UID: "41065dd3-8325-4037-9713-849501465bee"). InnerVolumeSpecName "kube-api-access-st48t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:56:15.607620 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.607596 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41065dd3-8325-4037-9713-849501465bee-image-registry-private-configuration\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:56:15.607620 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.607619 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41065dd3-8325-4037-9713-849501465bee-trusted-ca\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:56:15.607782 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.607628 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-bound-sa-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:56:15.607782 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.607639 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41065dd3-8325-4037-9713-849501465bee-installation-pull-secrets\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:56:15.607782 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.607651 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41065dd3-8325-4037-9713-849501465bee-registry-certificates\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:56:15.607782 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.607661 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-st48t\" (UniqueName: \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-kube-api-access-st48t\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:56:15.717255 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.717230 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-kgzkz-wqj59"] Oct 31 00:56:15.720405 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:56:15.720306 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc0276d_1f7a_46e1_9b6d_34ed7595f3c5.slice/crio-bf3cd60ef6a76cbfd77fdd4af4d53843a3e0d7f9132680f095101d988dee1abf WatchSource:0}: Error finding container bf3cd60ef6a76cbfd77fdd4af4d53843a3e0d7f9132680f095101d988dee1abf: Status 404 returned error can't find the container with id bf3cd60ef6a76cbfd77fdd4af4d53843a3e0d7f9132680f095101d988dee1abf Oct 31 00:56:15.720876 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.720856 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-gqgf7-x4kfr"] Oct 31 00:56:15.722764 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:56:15.722741 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3737c365_6bb7_4e45_a487_5a6ed8eda295.slice/crio-623cf6bc7f1411291483e34bb2e2037270fe2ca00f5d112901dddae279229715 WatchSource:0}: Error finding container 623cf6bc7f1411291483e34bb2e2037270fe2ca00f5d112901dddae279229715: Status 404 returned error can't find the container with id 623cf6bc7f1411291483e34bb2e2037270fe2ca00f5d112901dddae279229715 Oct 31 00:56:15.784977 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.784959 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-66jgl"] Oct 31 00:56:15.788644 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:56:15.788612 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e53a8a_f8cb_4821_bd6b_ee63d0e25623.slice/crio-bd607c44404b912d6dbd433803ce7b66e4e8294b684dae4c841c1ea26a44f0f9 WatchSource:0}: Error finding container bd607c44404b912d6dbd433803ce7b66e4e8294b684dae4c841c1ea26a44f0f9: Status 404 returned error can't find the container with id bd607c44404b912d6dbd433803ce7b66e4e8294b684dae4c841c1ea26a44f0f9 Oct 31 00:56:15.911904 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.911866 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:15.915187 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:15.914944 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:16.012584 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.012488 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rsxrp\" (UID: \"9fb838b9-ac5c-4029-9f11-98b610e5b375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:56:16.012584 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.012545 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:16.012739 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.012651 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-znxnl\" (UID: \"fe4d93b4-1929-4fbe-9bf3-834f03268472\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:56:16.013129 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.013109 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:16.015015 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.014996 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-znxnl\" (UID: \"fe4d93b4-1929-4fbe-9bf3-834f03268472\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:56:16.015072 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.015028 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rsxrp\" (UID: \"9fb838b9-ac5c-4029-9f11-98b610e5b375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:56:16.113293 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.113253 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fb9mh\" (UID: \"a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fb9mh" Oct 31 00:56:16.113447 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.113343 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:56:16.115609 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.115585 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fb9mh\" (UID: \"a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fb9mh" Oct 31 00:56:16.115715 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.115625 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls\") pod \"image-registry-68f7b65f66-27ggn\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:56:16.170725 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.170700 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xgrpm\"" Oct 31 00:56:16.177822 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.177801 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:16.202710 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.202691 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-z766m\"" Oct 31 00:56:16.210816 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.210798 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:16.215099 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.213729 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls\" (UniqueName: \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls\") pod \"41065dd3-8325-4037-9713-849501465bee\" (UID: \"41065dd3-8325-4037-9713-849501465bee\") " Oct 31 00:56:16.215099 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.213942 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:56:16.215372 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.215171 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dxd8s\"" Oct 31 00:56:16.216445 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.216419 2579 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls" pod "41065dd3-8325-4037-9713-849501465bee" (UID: "41065dd3-8325-4037-9713-849501465bee"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:56:16.216974 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.216955 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:56:16.224837 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.222824 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:56:16.266904 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.266830 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4k65v\"" Oct 31 00:56:16.276590 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.275234 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:56:16.315097 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.315063 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41065dd3-8325-4037-9713-849501465bee-registry-tls\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:56:16.327988 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.327961 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-9n8qj\"" Oct 31 00:56:16.336123 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.335732 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-fb9mh" Oct 31 00:56:16.402543 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.402504 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" event={"ID":"3737c365-6bb7-4e45-a487-5a6ed8eda295","Type":"ContainerStarted","Data":"d0e7bad687cd6f20e987a295b2a86ac6b43f2395999b7efd0b731992dcce03e4"} Oct 31 00:56:16.402677 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.402626 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" event={"ID":"3737c365-6bb7-4e45-a487-5a6ed8eda295","Type":"ContainerStarted","Data":"623cf6bc7f1411291483e34bb2e2037270fe2ca00f5d112901dddae279229715"} Oct 31 00:56:16.405990 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.405966 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-66jgl" event={"ID":"03e53a8a-f8cb-4821-bd6b-ee63d0e25623","Type":"ContainerStarted","Data":"8a2413cb0ad714f218ebcbdbb54b26a0e293655ba80605dde136bd28c8080273"} Oct 31 00:56:16.406529 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.406393 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-66jgl" event={"ID":"03e53a8a-f8cb-4821-bd6b-ee63d0e25623","Type":"ContainerStarted","Data":"bd607c44404b912d6dbd433803ce7b66e4e8294b684dae4c841c1ea26a44f0f9"} Oct 31 00:56:16.408472 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.408457 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68f7b65f66-27ggn" Oct 31 00:56:16.409060 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.408886 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-kgzkz-wqj59" event={"ID":"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5","Type":"ContainerStarted","Data":"876bab5f7a370fcae5e80132f586652b476838b692de9b5b5b07c9f727b97f4f"} Oct 31 00:56:16.409060 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.409041 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-kgzkz-wqj59" event={"ID":"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5","Type":"ContainerStarted","Data":"bf3cd60ef6a76cbfd77fdd4af4d53843a3e0d7f9132680f095101d988dee1abf"} Oct 31 00:56:16.431173 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.431133 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" podStartSLOduration=1.431122605 podStartE2EDuration="1.431122605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:56:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:56:16.430389739 +0000 UTC m=+65.852354294" watchObservedRunningTime="2026-10-31 00:56:16.431122605 +0000 UTC m=+65.853087136" Oct 31 00:56:16.457873 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.457847 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-786bfcf6b7-n7gm9"] Oct 31 00:56:16.459002 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.458976 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-72bs2\"" Oct 31 00:56:16.463321 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:56:16.463300 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfccb0eb9_af8a_494e_b629_37a428d87ea5.slice/crio-5e4324985f86cec518f63e5371a1092224ab27f0e3a94b14bfee0bf809ec8be7 WatchSource:0}: Error finding container 5e4324985f86cec518f63e5371a1092224ab27f0e3a94b14bfee0bf809ec8be7: Status 404 returned error can't find the container with id 5e4324985f86cec518f63e5371a1092224ab27f0e3a94b14bfee0bf809ec8be7 Oct 31 00:56:16.466161 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.466142 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kg2kz" Oct 31 00:56:16.471193 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.471175 2579 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68f7b65f66-27ggn"] Oct 31 00:56:16.476028 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.476006 2579 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68f7b65f66-27ggn"] Oct 31 00:56:16.503986 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.503939 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-kgzkz-wqj59" podStartSLOduration=1.503925103 podStartE2EDuration="1.503925103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:56:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:56:16.503156587 +0000 UTC m=+65.925121119" watchObservedRunningTime="2026-10-31 00:56:16.503925103 +0000 UTC m=+65.925889634" Oct 31 00:56:16.508767 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.508744 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-788b97d875-vrvqf"] Oct 31 00:56:16.517725 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.517704 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl"] Oct 31 00:56:16.521421 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:56:16.521396 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode51caef4_2776_4216_9143_2c07435c062b.slice/crio-7bfe63663352988c9221141cd28716101dbb706234e1b3adeb3787a6a5a345ca WatchSource:0}: Error finding container 7bfe63663352988c9221141cd28716101dbb706234e1b3adeb3787a6a5a345ca: Status 404 returned error can't find the container with id 7bfe63663352988c9221141cd28716101dbb706234e1b3adeb3787a6a5a345ca Oct 31 00:56:16.521952 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:56:16.521917 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe4d93b4_1929_4fbe_9bf3_834f03268472.slice/crio-61963d0d602361e419f13ec7172bd0f4f319bbbb7143c0e35944769e065359e6 WatchSource:0}: Error finding container 61963d0d602361e419f13ec7172bd0f4f319bbbb7143c0e35944769e065359e6: Status 404 returned error can't find the container with id 61963d0d602361e419f13ec7172bd0f4f319bbbb7143c0e35944769e065359e6 Oct 31 00:56:16.612809 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.612726 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp"] Oct 31 00:56:16.630580 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.630534 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-fb9mh"] Oct 31 00:56:16.636762 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:56:16.636730 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8fe7c8e_5707_47c2_82e9_f1dbe51d1a51.slice/crio-720be370902f1282f3b4eb2840d68e21773874c9ddacef1b0ee4557dbdd6e8bf WatchSource:0}: Error finding container 720be370902f1282f3b4eb2840d68e21773874c9ddacef1b0ee4557dbdd6e8bf: Status 404 returned error can't find the container with id 720be370902f1282f3b4eb2840d68e21773874c9ddacef1b0ee4557dbdd6e8bf Oct 31 00:56:16.764146 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.764121 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kg2kz"] Oct 31 00:56:16.767520 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:56:16.767462 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedf682ca_dae8_42a1_a573_0995bbb7188d.slice/crio-2e3fe36b22cd9c673702a5c7682dbc42b9da359d298d88561386f76831aab893 WatchSource:0}: Error finding container 2e3fe36b22cd9c673702a5c7682dbc42b9da359d298d88561386f76831aab893: Status 404 returned error can't find the container with id 2e3fe36b22cd9c673702a5c7682dbc42b9da359d298d88561386f76831aab893 Oct 31 00:56:16.819709 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.819687 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs\") pod \"network-metrics-daemon-4bzzq\" (UID: \"159fdfbd-fdcc-4655-b273-f0964617ed13\") " pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:56:16.819821 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.819722 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:56:16.822968 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.822941 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 31 00:56:16.822968 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.822945 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 31 00:56:16.832602 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.832579 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:56:16.832688 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.832579 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs\") pod \"network-metrics-daemon-4bzzq\" (UID: \"159fdfbd-fdcc-4655-b273-f0964617ed13\") " pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:56:16.856578 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.856535 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-xb7hg\"" Oct 31 00:56:16.863647 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.863625 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:56:16.870498 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.870475 2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-89pfs\"" Oct 31 00:56:16.877542 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:16.877520 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:56:17.034569 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:17.034486 2579 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="41065dd3-8325-4037-9713-849501465bee" path="/var/lib/kubelet/pods/41065dd3-8325-4037-9713-849501465bee/volumes" Oct 31 00:56:17.145101 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:17.145066 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wtcjv"] Oct 31 00:56:17.147919 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:56:17.147894 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d207e59_c491_43cb_a331_5b89a78f470c.slice/crio-3a83a3f55a00baa4436649f6e7086410ffafccb32c6aae404e206ad6ed2d456b WatchSource:0}: Error finding container 3a83a3f55a00baa4436649f6e7086410ffafccb32c6aae404e206ad6ed2d456b: Status 404 returned error can't find the container with id 3a83a3f55a00baa4436649f6e7086410ffafccb32c6aae404e206ad6ed2d456b Oct 31 00:56:17.167777 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:17.167715 2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4bzzq"] Oct 31 00:56:17.170050 ip-10-0-132-179 kubenswrapper[2579]: W1031 00:56:17.170020 2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod159fdfbd_fdcc_4655_b273_f0964617ed13.slice/crio-56e14829bb5be1872c2b183c2c3f089aad1f32b42c2f0db1e147ef6bb1dfac51 WatchSource:0}: Error finding container 56e14829bb5be1872c2b183c2c3f089aad1f32b42c2f0db1e147ef6bb1dfac51: Status 404 returned error can't find the container with id 56e14829bb5be1872c2b183c2c3f089aad1f32b42c2f0db1e147ef6bb1dfac51 Oct 31 00:56:17.417036 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:17.416992 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" event={"ID":"fe4d93b4-1929-4fbe-9bf3-834f03268472","Type":"ContainerStarted","Data":"61963d0d602361e419f13ec7172bd0f4f319bbbb7143c0e35944769e065359e6"} Oct 31 00:56:17.418478 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:17.418447 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kg2kz" event={"ID":"edf682ca-dae8-42a1-a573-0995bbb7188d","Type":"ContainerStarted","Data":"2e3fe36b22cd9c673702a5c7682dbc42b9da359d298d88561386f76831aab893"} Oct 31 00:56:17.421797 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:17.421769 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" event={"ID":"fccb0eb9-af8a-494e-b629-37a428d87ea5","Type":"ContainerStarted","Data":"cde7039986a3ebfed9012f7d6cd75cba7d7e071c4a462fa244d635916a1d50e5"} Oct 31 00:56:17.421905 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:17.421816 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" event={"ID":"fccb0eb9-af8a-494e-b629-37a428d87ea5","Type":"ContainerStarted","Data":"5e4324985f86cec518f63e5371a1092224ab27f0e3a94b14bfee0bf809ec8be7"} Oct 31 00:56:17.421905 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:17.421871 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:17.423603 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:17.423531 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4bzzq" event={"ID":"159fdfbd-fdcc-4655-b273-f0964617ed13","Type":"ContainerStarted","Data":"56e14829bb5be1872c2b183c2c3f089aad1f32b42c2f0db1e147ef6bb1dfac51"} Oct 31 00:56:17.426329 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:17.426304 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-fb9mh" event={"ID":"a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51","Type":"ContainerStarted","Data":"720be370902f1282f3b4eb2840d68e21773874c9ddacef1b0ee4557dbdd6e8bf"} Oct 31 00:56:17.427751 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:17.427728 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wtcjv" event={"ID":"6d207e59-c491-43cb-a331-5b89a78f470c","Type":"ContainerStarted","Data":"3a83a3f55a00baa4436649f6e7086410ffafccb32c6aae404e206ad6ed2d456b"} Oct 31 00:56:17.430690 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:17.430664 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-788b97d875-vrvqf" event={"ID":"e51caef4-2776-4216-9143-2c07435c062b","Type":"ContainerStarted","Data":"8ff6f9c9feace432335db729ebd59b987372f5221299f48ddf25b2c12f480765"} Oct 31 00:56:17.430786 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:17.430707 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-788b97d875-vrvqf" event={"ID":"e51caef4-2776-4216-9143-2c07435c062b","Type":"ContainerStarted","Data":"7bfe63663352988c9221141cd28716101dbb706234e1b3adeb3787a6a5a345ca"} Oct 31 00:56:17.432928 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:17.432906 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" event={"ID":"9fb838b9-ac5c-4029-9f11-98b610e5b375","Type":"ContainerStarted","Data":"1ade9bce13703eda75a9543fc2ee307e596ff048dcbf9053da1f66e614997986"} Oct 31 00:56:17.436567 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:17.436494 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-66jgl" event={"ID":"03e53a8a-f8cb-4821-bd6b-ee63d0e25623","Type":"ContainerStarted","Data":"0678c96b8bdadbad172ff41ec9c7ba29318c1deab7a0953a820c0d691b682c66"} Oct 31 00:56:17.444998 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:17.444953 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" podStartSLOduration=65.444937186 podStartE2EDuration="1m5.444937186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:55:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:56:17.443473053 +0000 UTC m=+66.865437597" watchObservedRunningTime="2026-10-31 00:56:17.444937186 +0000 UTC m=+66.866901714" Oct 31 00:56:18.211921 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:18.211888 2579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:18.215072 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:18.214832 2579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:18.247653 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:18.246458 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/router-default-788b97d875-vrvqf" podStartSLOduration=411.246440362 podStartE2EDuration="6m51.246440362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:49:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:56:17.46795343 +0000 UTC m=+66.889917977" watchObservedRunningTime="2026-10-31 00:56:18.246440362 +0000 UTC m=+67.668404897" Oct 31 00:56:18.441431 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:18.441295 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:18.442706 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:18.442479 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:18.890953 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:18.890922 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-twq8q_f6434cdd-b8a7-4fdb-ab00-53f19ce35b98/dns-node-resolver/0.log" Oct 31 00:56:18.906476 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:18.906450 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-twq8q_f6434cdd-b8a7-4fdb-ab00-53f19ce35b98/dns-node-resolver/0.log" Oct 31 00:56:19.090258 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:19.090232 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-786bfcf6b7-n7gm9_fccb0eb9-af8a-494e-b629-37a428d87ea5/registry/0.log" Oct 31 00:56:19.090792 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:19.090725 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-786bfcf6b7-n7gm9_fccb0eb9-af8a-494e-b629-37a428d87ea5/registry/0.log" Oct 31 00:56:19.447486 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:19.447452 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-fb9mh" event={"ID":"a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51","Type":"ContainerStarted","Data":"a6943d278dbde20859b37e344ff24980f611fb2ab98ed8046a6269baf2bd6bd3"} Oct 31 00:56:19.450979 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:19.450953 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-66jgl" event={"ID":"03e53a8a-f8cb-4821-bd6b-ee63d0e25623","Type":"ContainerStarted","Data":"9a519a76aa9b2a5a366370ce643b3b45570bdad2bff1de67a46ea7d31e22bbe7"} Oct 31 00:56:19.453910 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:19.453889 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4bzzq" event={"ID":"159fdfbd-fdcc-4655-b273-f0964617ed13","Type":"ContainerStarted","Data":"57e265ae634ca8967f2ed489661e61745057edbd8858315edb2e5394f2d985ae"} Oct 31 00:56:19.454010 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:19.453931 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4bzzq" event={"ID":"159fdfbd-fdcc-4655-b273-f0964617ed13","Type":"ContainerStarted","Data":"2b5df35ce2ebf5f448087d3f6013218c629aab1f8d6534e8d522fd1d966d38c9"} Oct 31 00:56:19.466524 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:19.466475 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-86c478bb88-fb9mh" podStartSLOduration=374.511293039 podStartE2EDuration="6m16.466458549s" totalImagesPullingTime="1.95516551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:56:19.46443486 +0000 UTC m=+68.886399395" watchObservedRunningTime="2026-10-31 00:56:19.466458549 +0000 UTC m=+68.888423084" Oct 31 00:56:19.494134 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:19.494100 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6mv8k_9b23111a-a892-4d92-990d-742a857450fa/node-ca/0.log" Oct 31 00:56:19.494293 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:19.494143 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6mv8k_9b23111a-a892-4d92-990d-742a857450fa/node-ca/0.log" Oct 31 00:56:19.509900 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:19.509115 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4bzzq" podStartSLOduration=66.631083602 podStartE2EDuration="1m8.509084566s" totalImagesPullingTime="1.878000964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:56:19.486179895 +0000 UTC m=+68.908144432" watchObservedRunningTime="2026-10-31 00:56:19.509084566 +0000 UTC m=+68.931049093" Oct 31 00:56:19.509900 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:19.509334 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-66jgl" podStartSLOduration=1.363291963 podStartE2EDuration="4.509328476s" totalImagesPullingTime="3.146036513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:56:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:56:19.50750561 +0000 UTC m=+68.929470167" watchObservedRunningTime="2026-10-31 00:56:19.509328476 +0000 UTC m=+68.931293013" Oct 31 00:56:20.097257 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:20.097183 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-788b97d875-vrvqf_e51caef4-2776-4216-9143-2c07435c062b/router/0.log" Oct 31 00:56:20.097257 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:20.097213 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-788b97d875-vrvqf_e51caef4-2776-4216-9143-2c07435c062b/router/0.log" Oct 31 00:56:20.459358 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:20.458870 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" event={"ID":"fe4d93b4-1929-4fbe-9bf3-834f03268472","Type":"ContainerStarted","Data":"078e8dd1afdae2a4a0d84e0e2cc59bba3fc7e212bd715b2dc592cb6ad6a7d43f"} Oct 31 00:56:20.461271 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:20.461186 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kg2kz" event={"ID":"edf682ca-dae8-42a1-a573-0995bbb7188d","Type":"ContainerStarted","Data":"ec1c214428031cc805473702ac0dd2aa4cfcadcd05dc01561b4591415852636d"} Oct 31 00:56:20.461271 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:20.461238 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kg2kz" event={"ID":"edf682ca-dae8-42a1-a573-0995bbb7188d","Type":"ContainerStarted","Data":"b46714b259c0bc9dea49e69740d5bd6c7f4bccb407656f6eca021e05a3b4f8ca"} Oct 31 00:56:20.461737 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:20.461717 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kg2kz" Oct 31 00:56:20.481022 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:20.480924 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" podStartSLOduration=410.609239818 podStartE2EDuration="6m53.480906789s" totalImagesPullingTime="2.871666971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:56:20.479039375 +0000 UTC m=+69.901003930" watchObservedRunningTime="2026-10-31 00:56:20.480906789 +0000 UTC m=+69.902871322" Oct 31 00:56:20.501207 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:20.501149 2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-kg2kz" podStartSLOduration=34.607509772 podStartE2EDuration="37.501134016s" totalImagesPullingTime="2.893624244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:55:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:56:20.500030001 +0000 UTC m=+69.921994560" watchObservedRunningTime="2026-10-31 00:56:20.501134016 +0000 UTC m=+69.923098547" Oct 31 00:56:20.689027 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:20.688992 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wqhkd_42d46af4-addb-42c6-a15f-d1b717fb91b8/serve-healthcheck-canary/0.log" Oct 31 00:56:20.689027 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:20.689013 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wqhkd_42d46af4-addb-42c6-a15f-d1b717fb91b8/serve-healthcheck-canary/0.log" Oct 31 00:56:22.308140 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:22.308110 2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:56:22.473924 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:22.473891 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" event={"ID":"9fb838b9-ac5c-4029-9f11-98b610e5b375","Type":"ContainerStarted","Data":"555d575fa2579a3ae91172e3a643d2fafa8c5bd25fbab3b8f5690d22113b3644"} Oct 31 00:56:22.474107 ip-10-0-132-179 kubenswrapper[2579]: I1031 00:56:22.473950 2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" event={"ID":"9fb838b9-ac5c-4029-9f11-98b610e5b375","Type":"ContainerStarted","Data":"0183f5d59d1b1fe9c44ed40279045d9c44ca042b21ab848ea138d4eab4d3702d"} Oct 31 00:56:23.362357 ip-10-0-132-179 systemd[1]: Stopping Kubernetes Kubelet... Oct 31 00:56:23.373970 ip-10-0-132-179 systemd[1]: kubelet.service: Deactivated successfully. Oct 31 00:56:23.374136 ip-10-0-132-179 systemd[1]: Stopped Kubernetes Kubelet. Oct 31 00:56:23.374301 ip-10-0-132-179 systemd[1]: kubelet.service: Consumed 4.290s CPU time. Oct 31 00:56:23.389108 ip-10-0-132-179 systemd[1]: Starting Kubernetes Kubelet... Oct 31 00:56:23.475944 ip-10-0-132-179 kubenswrapper[5821]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 00:56:23.475944 ip-10-0-132-179 kubenswrapper[5821]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 31 00:56:23.475944 ip-10-0-132-179 kubenswrapper[5821]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 00:56:23.475944 ip-10-0-132-179 kubenswrapper[5821]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 31 00:56:23.478027 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.477942 5821 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:56:23.478027 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478026 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:56:23.478027 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478030 5821 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:56:23.478130 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478034 5821 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:56:23.478130 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478037 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:56:23.478130 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478040 5821 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:56:23.478130 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478042 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:56:23.478130 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478045 5821 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:56:23.478130 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478048 5821 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:56:23.478130 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478050 5821 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:56:23.478130 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478053 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:56:23.478130 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478056 5821 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:56:23.478130 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478059 5821 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:56:23.478130 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478062 5821 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:56:23.478130 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478064 5821 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:56:23.478130 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478067 5821 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:56:23.478130 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478070 5821 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:56:23.478130 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478072 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:56:23.478130 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478075 5821 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:56:23.478130 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478077 5821 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:56:23.478130 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478080 5821 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:56:23.478130 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478083 5821 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:56:23.478130 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478085 5821 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:56:23.478625 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478088 5821 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:56:23.478625 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478090 5821 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:56:23.478625 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478093 5821 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:56:23.478625 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478103 5821 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:56:23.478625 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478106 5821 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:56:23.478625 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478111 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:56:23.478625 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478113 5821 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:56:23.478625 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478116 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:56:23.478625 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478119 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:56:23.478625 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478122 5821 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:56:23.478625 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478125 5821 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:56:23.478625 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478128 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:56:23.478625 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478130 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:56:23.478625 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478133 5821 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:56:23.478625 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478136 5821 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:56:23.478625 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478139 5821 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:56:23.478625 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478142 5821 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:56:23.478625 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478145 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:56:23.478625 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478147 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:56:23.479091 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478150 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:56:23.479091 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478153 5821 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:56:23.479091 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478155 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:56:23.479091 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478158 5821 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:56:23.479091 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478161 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:56:23.479091 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478163 5821 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:56:23.479091 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478166 5821 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:56:23.479091 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478168 5821 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:56:23.479091 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478171 5821 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:56:23.479091 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478173 5821 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:56:23.479091 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478176 5821 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:56:23.479091 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478180 5821 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:56:23.479091 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478182 5821 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:56:23.479091 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478187 5821 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:56:23.479091 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478191 5821 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:56:23.479091 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478195 5821 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:56:23.479091 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478198 5821 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:56:23.479091 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478201 5821 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:56:23.479091 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478204 5821 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:56:23.479559 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478207 5821 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:56:23.479559 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478210 5821 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:56:23.479559 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478212 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:56:23.479559 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478215 5821 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:56:23.479559 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478218 5821 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:56:23.479559 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478220 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:56:23.479559 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478223 5821 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:56:23.479559 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478226 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:56:23.479559 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478228 5821 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:56:23.479559 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478231 5821 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:56:23.479559 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478233 5821 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:56:23.479559 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478236 5821 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:56:23.479559 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478239 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:56:23.479559 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478242 5821 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:56:23.479559 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478244 5821 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:56:23.479559 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478247 5821 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:56:23.479559 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478249 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:56:23.479559 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478252 5821 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:56:23.479559 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478254 5821 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:56:23.480017 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478257 5821 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:56:23.480017 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478260 5821 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:56:23.480017 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478262 5821 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:56:23.480017 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478265 5821 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:56:23.480017 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478268 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:56:23.480017 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478272 5821 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:56:23.480017 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478275 5821 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:56:23.480017 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478278 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:56:23.480017 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478282 5821 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:56:23.480017 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478284 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:56:23.480017 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478287 5821 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:56:23.480017 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478290 5821 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:56:23.480017 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478292 5821 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:56:23.480017 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478295 5821 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:56:23.480017 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478298 5821 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:56:23.480017 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478300 5821 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:56:23.480017 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478303 5821 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:56:23.480017 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478305 5821 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:56:23.480017 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478308 5821 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:56:23.480470 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478310 5821 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:56:23.480470 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478313 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:56:23.480470 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478315 5821 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:56:23.480470 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478318 5821 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:56:23.480470 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478320 5821 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:56:23.480470 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478324 5821 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:56:23.480470 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.478326 5821 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:56:23.480470 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479144 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:56:23.480470 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479152 5821 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:56:23.480470 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479156 5821 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:56:23.480470 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479159 5821 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:56:23.480470 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479162 5821 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:56:23.480470 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479164 5821 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:56:23.480470 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479167 5821 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:56:23.480470 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479170 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:56:23.480470 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479172 5821 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:56:23.480470 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479175 5821 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:56:23.480470 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479177 5821 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:56:23.480470 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479180 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:56:23.480949 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479183 5821 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:56:23.480949 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479185 5821 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:56:23.480949 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479188 5821 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:56:23.480949 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479198 5821 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:56:23.480949 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479201 5821 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:56:23.480949 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479204 5821 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:56:23.480949 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479207 5821 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:56:23.480949 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479209 5821 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:56:23.480949 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479213 5821 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:56:23.480949 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479215 5821 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:56:23.480949 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479218 5821 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:56:23.480949 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479220 5821 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:56:23.480949 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479223 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:56:23.480949 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479226 5821 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:56:23.480949 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479228 5821 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:56:23.480949 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479231 5821 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:56:23.480949 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479233 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:56:23.480949 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479236 5821 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:56:23.480949 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479239 5821 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:56:23.480949 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479244 5821 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:56:23.481433 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479247 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:56:23.481433 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479249 5821 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:56:23.481433 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479252 5821 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:56:23.481433 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479255 5821 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:56:23.481433 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479257 5821 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:56:23.481433 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479260 5821 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:56:23.481433 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479263 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:56:23.481433 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479265 5821 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:56:23.481433 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479268 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:56:23.481433 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479271 5821 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:56:23.481433 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479273 5821 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:56:23.481433 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479276 5821 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:56:23.481433 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479279 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:56:23.481433 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479281 5821 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:56:23.481433 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479284 5821 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:56:23.481433 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479286 5821 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:56:23.481433 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479295 5821 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:56:23.481433 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479297 5821 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:56:23.481433 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479300 5821 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:56:23.481433 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479303 5821 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:56:23.481953 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479306 5821 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:56:23.481953 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479308 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:56:23.481953 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479311 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:56:23.481953 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479313 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:56:23.481953 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479316 5821 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:56:23.481953 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479318 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:56:23.481953 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479321 5821 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:56:23.481953 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479324 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:56:23.481953 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479329 5821 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:56:23.481953 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479333 5821 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:56:23.481953 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479335 5821 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:56:23.481953 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479341 5821 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:56:23.481953 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479344 5821 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:56:23.481953 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479346 5821 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:56:23.481953 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479349 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:56:23.481953 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479352 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:56:23.481953 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479354 5821 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:56:23.481953 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479357 5821 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:56:23.481953 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479361 5821 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:56:23.482430 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479364 5821 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:56:23.482430 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479368 5821 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:56:23.482430 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479370 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:56:23.482430 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479373 5821 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:56:23.482430 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479375 5821 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:56:23.482430 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479378 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:56:23.482430 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479381 5821 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:56:23.482430 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479383 5821 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:56:23.482430 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479386 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:56:23.482430 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479388 5821 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:56:23.482430 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479396 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:56:23.482430 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479399 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:56:23.482430 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479402 5821 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:56:23.482430 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479405 5821 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:56:23.482430 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479409 5821 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:56:23.482430 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479413 5821 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:56:23.482430 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479416 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:56:23.482430 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479419 5821 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:56:23.482430 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479421 5821 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:56:23.482901 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479424 5821 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:56:23.482901 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479426 5821 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:56:23.482901 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479429 5821 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:56:23.482901 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479431 5821 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:56:23.482901 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479434 5821 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:56:23.482901 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479438 5821 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:56:23.482901 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479441 5821 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:56:23.482901 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479444 5821 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:56:23.482901 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479446 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:56:23.482901 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479449 5821 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:56:23.482901 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479451 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:56:23.482901 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479454 5821 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:56:23.482901 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479458 5821 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:56:23.482901 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479461 5821 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:56:23.482901 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479464 5821 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:56:23.482901 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.479470 5821 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:56:23.482901 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480001 5821 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:56:23.482901 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480008 5821 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:56:23.482901 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480012 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:56:23.482901 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480014 5821 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:56:23.483444 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480017 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:56:23.483444 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480020 5821 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:56:23.483444 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480023 5821 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:56:23.483444 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480027 5821 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:56:23.483444 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480030 5821 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:56:23.483444 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480033 5821 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:56:23.483444 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480036 5821 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:56:23.483444 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480038 5821 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:56:23.483444 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480041 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:56:23.483444 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480044 5821 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:56:23.483444 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480047 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:56:23.483444 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480050 5821 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:56:23.483444 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480053 5821 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:56:23.483444 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480056 5821 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:56:23.483444 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480059 5821 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:56:23.483444 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480061 5821 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:56:23.483444 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480064 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:56:23.483444 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480067 5821 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:56:23.483444 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480070 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:56:23.483910 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480073 5821 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:56:23.483910 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480075 5821 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:56:23.483910 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480078 5821 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:56:23.483910 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480080 5821 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:56:23.483910 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480083 5821 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:56:23.483910 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480086 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:56:23.483910 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480089 5821 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:56:23.483910 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480092 5821 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:56:23.483910 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480094 5821 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:56:23.483910 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480097 5821 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:56:23.483910 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480099 5821 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:56:23.483910 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480102 5821 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:56:23.483910 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480104 5821 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:56:23.483910 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480107 5821 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:56:23.483910 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480110 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:56:23.483910 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480112 5821 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:56:23.483910 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480115 5821 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:56:23.483910 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480118 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:56:23.483910 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480120 5821 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:56:23.483910 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480123 5821 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:56:23.484413 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480125 5821 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:56:23.484413 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480128 5821 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:56:23.484413 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480131 5821 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:56:23.484413 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480133 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:56:23.484413 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480136 5821 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:56:23.484413 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480138 5821 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:56:23.484413 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480141 5821 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:56:23.484413 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480143 5821 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:56:23.484413 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480146 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:56:23.484413 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480148 5821 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:56:23.484413 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480151 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:56:23.484413 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480154 5821 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:56:23.484413 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480157 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:56:23.484413 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480160 5821 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:56:23.484413 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480162 5821 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:56:23.484413 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480165 5821 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:56:23.484413 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480170 5821 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:56:23.484413 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480174 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:56:23.484413 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480176 5821 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:56:23.484886 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480179 5821 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:56:23.484886 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480182 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:56:23.484886 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480185 5821 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:56:23.484886 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480188 5821 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:56:23.484886 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480190 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:56:23.484886 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480193 5821 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:56:23.484886 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480196 5821 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:56:23.484886 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480198 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:56:23.484886 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480201 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:56:23.484886 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480203 5821 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:56:23.484886 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480206 5821 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:56:23.484886 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480209 5821 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:56:23.484886 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480211 5821 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:56:23.484886 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480214 5821 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:56:23.484886 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480217 5821 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:56:23.484886 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480219 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:56:23.484886 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480222 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:56:23.484886 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480224 5821 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:56:23.484886 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480227 5821 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:56:23.484886 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480230 5821 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:56:23.485362 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480232 5821 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:56:23.485362 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480234 5821 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:56:23.485362 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480237 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:56:23.485362 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480240 5821 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:56:23.485362 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480242 5821 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:56:23.485362 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480245 5821 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:56:23.485362 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480247 5821 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:56:23.485362 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480252 5821 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:56:23.485362 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480256 5821 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:56:23.485362 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480259 5821 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:56:23.485362 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480262 5821 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:56:23.485362 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480265 5821 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:56:23.485362 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480268 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:56:23.485362 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480270 5821 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:56:23.485362 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480274 5821 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:56:23.485362 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480276 5821 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:56:23.485362 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480279 5821 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:56:23.485362 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480281 5821 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:56:23.485362 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480284 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480286 5821 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480289 5821 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480291 5821 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480294 5821 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.480296 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480395 5821 flags.go:64] FLAG: --address="0.0.0.0" Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480405 5821 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480412 5821 flags.go:64] FLAG: --anonymous-auth="true" Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480417 5821 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480422 5821 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480426 5821 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480430 5821 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480436 5821 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480439 5821 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480442 5821 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480446 5821 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480449 5821 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480452 5821 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480455 5821 flags.go:64] FLAG: --cgroup-root="" Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480458 5821 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480461 5821 flags.go:64] FLAG: --client-ca-file="" Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480464 5821 flags.go:64] FLAG: --cloud-provider="external" Oct 31 00:56:23.485837 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480467 5821 flags.go:64] FLAG: --cluster-dns="[]" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480471 5821 flags.go:64] FLAG: --cluster-domain="" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480474 5821 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480477 5821 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480481 5821 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480484 5821 flags.go:64] FLAG: --container-log-max-files="5" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480488 5821 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480491 5821 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480494 5821 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480497 5821 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480501 5821 flags.go:64] FLAG: --contention-profiling="false" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480503 5821 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480506 5821 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480510 5821 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480513 5821 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480517 5821 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480520 5821 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480523 5821 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480526 5821 flags.go:64] FLAG: --enable-load-reader="false" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480529 5821 flags.go:64] FLAG: --enable-server="true" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480532 5821 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480536 5821 flags.go:64] FLAG: --event-burst="100" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480541 5821 flags.go:64] FLAG: --event-qps="50" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480545 5821 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 31 00:56:23.486397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480562 5821 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480567 5821 flags.go:64] FLAG: --eviction-hard="" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480571 5821 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480574 5821 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480577 5821 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480580 5821 flags.go:64] FLAG: --eviction-soft="" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480583 5821 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480586 5821 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480589 5821 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480592 5821 flags.go:64] FLAG: --experimental-mounter-path="" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480595 5821 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480598 5821 flags.go:64] FLAG: --fail-swap-on="true" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480601 5821 flags.go:64] FLAG: --feature-gates="" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480605 5821 flags.go:64] FLAG: --file-check-frequency="20s" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480608 5821 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480611 5821 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480614 5821 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480618 5821 flags.go:64] FLAG: --healthz-port="10248" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480620 5821 flags.go:64] FLAG: --help="false" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480623 5821 flags.go:64] FLAG: --hostname-override="ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480626 5821 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480630 5821 flags.go:64] FLAG: --http-check-frequency="20s" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480633 5821 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 31 00:56:23.487222 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480636 5821 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480639 5821 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480643 5821 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480646 5821 flags.go:64] FLAG: --image-service-endpoint="" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480649 5821 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480652 5821 flags.go:64] FLAG: --kube-api-burst="100" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480655 5821 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480660 5821 flags.go:64] FLAG: --kube-api-qps="50" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480664 5821 flags.go:64] FLAG: --kube-reserved="" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480667 5821 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480670 5821 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480673 5821 flags.go:64] FLAG: --kubelet-cgroups="" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480676 5821 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480679 5821 flags.go:64] FLAG: --lock-file="" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480682 5821 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480685 5821 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480688 5821 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480694 5821 flags.go:64] FLAG: --log-json-split-stream="false" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480697 5821 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480700 5821 flags.go:64] FLAG: --log-text-split-stream="false" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480703 5821 flags.go:64] FLAG: --logging-format="text" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480706 5821 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480710 5821 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480713 5821 flags.go:64] FLAG: --manifest-url="" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480716 5821 flags.go:64] FLAG: --manifest-url-header="" Oct 31 00:56:23.488129 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480721 5821 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480724 5821 flags.go:64] FLAG: --max-open-files="1000000" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480728 5821 flags.go:64] FLAG: --max-pods="110" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480732 5821 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480735 5821 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480738 5821 flags.go:64] FLAG: --memory-manager-policy="None" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480741 5821 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480744 5821 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480747 5821 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480750 5821 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480757 5821 flags.go:64] FLAG: --node-status-max-images="50" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480760 5821 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480763 5821 flags.go:64] FLAG: --oom-score-adj="-999" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480766 5821 flags.go:64] FLAG: --pod-cidr="" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480770 5821 flags.go:64] FLAG: --pod-manifest-path="" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480775 5821 flags.go:64] FLAG: --pod-max-pids="-1" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480778 5821 flags.go:64] FLAG: --pods-per-core="0" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480781 5821 flags.go:64] FLAG: --port="10250" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480784 5821 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480787 5821 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-088292b40cd502275" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480790 5821 flags.go:64] FLAG: --qos-reserved="" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480793 5821 flags.go:64] FLAG: --read-only-port="10255" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480796 5821 flags.go:64] FLAG: --register-node="true" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480799 5821 flags.go:64] FLAG: --register-with-taints="" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480806 5821 flags.go:64] FLAG: --registry-burst="10" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480809 5821 flags.go:64] FLAG: --registry-qps="5" Oct 31 00:56:23.489273 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480812 5821 flags.go:64] FLAG: --reserved-cpus="" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480815 5821 flags.go:64] FLAG: --reserved-memory="" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480819 5821 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480822 5821 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480825 5821 flags.go:64] FLAG: --rotate-certificates="false" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480828 5821 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480831 5821 flags.go:64] FLAG: --runonce="false" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480834 5821 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480837 5821 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480840 5821 flags.go:64] FLAG: --seccomp-default="false" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480843 5821 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480846 5821 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480849 5821 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480852 5821 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480855 5821 flags.go:64] FLAG: --storage-driver-password="root" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480858 5821 flags.go:64] FLAG: --storage-driver-secure="false" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480861 5821 flags.go:64] FLAG: --storage-driver-table="stats" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480864 5821 flags.go:64] FLAG: --storage-driver-user="root" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480867 5821 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480870 5821 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480875 5821 flags.go:64] FLAG: --system-cgroups="" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480879 5821 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480884 5821 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480887 5821 flags.go:64] FLAG: --tls-cert-file="" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480890 5821 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 31 00:56:23.490432 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480894 5821 flags.go:64] FLAG: --tls-min-version="" Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480897 5821 flags.go:64] FLAG: --tls-private-key-file="" Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480900 5821 flags.go:64] FLAG: --topology-manager-policy="none" Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480903 5821 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480906 5821 flags.go:64] FLAG: --topology-manager-scope="container" Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480909 5821 flags.go:64] FLAG: --v="2" Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480914 5821 flags.go:64] FLAG: --version="false" Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480918 5821 flags.go:64] FLAG: --vmodule="" Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480922 5821 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.480925 5821 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481062 5821 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481065 5821 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481068 5821 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481071 5821 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481074 5821 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481077 5821 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481079 5821 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481083 5821 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481086 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481089 5821 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481092 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481094 5821 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:56:23.491515 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481097 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:56:23.492440 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481100 5821 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:56:23.492440 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481102 5821 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:56:23.492440 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481108 5821 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:56:23.492440 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481111 5821 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:56:23.492440 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481117 5821 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:56:23.492440 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481122 5821 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:56:23.492440 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481125 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:56:23.492440 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481128 5821 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:56:23.492440 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481131 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:56:23.492440 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481134 5821 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:56:23.492440 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481137 5821 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:56:23.492440 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481140 5821 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:56:23.492440 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481142 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:56:23.492440 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481145 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:56:23.492440 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481147 5821 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:56:23.492440 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481150 5821 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:56:23.492440 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481153 5821 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:56:23.492440 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481155 5821 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:56:23.492440 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481158 5821 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:56:23.493414 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481161 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:56:23.493414 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481163 5821 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:56:23.493414 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481166 5821 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:56:23.493414 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481168 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:56:23.493414 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481171 5821 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:56:23.493414 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481173 5821 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:56:23.493414 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481176 5821 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:56:23.493414 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481179 5821 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:56:23.493414 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481182 5821 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:56:23.493414 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481184 5821 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:56:23.493414 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481187 5821 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:56:23.493414 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481190 5821 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:56:23.493414 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481192 5821 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:56:23.493414 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481195 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:56:23.493414 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481197 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:56:23.493414 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481200 5821 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:56:23.493414 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481203 5821 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:56:23.493414 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481207 5821 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:56:23.493414 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481211 5821 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:56:23.493414 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481214 5821 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:56:23.494016 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481217 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:56:23.494016 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481219 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:56:23.494016 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481222 5821 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:56:23.494016 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481224 5821 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:56:23.494016 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481227 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:56:23.494016 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481230 5821 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:56:23.494016 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481232 5821 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:56:23.494016 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481235 5821 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:56:23.494016 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481238 5821 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:56:23.494016 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481240 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:56:23.494016 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481243 5821 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:56:23.494016 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481245 5821 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:56:23.494016 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481248 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:56:23.494016 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481251 5821 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:56:23.494016 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481254 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:56:23.494016 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481258 5821 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:56:23.494016 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481262 5821 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:56:23.494016 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481265 5821 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:56:23.494016 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481268 5821 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:56:23.494545 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481271 5821 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:56:23.494545 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481274 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:56:23.494545 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481276 5821 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:56:23.494545 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481278 5821 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:56:23.494545 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481281 5821 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:56:23.494545 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481284 5821 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:56:23.494545 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481286 5821 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:56:23.494545 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481289 5821 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:56:23.494545 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481291 5821 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:56:23.494545 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481294 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:56:23.494545 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481298 5821 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:56:23.494545 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481302 5821 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:56:23.494545 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481305 5821 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:56:23.494545 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481308 5821 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:56:23.494545 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481310 5821 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:56:23.494545 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481313 5821 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:56:23.494545 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481316 5821 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:56:23.494545 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481318 5821 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:56:23.494545 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481321 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:56:23.494545 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481323 5821 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:56:23.495127 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481326 5821 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:56:23.495127 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481328 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:56:23.495127 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481331 5821 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:56:23.495127 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481334 5821 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:56:23.495127 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481336 5821 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:56:23.495127 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481339 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:56:23.495127 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481341 5821 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:56:23.495127 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481344 5821 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:56:23.495127 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481347 5821 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:56:23.495127 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481349 5821 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:56:23.495127 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481352 5821 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:56:23.495127 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481355 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:56:23.495127 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481357 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:56:23.495127 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481360 5821 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:56:23.495127 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481363 5821 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:56:23.495127 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.481389 5821 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 00:56:23.495573 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481422 5821 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:56:23.495573 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481427 5821 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:56:23.495573 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481430 5821 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:56:23.495573 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481433 5821 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:56:23.495573 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481436 5821 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:56:23.495573 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481439 5821 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:56:23.495573 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481441 5821 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:56:23.495573 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481447 5821 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:56:23.495573 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481450 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:56:23.495573 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481453 5821 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:56:23.495573 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481456 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:56:23.495573 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481458 5821 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:56:23.495573 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481461 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:56:23.495573 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481464 5821 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:56:23.495573 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481467 5821 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:56:23.495573 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481469 5821 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:56:23.495573 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481472 5821 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:56:23.495573 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481476 5821 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:56:23.495573 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481480 5821 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:56:23.496029 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481483 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:56:23.496029 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481485 5821 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:56:23.496029 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481488 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:56:23.496029 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481491 5821 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:56:23.496029 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481494 5821 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:56:23.496029 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481496 5821 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:56:23.496029 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481499 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:56:23.496029 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481501 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:56:23.496029 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481504 5821 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:56:23.496029 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481506 5821 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:56:23.496029 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481509 5821 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:56:23.496029 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481512 5821 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:56:23.496029 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481514 5821 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:56:23.496029 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481517 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:56:23.496029 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481519 5821 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:56:23.496029 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481522 5821 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:56:23.496029 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481525 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:56:23.496029 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481527 5821 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:56:23.496029 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481530 5821 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:56:23.496029 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481532 5821 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:56:23.496502 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481537 5821 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:56:23.496502 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481541 5821 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:56:23.496502 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481544 5821 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:56:23.496502 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481546 5821 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:56:23.496502 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481564 5821 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:56:23.496502 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481568 5821 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:56:23.496502 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481572 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:56:23.496502 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481576 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:56:23.496502 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481580 5821 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:56:23.496502 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481584 5821 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:56:23.496502 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481588 5821 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:56:23.496502 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481593 5821 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:56:23.496502 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481597 5821 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:56:23.496502 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481600 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:56:23.496502 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481603 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:56:23.496502 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481606 5821 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:56:23.496502 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481608 5821 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:56:23.496502 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481612 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:56:23.496502 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481615 5821 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:56:23.496502 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481617 5821 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:56:23.497080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481620 5821 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:56:23.497080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481622 5821 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:56:23.497080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481625 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:56:23.497080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481628 5821 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:56:23.497080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481630 5821 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:56:23.497080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481633 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:56:23.497080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481635 5821 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:56:23.497080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481638 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:56:23.497080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481642 5821 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:56:23.497080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481646 5821 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:56:23.497080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481649 5821 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:56:23.497080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481652 5821 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:56:23.497080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481657 5821 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:56:23.497080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481660 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:56:23.497080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481663 5821 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:56:23.497080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481666 5821 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:56:23.497080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481669 5821 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:56:23.497080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481671 5821 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:56:23.497080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481674 5821 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:56:23.497580 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481677 5821 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:56:23.497580 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481679 5821 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:56:23.497580 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481682 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:56:23.497580 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481685 5821 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:56:23.497580 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481687 5821 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:56:23.497580 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481690 5821 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:56:23.497580 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481692 5821 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:56:23.497580 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481695 5821 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:56:23.497580 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481698 5821 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:56:23.497580 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481700 5821 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:56:23.497580 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481703 5821 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:56:23.497580 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481713 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:56:23.497580 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481715 5821 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:56:23.497580 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481718 5821 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:56:23.497580 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481721 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:56:23.497580 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481723 5821 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:56:23.497580 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481726 5821 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:56:23.497580 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481728 5821 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:56:23.497580 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481731 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:56:23.498080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481734 5821 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:56:23.498080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481736 5821 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:56:23.498080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481739 5821 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:56:23.498080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481743 5821 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:56:23.498080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481745 5821 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:56:23.498080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481748 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:56:23.498080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481753 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:56:23.498080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481755 5821 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:56:23.498080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.481758 5821 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:56:23.498080 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.485978 5821 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 31 00:56:23.498080 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.485994 5821 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 31 00:56:23.498080 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.486010 5821 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 31 00:56:23.498080 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.486015 5821 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 31 00:56:23.498080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486092 5821 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:56:23.498080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486097 5821 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:56:23.498080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486101 5821 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:56:23.498080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486103 5821 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:56:23.498080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486106 5821 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:56:23.498080 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486109 5821 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:56:23.498593 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486111 5821 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:56:23.498593 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486114 5821 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:56:23.498593 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486117 5821 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:56:23.498593 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486120 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:56:23.498593 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486122 5821 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:56:23.498593 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486125 5821 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:56:23.498593 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486128 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:56:23.498593 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486137 5821 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:56:23.498593 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486140 5821 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:56:23.498593 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486143 5821 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:56:23.498593 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486146 5821 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:56:23.498593 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486148 5821 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:56:23.498593 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486151 5821 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:56:23.498593 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486154 5821 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:56:23.498593 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486157 5821 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:56:23.498593 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486160 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:56:23.498593 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486162 5821 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:56:23.498593 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486165 5821 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:56:23.498593 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486168 5821 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:56:23.498593 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486177 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:56:23.499105 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486180 5821 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:56:23.499105 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486183 5821 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:56:23.499105 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486185 5821 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:56:23.499105 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486188 5821 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:56:23.499105 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486191 5821 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:56:23.499105 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486193 5821 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:56:23.499105 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486196 5821 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:56:23.499105 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486199 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:56:23.499105 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486201 5821 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:56:23.499105 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486204 5821 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:56:23.499105 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486207 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:56:23.499105 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486209 5821 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:56:23.499105 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486212 5821 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:56:23.499105 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486215 5821 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:56:23.499105 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486217 5821 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:56:23.499105 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486220 5821 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:56:23.499105 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486223 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:56:23.499105 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486225 5821 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:56:23.499105 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486228 5821 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:56:23.499105 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486230 5821 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:56:23.499597 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486239 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:56:23.499597 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486242 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:56:23.499597 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486245 5821 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:56:23.499597 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486248 5821 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:56:23.499597 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486252 5821 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:56:23.499597 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486256 5821 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:56:23.499597 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486260 5821 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:56:23.499597 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486262 5821 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:56:23.499597 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486265 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:56:23.499597 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486268 5821 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:56:23.499597 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486271 5821 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:56:23.499597 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486273 5821 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:56:23.499597 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486277 5821 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:56:23.499597 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486281 5821 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:56:23.499597 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486284 5821 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:56:23.499597 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486286 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:56:23.499597 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486289 5821 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:56:23.499597 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486292 5821 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:56:23.499597 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486294 5821 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:56:23.500051 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486297 5821 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:56:23.500051 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486300 5821 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:56:23.500051 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486302 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:56:23.500051 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486305 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:56:23.500051 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486307 5821 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:56:23.500051 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486310 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:56:23.500051 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486312 5821 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:56:23.500051 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486315 5821 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:56:23.500051 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486318 5821 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:56:23.500051 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486320 5821 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:56:23.500051 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486323 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:56:23.500051 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486325 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:56:23.500051 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486328 5821 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:56:23.500051 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486330 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:56:23.500051 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486339 5821 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:56:23.500051 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486342 5821 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:56:23.500051 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486345 5821 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:56:23.500051 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486347 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:56:23.500051 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486350 5821 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:56:23.500530 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486353 5821 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:56:23.500530 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486355 5821 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:56:23.500530 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486358 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:56:23.500530 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486361 5821 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:56:23.500530 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486364 5821 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:56:23.500530 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486366 5821 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:56:23.500530 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486369 5821 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:56:23.500530 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486371 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:56:23.500530 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486374 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:56:23.500530 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486376 5821 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:56:23.500530 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486379 5821 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:56:23.500530 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486381 5821 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:56:23.500530 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486384 5821 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:56:23.500530 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486387 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:56:23.500530 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486389 5821 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:56:23.500530 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486391 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:56:23.500530 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486394 5821 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:56:23.500530 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486397 5821 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:56:23.500530 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486399 5821 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:56:23.501001 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486402 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:56:23.501001 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486405 5821 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:56:23.501001 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.486407 5821 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:56:23.501001 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.486435 5821 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 00:56:23.501001 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487331 5821 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:56:23.501001 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487367 5821 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:56:23.501001 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487374 5821 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:56:23.501001 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487381 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:56:23.501001 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487386 5821 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:56:23.501001 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487417 5821 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:56:23.501001 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487423 5821 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:56:23.501001 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487428 5821 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:56:23.501001 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487434 5821 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:56:23.501001 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487438 5821 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:56:23.501001 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487442 5821 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:56:23.501372 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487447 5821 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:56:23.501372 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487457 5821 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:56:23.501372 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487461 5821 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:56:23.501372 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487465 5821 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:56:23.501372 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487470 5821 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:56:23.501372 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487474 5821 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:56:23.501372 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487479 5821 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:56:23.501372 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487483 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:56:23.501372 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487488 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:56:23.501372 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487493 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:56:23.501372 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487497 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:56:23.501372 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487501 5821 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:56:23.501372 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487506 5821 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:56:23.501372 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487512 5821 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:56:23.501372 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487525 5821 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:56:23.501372 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487530 5821 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:56:23.501372 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487535 5821 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:56:23.501372 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487541 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:56:23.501372 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487546 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:56:23.501931 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487565 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:56:23.501931 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487570 5821 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:56:23.501931 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487574 5821 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:56:23.501931 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487578 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:56:23.501931 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487582 5821 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:56:23.501931 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487586 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:56:23.501931 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487590 5821 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:56:23.501931 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487600 5821 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:56:23.501931 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487630 5821 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:56:23.501931 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487635 5821 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:56:23.501931 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487639 5821 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:56:23.501931 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487644 5821 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:56:23.501931 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487648 5821 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:56:23.501931 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487652 5821 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:56:23.501931 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487656 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:56:23.501931 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487660 5821 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:56:23.501931 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487664 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:56:23.501931 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487669 5821 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:56:23.501931 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487673 5821 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:56:23.501931 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487676 5821 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:56:23.502460 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487682 5821 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:56:23.502460 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487685 5821 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:56:23.502460 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487688 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:56:23.502460 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487691 5821 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:56:23.502460 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487695 5821 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:56:23.502460 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487698 5821 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:56:23.502460 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487701 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:56:23.502460 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487703 5821 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:56:23.502460 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487706 5821 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:56:23.502460 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487709 5821 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:56:23.502460 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487712 5821 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:56:23.502460 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487717 5821 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:56:23.502460 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487721 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:56:23.502460 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487726 5821 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:56:23.502460 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487730 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:56:23.502460 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487742 5821 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:56:23.502460 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487889 5821 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:56:23.502460 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487899 5821 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:56:23.502460 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487905 5821 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:56:23.502932 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487911 5821 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:56:23.502932 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487917 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:56:23.502932 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487928 5821 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:56:23.502932 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487933 5821 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:56:23.502932 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487938 5821 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:56:23.502932 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487943 5821 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:56:23.502932 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487947 5821 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:56:23.502932 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487952 5821 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:56:23.502932 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487956 5821 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:56:23.502932 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487961 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:56:23.502932 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487965 5821 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:56:23.502932 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487969 5821 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:56:23.502932 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487974 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:56:23.502932 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487979 5821 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:56:23.502932 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487983 5821 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:56:23.502932 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487987 5821 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:56:23.502932 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487992 5821 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:56:23.502932 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.487999 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:56:23.502932 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488003 5821 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:56:23.502932 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488007 5821 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:56:23.503461 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488011 5821 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:56:23.503461 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488016 5821 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:56:23.503461 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488021 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:56:23.503461 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488025 5821 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:56:23.503461 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488030 5821 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:56:23.503461 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488034 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:56:23.503461 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488038 5821 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:56:23.503461 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488043 5821 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:56:23.503461 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488048 5821 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:56:23.503461 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488052 5821 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:56:23.503461 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488056 5821 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:56:23.503461 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488061 5821 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:56:23.503461 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488066 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:56:23.503461 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488070 5821 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:56:23.503461 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488075 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:56:23.503461 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488081 5821 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:56:23.503461 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488085 5821 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:56:23.503936 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.488134 5821 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 31 00:56:23.503936 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488211 5821 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 31 00:56:23.503936 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488222 5821 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 31 00:56:23.503936 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488228 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 31 00:56:23.503936 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488234 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 31 00:56:23.503936 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488239 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 31 00:56:23.503936 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488243 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 31 00:56:23.503936 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488248 5821 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 31 00:56:23.503936 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488253 5821 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 31 00:56:23.503936 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488260 5821 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 31 00:56:23.503936 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488272 5821 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 31 00:56:23.503936 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488278 5821 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 31 00:56:23.503936 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488284 5821 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 31 00:56:23.503936 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488288 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 31 00:56:23.503936 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488293 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 31 00:56:23.504307 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488298 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 31 00:56:23.504307 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488303 5821 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 31 00:56:23.504307 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488307 5821 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 31 00:56:23.504307 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488312 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 31 00:56:23.504307 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488316 5821 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 31 00:56:23.504307 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488321 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 31 00:56:23.504307 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488325 5821 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 31 00:56:23.504307 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488330 5821 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 31 00:56:23.504307 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488335 5821 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 31 00:56:23.504307 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488340 5821 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 31 00:56:23.504307 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488344 5821 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 31 00:56:23.504307 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488349 5821 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 31 00:56:23.504307 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488353 5821 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 31 00:56:23.504307 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488358 5821 feature_gate.go:386] unrecognized feature gate: Example2 Oct 31 00:56:23.504307 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488362 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 31 00:56:23.504307 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488367 5821 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 31 00:56:23.504307 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488371 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 31 00:56:23.504307 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488375 5821 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 31 00:56:23.504307 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488380 5821 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 31 00:56:23.504307 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488384 5821 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 31 00:56:23.504815 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488391 5821 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 31 00:56:23.504815 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488395 5821 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 31 00:56:23.504815 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488400 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 31 00:56:23.504815 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488405 5821 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 31 00:56:23.504815 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488409 5821 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 31 00:56:23.504815 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488413 5821 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 31 00:56:23.504815 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488418 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 31 00:56:23.504815 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488422 5821 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 31 00:56:23.504815 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488427 5821 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 31 00:56:23.504815 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488431 5821 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 31 00:56:23.504815 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488436 5821 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 31 00:56:23.504815 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488441 5821 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 31 00:56:23.504815 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488445 5821 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 31 00:56:23.504815 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488450 5821 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 31 00:56:23.504815 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488455 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 31 00:56:23.504815 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488459 5821 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 31 00:56:23.504815 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488463 5821 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 31 00:56:23.504815 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488467 5821 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 31 00:56:23.504815 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488471 5821 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 31 00:56:23.505333 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488476 5821 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 31 00:56:23.505333 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488480 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 31 00:56:23.505333 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488484 5821 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 31 00:56:23.505333 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488488 5821 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 31 00:56:23.505333 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488493 5821 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 31 00:56:23.505333 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488497 5821 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 31 00:56:23.505333 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488501 5821 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 31 00:56:23.505333 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488505 5821 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 31 00:56:23.505333 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488510 5821 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 31 00:56:23.505333 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488514 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 31 00:56:23.505333 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488518 5821 feature_gate.go:386] unrecognized feature gate: EVPN Oct 31 00:56:23.505333 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488522 5821 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 31 00:56:23.505333 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488526 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 31 00:56:23.505333 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488530 5821 feature_gate.go:386] unrecognized feature gate: Example Oct 31 00:56:23.505333 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488535 5821 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 31 00:56:23.505333 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488539 5821 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 31 00:56:23.505333 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488543 5821 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 31 00:56:23.505333 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488574 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 31 00:56:23.505333 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488580 5821 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 31 00:56:23.505333 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488585 5821 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 31 00:56:23.506167 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488589 5821 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 31 00:56:23.506167 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488594 5821 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 31 00:56:23.506167 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488600 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 31 00:56:23.506167 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488607 5821 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 31 00:56:23.506167 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488611 5821 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 31 00:56:23.506167 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488615 5821 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 31 00:56:23.506167 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488620 5821 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 31 00:56:23.506167 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488624 5821 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 31 00:56:23.506167 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488632 5821 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 31 00:56:23.506167 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488637 5821 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 31 00:56:23.506167 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488641 5821 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 31 00:56:23.506167 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488645 5821 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 31 00:56:23.506167 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488650 5821 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 31 00:56:23.506167 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488655 5821 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 31 00:56:23.506167 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488660 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 31 00:56:23.506167 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488664 5821 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 31 00:56:23.506167 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488669 5821 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 31 00:56:23.506167 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488674 5821 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 31 00:56:23.506167 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488678 5821 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 31 00:56:23.506895 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488684 5821 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 31 00:56:23.506895 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488692 5821 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 31 00:56:23.506895 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488697 5821 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 31 00:56:23.506895 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488701 5821 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 31 00:56:23.506895 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488706 5821 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 31 00:56:23.506895 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488710 5821 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 31 00:56:23.506895 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488715 5821 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 31 00:56:23.506895 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488721 5821 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 31 00:56:23.506895 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488726 5821 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 31 00:56:23.506895 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488730 5821 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 31 00:56:23.506895 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488735 5821 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 31 00:56:23.506895 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488739 5821 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 31 00:56:23.506895 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488744 5821 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 31 00:56:23.506895 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:23.488748 5821 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 31 00:56:23.506895 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.488839 5821 server.go:957] "Client rotation is on, will bootstrap in background" Oct 31 00:56:23.506895 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.490340 5821 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Oct 31 00:56:23.506895 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.490423 5821 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 31 00:56:23.506895 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.490708 5821 server.go:1014] "Starting client certificate rotation" Oct 31 00:56:23.507366 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.490843 5821 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 31 00:56:23.507366 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.490882 5821 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 00:50:11 +0000 UTC" deadline="2028-05-07 01:01:43.103351054 +0000 UTC" Oct 31 00:56:23.507366 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.490916 5821 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13296h5m19.612446081s" Oct 31 00:56:23.507366 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.491461 5821 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 31 00:56:23.507366 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.493147 5821 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 31 00:56:23.507366 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.494771 5821 log.go:25] "Validated CRI v1 runtime API" Oct 31 00:56:23.507366 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.496691 5821 log.go:25] "Validated CRI v1 image API" Oct 31 00:56:23.507366 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.497380 5821 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 31 00:56:23.507366 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.499623 5821 fs.go:135] Filesystem UUIDs: map[26e1a12f-26a1-46c8-8b01-ab5a5c33771b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9fd56436-6f20-4a14-83b0-c6603bbb7c49:/dev/nvme0n1p3] Oct 31 00:56:23.507742 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.499638 5821 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/034a5b503f54141e3a56cc53c0c3d91105ec9a38c7538cbf41ee7a7eace549d9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/034a5b503f54141e3a56cc53c0c3d91105ec9a38c7538cbf41ee7a7eace549d9/userdata/shm major:0 minor:239 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0b70fccbbc03bc8d398592b7eaa1f8c681a4e478cb6cddd930b838ec69648206/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0b70fccbbc03bc8d398592b7eaa1f8c681a4e478cb6cddd930b838ec69648206/userdata/shm major:0 minor:222 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0ec69a84f19a38cfb1a6aa7224d2730314a7a9d3212fca4f63932fa0afe5c66b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0ec69a84f19a38cfb1a6aa7224d2730314a7a9d3212fca4f63932fa0afe5c66b/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/166ed07caade26a201d728ceb1829f9bf1f1df0d11160b46bf6fdb4e8ae54655/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/166ed07caade26a201d728ceb1829f9bf1f1df0d11160b46bf6fdb4e8ae54655/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1ade9bce13703eda75a9543fc2ee307e596ff048dcbf9053da1f66e614997986/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1ade9bce13703eda75a9543fc2ee307e596ff048dcbf9053da1f66e614997986/userdata/shm major:0 minor:390 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2104fbd04fee4ec819bbfaf482e72c2fb86a731e88288e50f6c97eca1c2bf6e0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2104fbd04fee4ec819bbfaf482e72c2fb86a731e88288e50f6c97eca1c2bf6e0/userdata/shm major:0 minor:235 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2e3fe36b22cd9c673702a5c7682dbc42b9da359d298d88561386f76831aab893/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2e3fe36b22cd9c673702a5c7682dbc42b9da359d298d88561386f76831aab893/userdata/shm major:0 minor:399 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/32eee51493c70164676708ebd1d346d8bd51f0f5ddb6236e4a40fc331e63f728/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/32eee51493c70164676708ebd1d346d8bd51f0f5ddb6236e4a40fc331e63f728/userdata/shm major:0 minor:310 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/354fc15ac80d0e1a7d05a61557fd1d6c00a4a67ed851ba9a282f6aa8bd1e2fd2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/354fc15ac80d0e1a7d05a61557fd1d6c00a4a67ed851ba9a282f6aa8bd1e2fd2/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3a83a3f55a00baa4436649f6e7086410ffafccb32c6aae404e206ad6ed2d456b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3a83a3f55a00baa4436649f6e7086410ffafccb32c6aae404e206ad6ed2d456b/userdata/shm major:0 minor:433 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/511046d629e07bb8d2c40a6f46cb60c3c0ba11a1e830e30568d299700028528e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/511046d629e07bb8d2c40a6f46cb60c3c0ba11a1e830e30568d299700028528e/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/56e14829bb5be1872c2b183c2c3f089aad1f32b42c2f0db1e147ef6bb1dfac51/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/56e14829bb5be1872c2b183c2c3f089aad1f32b42c2f0db1e147ef6bb1dfac51/userdata/shm major:0 minor:435 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5e4324985f86cec518f63e5371a1092224ab27f0e3a94b14bfee0bf809ec8be7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5e4324985f86cec518f63e5371a1092224ab27f0e3a94b14bfee0bf809ec8be7/userdata/shm major:0 minor:386 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/61963d0d602361e419f13ec7172bd0f4f319bbbb7143c0e35944769e065359e6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/61963d0d602361e419f13ec7172bd0f4f319bbbb7143c0e35944769e065359e6/userdata/shm major:0 minor:391 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/623cf6bc7f1411291483e34bb2e2037270fe2ca00f5d112901dddae279229715/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/623cf6bc7f1411291483e34bb2e2037270fe2ca00f5d112901dddae279229715/userdata/shm major:0 minor:357 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/70788e0e0bd25b9fae1c4ceba2418dbc64b31d36078b88801801710caee38dcb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/70788e0e0bd25b9fae1c4ceba2418dbc64b31d36078b88801801710caee38dcb/userdata/shm major:0 minor:69 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/720be370902f1282f3b4eb2840d68e21773874c9ddacef1b0ee4557dbdd6e8bf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/720be370902f1282f3b4eb2840d68e21773874c9ddacef1b0ee4557dbdd6e8bf/userdata/shm major:0 minor:394 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7479eff13b042006c3acd658daf8e57fd5b91e2d2c98cba23f205dd61d80c154/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7479eff13b042006c3acd658daf8e57fd5b91e2d2c98cba23f205dd61d80c154/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/77501eedb58e5542a24e2aab078b4d7ad14ec809de93d1ccd806262557dc3b37/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/77501eedb58e5542a24e2aab078b4d7ad14ec809de93d1ccd806262557dc3b37/userdata/shm major:0 minor:287 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7bfe63663352988c9221141cd28716101dbb706234e1b3adeb3787a6a5a345ca/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7bfe63663352988c9221141cd28716101dbb706234e1b3adeb3787a6a5a345ca/userdata/shm major:0 minor:388 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/854f8ddceeea905e740290da5f9cbb66218b5da287949628742ca469425c69aa/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/854f8ddceeea905e740290da5f9cbb66218b5da287949628742ca469425c69aa/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8740c4c69ef0590c0f9ef9e183dabc84981a93856c967ed1085cf072b83bf963/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8740c4c69ef0590c0f9ef9e183dabc84981a93856c967ed1085cf072b83bf963/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b1c4990622b03017c61e7ec684aa2a18adf42cbe971ec9ac605343d7d346ae8c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b1c4990622b03017c61e7ec684aa2a18adf42cbe971ec9ac605343d7d346ae8c/userdata/shm major:0 minor:220 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b570d68ad7275fbafce394d39b2da7af4d3d396f07bb155bc66e2895d3f25b47/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b570d68ad7275fbafce394d39b2da7af4d3d396f07bb155bc66e2895d3f25b47/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bd607c44404b912d6dbd433803ce7b66e4e8294b684dae4c841c1ea26a44f0f9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bd607c44404b912d6dbd433803ce7b66e4e8294b684dae4c841c1ea26a44f0f9/userdata/shm major:0 minor:359 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/be2cb70fe3c74712d7df80d215733b281a66e0dba88f5e7633c84720eca0a90b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/be2cb70fe3c74712d7df80d215733b281a66e0dba88f5e7633c84720eca0a90b/userdata/shm major:0 minor:218 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bf3cd60ef6a76cbfd77fdd4af4d53843a3e0d7f9132680f095101d988dee1abf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bf3cd60ef6a76cbfd77fdd4af4d53843a3e0d7f9132680f095101d988dee1abf/userdata/shm major:0 minor:355 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c21eb5eb1093fe216589c3bc7ee8119c13ed65eac6f72ecd12aaf93d06829b9c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c21eb5eb1093fe216589c3bc7ee8119c13ed65eac6f72ecd12aaf93d06829b9c/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cc7e25dc0e3412dcca46df370c2ba4c161be97bdcdc6fb57295a313482a3c911/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cc7e25dc0e3412dcca46df370c2ba4c161be97bdcdc6fb57295a313482a3c911/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d06ebfd727a4b1a42b9bfc7d2e249d1cb64ad9ccbc71624dadd566ced112104d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d06ebfd727a4b1a42b9bfc7d2e249d1cb64ad9ccbc71624dadd566ced112104d/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d1c319e27efaccf939b4525ae53eb20e0206b9380af03c16e39630104f458272/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d1c319e27efaccf939b4525ae53eb20e0206b9380af03c16e39630104f458272/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e2270aa8fda01802802363dc62d4765a2089b071a4dc109bd9541e7562a7afee/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e2270aa8fda01802802363dc62d4765a2089b071a4dc109bd9541e7562a7afee/userdata/shm major:0 minor:237 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ffdf3e696376dd3a528363ea11f4813e9ee0e7b058dbf654d99bcccf5733f4b6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ffdf3e696376dd3a528363ea11f4813e9ee0e7b058dbf654d99bcccf5733f4b6/userdata/shm major:0 minor:224 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03e53a8a-f8cb-4821-bd6b-ee63d0e25623/volumes/kubernetes.io~projected/kube-api-access-xldv4:{mountpoint:/var/lib/kubelet/pods/03e53a8a-f8cb-4821-bd6b-ee63d0e25623/volumes/kubernetes.io~projected/kube-api-access-xldv4 major:0 minor:354 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03e53a8a-f8cb-4821-bd6b-ee63d0e25623/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/03e53a8a-f8cb-4821-bd6b-ee63d0e25623/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:353 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/05787044-8eb5-4158-a092-69f7266871fb/volumes/kubernetes.io~projected/kube-api-access-fsv9v:{mountpoint:/var/lib/kubelet/pods/05787044-8eb5-4158-a092-69f7266871fb/volumes/kubernetes.io~projected/kube-api-access-fsv9v major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/159fdfbd-fdcc-4655-b273-f0964617ed13/volumes/kubernetes.io~projected/kube-api-access-tj9gv:{mountpoint:/var/lib/kubelet/pods/159fdfbd-fdcc-4655-b273-f0964617ed13/volumes/kubernetes.io~projected/kube-api-access-tj9gv major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/159fdfbd-fdcc-4655-b273-f0964617ed13/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/159fdfbd-fdcc-4655-b273-f0964617ed13/volumes/kubernetes.io~secret/metrics-certs major:0 minor:428 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5/volumes/kubernetes.io~projected/kube-api-access-wrtm2:{mountpoint:/var/lib/kubelet/pods/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5/volumes/kubernetes.io~projected/kube-api-access-wrtm2 major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/314bbfb5-1511-4a13-9a52-9bee729f1b2e/volumes/kubernetes.io~projected/kube-api-access-n55jw:{mountpoint:/var/lib/kubelet/pods/314bbfb5-1511-4a13-9a52-9bee729f1b2e/volumes/kubernetes.io~projected/kube-api-access-n55jw major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/330d9526-3090-4286-ab5c-db9eb532f4c5/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/330d9526-3090-4286-ab5c-db9eb532f4c5/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/330d9526-3090-4286-ab5c-db9eb532f4c5/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/330d9526-3090-4286-ab5c-db9eb532f4c5/volumes/kubernetes.io~empty-dir/tmp major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/330d9526-3090-4286-ab5c-db9eb532f4c5/volumes/kubernetes.io~projected/kube-api-access-wnw8h:{mountpoint:/var/lib/kubelet/pods/330d9526-3090-4286-ab5c-db9eb532f4c5/volumes/kubernetes.io~projected/kube-api-access-wnw8h major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/33816f29-a274-4bbb-83d7-72820504fee3/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/33816f29-a274-4bbb-83d7-72820504fee3/volumes/kubernetes.io~secret/agent-certs major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3737c365-6bb7-4e45-a487-5a6ed8eda295/volumes/kubernetes.io~projected/kube-api-access-4z68r:{mountpoint:/var/lib/kubelet/pods/3737c365-6bb7-4e45-a487-5a6ed8eda295/volumes/kubernetes.io~projected/kube-api-access-4z68r major:0 minor:352 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3adb1944-49fd-4158-b195-4e80ebfd8f58/volumes/kubernetes.io~projected/kube-api-access-25sgt:{mountpoint:/var/lib/kubelet/pods/3adb1944-49fd-4158-b195-4e80ebfd8f58/volumes/kubernetes.io~projected/kube-api-access-25sgt major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/42d46af4-addb-42c6-a15f-d1b717fb91b8/volumes/kubernetes.io~projected/kube-api-access-gmvgr:{mountpoint:/var/lib/kubelet/pods/42d46af4-addb-42c6-a15f-d1b717fb91b8/volumes/kubernetes.io~projected/kube-api-access-gmvgr major:0 minor:234 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/42d46af4-addb-42c6-a15f-d1b717fb91b8/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/42d46af4-addb-42c6-a15f-d1b717fb91b8/volumes/kubernetes.io~secret/cert major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5/volumes/kubernetes.io~projected/kube-api-access-msq52:{mountpoint:/var/lib/kubelet/pods/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5/volumes/kubernetes.io~projected/kube-api-access-msq52 major:0 minor:347 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/50554e95-e3c9-4f06-84ca-dd86c85bcf8a/volumes/kubernetes.io~projected/kube-api-access-2rmxd:{mountpoint:/var/lib/kubelet/pods/50554e95-e3c9-4f06-84ca-dd86c85bcf8a/volumes/kubernetes.io~projected/kube-api-access-2rmxd major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/50554e95-e3c9-4f06-84ca-dd86c85bcf8a/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/50554e95-e3c9-4f06-84ca-dd86c85bcf8a/volumes/kubernetes.io~secret/serving-cert major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/51be789d-183b-4988-9099-d5d33ad634c4/volumes/kubernetes.io~projected/kube-api-access-mw5wp:{mountpoint:/var/lib/kubelet/pods/51be789d-183b-4988-9099-d5d33ad634c4/volumes/kubernetes.io~projected/kube-api-access-mw5wp major:0 minor:233 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/51be789d-183b-4988-9099-d5d33ad634c4/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/51be789d-183b-4988-9099-d5d33ad634c4/volumes/kubernetes.io~secret/serving-cert major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/58a9ea73-4db8-44ee-83ac-55504736d028/volumes/kubernetes.io~projected/kube-api-access-4whx4:{mountpoint:/var/lib/kubelet/pods/58a9ea73-4db8-44ee-83ac-55504736d028/volumes/kubernetes.io~projected/kube-api-access-4whx4 major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6d207e59-c491-43cb-a331-5b89a78f470c/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/6d207e59-c491-43cb-a331-5b89a78f470c/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:432 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6dda3bac-470c-46f8-b510-8a73f6dc76c6/volumes/kubernetes.io~projected/kube-api-access-tccp5:{mountpoint:/var/lib/kubelet/pods/6dda3bac-470c-46f8-b510-8a73f6dc76c6/volumes/kubernetes.io~projected/kube-api-access-tccp5 major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6dda3bac-470c-46f8-b510-8a73f6dc76c6/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/6dda3bac-470c-46f8-b510-8a73f6dc76c6/volumes/kubernetes.io~secret/serving-cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7885b2e1-6437-402d-9335-f2b5bb2be17a/volumes/kubernetes.io~projected/kube-api-access-rlnkr:{mountpoint:/var/lib/kubelet/pods/7885b2e1-6437-402d-9335-f2b5bb2be17a/volumes/kubernetes.io~projected/kube-api-access-rlnkr major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9a3528e4-8866-4d92-889c-db7d8a7271b4/volumes/kubernetes.io~projected/kube-api-access-6jgr2:{mountpoint:/var/lib/kubelet/pods/9a3528e4-8866-4d92-889c-db7d8a7271b4/volumes/kubernetes.io~projected/kube-api-access-6jgr2 major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9a3528e4-8866-4d92-889c-db7d8a7271b4/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/9a3528e4-8866-4d92-889c-db7d8a7271b4/volumes/kubernetes.io~secret/serving-cert major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9b23111a-a892-4d92-990d-742a857450fa/volumes/kubernetes.io~projected/kube-api-access-txczj:{mountpoint:/var/lib/kubelet/pods/9b23111a-a892-4d92-990d-742a857450fa/volumes/kubernetes.io~projected/kube-api-access-txczj major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9fb838b9-ac5c-4029-9f11-98b610e5b375/volumes/kubernetes.io~projected/kube-api-access-7nhbc:{mountpoint:/var/lib/kubelet/pods/9fb838b9-ac5c-4029-9f11-98b610e5b375/volumes/kubernetes.io~projected/kube-api-access-7nhbc major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9fb838b9-ac5c-4029-9f11-98b610e5b375/volumes/kubernetes.io~secret/samples-operator-tls:{mountpoint:/var/lib/kubelet/pods/9fb838b9-ac5c-4029-9f11-98b610e5b375/volumes/kubernetes.io~secret/samples-operator-tls major:0 minor:382 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a1a12f14-a3aa-43b0-8ada-4568a87f7186/volumes/kubernetes.io~projected/kube-api-access-ktcbp:{mountpoint:/var/lib/kubelet/pods/a1a12f14-a3aa-43b0-8ada-4568a87f7186/volumes/kubernetes.io~projected/kube-api-access-ktcbp major:0 minor:262 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51/volumes/kubernetes.io~secret/networking-console-plugin-cert:{mountpoint:/var/lib/kubelet/pods/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51/volumes/kubernetes.io~secret/networking-console-plugin-cert major:0 minor:384 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b0086739-e8c7-4143-b297-87002d2f7dfb/volumes/kubernetes.io~projected/kube-api-access-gvd5m:{mountpoint:/var/lib/kubelet/pods/b0086739-e8c7-4143-b297-87002d2f7dfb/volumes/kubernetes.io~projected/kube-api-access-gvd5m major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b686e125-10ef-4399-b811-42858a543682/volumes/kubernetes.io~projected/kube-api-access-gg55m:{mountpoint:/var/lib/kubelet/pods/b686e125-10ef-4399-b811-42858a543682/volumes/kubernetes.io~projected/kube-api-access-gg55m major:0 minor:231 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b93a7d1a-904e-4d81-a425-f4d3b3055354/volumes/kubernetes.io~projected/kube-api-access-kb4g2:{mountpoint:/var/lib/kubelet/pods/b93a7d1a-904e-4d81-a425-f4d3b3055354/volumes/kubernetes.io~projected/kube-api-access-kb4g2 major:0 minor:301 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d050f2b3-1f51-4f94-8d13-075aa3288bd1/volumes/kubernetes.io~projected/kube-api-access-5lzml:{mountpoint:/var/lib/kubelet/pods/d050f2b3-1f51-4f94-8d13-075aa3288bd1/volumes/kubernetes.io~projected/kube-api-access-5lzml major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e4573d06-669b-4764-9609-9bdc204c419a/volumes/kubernetes.io~projected/kube-api-access-mcpm8:{mountpoint:/var/lib/kubelet/pods/e4573d06-669b-4764-9609-9bdc204c419a/volumes/kubernetes.io~projected/kube-api-access-mcpm8 major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e51caef4-2776-4216-9143-2c07435c062b/volumes/kubernetes.io~projected/kube-api-access-l9gzn:{mountpoint:/var/lib/kubelet/pods/e51caef4-2776-4216-9143-2c07435c062b/volumes/kubernetes.io~projected/kube-api-access-l9gzn major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e51caef4-2776-4216-9143-2c07435c062b/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/e51caef4-2776-4216-9143-2c07435c062b/volumes/kubernetes.io~secret/default-certificate major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e51caef4-2776-4216-9143-2c07435c062b/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/e51caef4-2776-4216-9143-2c07435c062b/volumes/kubernetes.io~secret/metrics-certs major:0 minor:334 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e51caef4-2776-4216-9143-2c07435c062b/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/e51caef4-2776-4216-9143-2c07435c062b/volumes/kubernetes.io~secret/stats-auth major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/edf682ca-dae8-42a1-a573-0995bbb7188d/volumes/kubernetes.io~projected/kube-api-access-ks7rn:{mountpoint:/var/lib/kubelet/pods/edf682ca-dae8-42a1-a573-0995bbb7188d/volumes/kubernetes.io~projected/kube-api-access-ks7rn major:0 minor:241 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/edf682ca-dae8-42a1-a573-0995bbb7188d/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/edf682ca-dae8-42a1-a573-0995bbb7188d/volumes/kubernetes.io~secret/metrics-tls major:0 minor:385 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f6434cdd-b8a7-4fdb-ab00-53f19ce35b98/volumes/kubernetes.io~projected/kube-api-access-8rcsn:{mountpoint:/var/lib/kubelet/pods/f6434cdd-b8a7-4fdb-ab00-53f19ce35b98/volumes/kubernetes.io~projected/kube-api-access-8rcsn major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fccb0eb9-af8a-494e-b629-37a428d87ea5/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/fccb0eb9-af8a-494e-b629-37a428d87ea5/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fccb0eb9-af8a-494e-b629-37a428d87ea5/volumes/kubernetes.io~projected/kube-api-access-m8f7j:{mountpoint:/var/lib/kubelet/pods/fccb0eb9-af8a-494e-b629-37a428d87ea5/volumes/kubernetes.io~projected/kube-api-access-m8f7j major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fccb0eb9-af8a-494e-b629-37a428d87ea5/volumes/kubernetes.io~projected/registry-tls:{mountpoint:/var/lib/kubelet/pods/fccb0eb9-af8a-494e-b629-37a428d87ea5/volumes/kubernetes.io~projected/registry-tls major:0 minor:377 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fccb0eb9-af8a-494e-b629-37a428d87ea5/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/fccb0eb9-af8a-494e-b629-37a428d87ea5/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fccb0eb9-af8a-494e-b629-37a428d87ea5/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/fccb0eb9-af8a-494e-b629-37a428d87ea5/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fe4d93b4-1929-4fbe-9bf3-834f03268472/volumes/kubernetes.io~projected/kube-api-access-67qqz:{mountpoint:/var/lib/kubelet/pods/fe4d93b4-1929-4fbe-9bf3-834f03268472/volumes/kubernetes.io~projected/kube-api-access-67qqz major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fe4d93b4-1929-4fbe-9bf3-834f03268472/volumes/kubernetes.io~secret/cluster-monitoring-operator-tls:{mountpoint:/var/lib/kubelet/pods/fe4d93b4-1929-4fbe-9bf3-834f03268472/volumes/kubernetes.io~secret/cluster-monitoring-operator-tls major:0 minor:383 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/01e201cfdf56dbbb784cb1866e75c412ad9e19ca8a0e4950284e9cefcef74798/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/c2f790a5f04f3dc00c48c6d6b79b8dd55a2ced2b421ead0ffa1fdb77a69ec6d0/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-105:{mountpoint:/var/lib/containers/storage/overlay/ff753de182f33ba2b83aaf68dc9f064afe28ee15f897454b397da5e07c94dbeb/merged major:0 minor:105 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/5b0c693847c5b0a2b2a7fe1d5a07c8523e8d184f5545288b66efdab29f6b0a43/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-111:{mountpoint:/var/lib/containers/storage/overlay/5cf41ddc7cb97110f22a141f578a6608472c778ecba5a7e22a35eb35aa3c79f0/merged major:0 minor:111 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/2eee6aa83dc373ed86df3afa37e63e106ffad1f5663a19f79acae83e867ea8a4/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/67ec91372f0b1d025feedeb30e171b5815afa431d3e6e96a4b9840519b11153f/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/bbe215666bb92aa1ac71b96360541d6044fbf57a10b46f80e238d5d7b332c8b9/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/881d2323122faa5e45d04f1602bf4972508e14ba93a202bfa58dcf9d8b5d37dc/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/c0b3ed92cef4aa9201e127bd77c7ba7936feb9cfb0390e2f1a52aad7c2ff1262/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/c82255caad5554049543cda4604766656c992a31c0f48164aac1c5a3c67f2502/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/e8e9863aceb032595888862f9d8fbb73ab17c07725bd64c88380756e3ddc39ef/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-149:{mountpoint:/var/lib/containers/storage/overlay/24338e867ae91128fef30b2851f4085cd84dca9cd5379afdcefbc76de00765a9/merged major:0 minor:149 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/cce4aab418b6d70b851e2b33b7be0c06741d40dbc3fcef120d6a3eb8bb212051/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/2ede7013dd00db6ff403adf1e40d51902ade4247572f691016609eac1d16c788/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/cb6ce3f90cb16438c4553aa9fc0f34628de0576fb93ef95d36eefd4ef80538e7/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/fda7dec1bc99138f0251e4602e51c3b0a1c8cda9c14b4bf7cb83d87df7f7e945/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/ee01ad5425d21ff32a9cfa330374ebe76e1c5a8f6a10d7527c2201d6a4505ea6/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/f216bb56bee39d058aed78878649c49dc3277a5400dc5cac40192699ffd71627/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/5dc76d59907f00804206da0fb5d2e628e5d677fe468117a5816257baba6204ac/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/0fdb58dbe8d61780f8460c7c25326b2167e15235cd7998eecc03e355cabbb041/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-229:{mountpoint:/var/lib/containers/storage/overlay/567607754a6d5833bf384eedee8e2c16d162f6adda073e4d39599af3500ce625/merged major:0 minor:229 fsType:overlay blockSize:0} overlay_0-232:{mountpoint:/var/lib/containers/storage/overlay/58c30627b9d6056c1746f3c8d4859b0a37cd0a595c1002977f08387e0384ae25/merged major:0 minor:232 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/47ac8668325f21cce8dd3deba30d46defe6db79bb7ef200d400523794478c29d/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/c0f8874d8640eab40029ff3bd826344270b09dec7bd677ced94d34a60b57ff7a/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/c7ac85c80390f188e4b20631cb7f707618cdcd0572b11b6b2e061dc1199919dc/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/4f5336cf5b45bf4c99995285e9c1f0d97f575679fc216c0c43e9ddcf2e655e84/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/0dd809f134dec103ef3130b724eb0a776ee0fea10cdd791aca4f0bcc1b0e6111/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/98cc5415e70faf8039fa9e91511f90132079ca0f5e0a9611ab043f384e45644c/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/d6af48411050a71609b3db99d55956ec4d8fc6f16d1c2c36311e8dec7c139ef4/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-263:{mountpoint:/var/lib/containers/storage/overlay/a744fd73f84324a0f234bd55b533ab2c5277ef9efccf834ba8c38610e2f1eb38/merged major:0 minor:263 fsType:overlay blockSize:0} overlay_0-265:{mountpoint:/var/lib/containers/storage/overlay/bbb9b2857595f1a5f4b27a8d03c79bc78f520ed15186075cfab02a0c64c708ef/merged major:0 minor:265 fsType:overlay blockSize:0} overlay_0-267:{mountpoint:/var/lib/containers/storage/overlay/dea6c6d69aea002ea96c046f4aab077448dfc537cf9f6a17730ecd007d8e66c5/merged major:0 minor:267 fsType:overlay blockSize:0} overlay_0-269:{mountpoint:/var/lib/containers/storage/overlay/88a2fde3d46a748a06aee5db1510f70a21c0c11ae718618d4f89593b6cfde0fd/merged major:0 minor:269 fsType:overlay blockSize:0} overlay_0-271:{mountpoint:/var/lib/containers/storage/overlay/b2855c0410d68a0fb696fe5f70f48cf6c29de1ccaf4bf08ef8e602b6dbdcd658/merged major:0 minor:271 fsType:overlay blockSize:0} overlay_0-284:{mountpoint:/var/lib/containers/storage/overlay/9f1f7fd104fb29b5e7e776a718bc5b29aa27a9f2e9a7094972c57af2a1cb3090/merged major:0 minor:284 fsType:overlay blockSize:0} overlay_0-289:{mountpoint:/var/lib/containers/storage/overlay/cbbb6f4c5eb97c0cc9a599b18c6059f8ccec75d42174bd50f5584d93d01efa61/merged major:0 minor:289 fsType:overlay blockSize:0} overlay_0-291:{mountpoint:/var/lib/containers/storage/overlay/a34bd52879929e53cb85d54ec7ddad5664b14b957f46e42b7e19bf571849bc7f/merged major:0 minor:291 fsType:overlay blockSize:0} overlay_0-293:{mountpoint:/var/lib/containers/storage/overlay/888ba9d9ac96c5275ecd350e3fadbdea4a767cd9dcda9e479080fda4c74186b3/merged major:0 minor:293 fsType:overlay blockSize:0} overlay_0-299:{mountpoint:/var/lib/containers/storage/overlay/6c370fbc7e016b647933e20843b457e0e810e72676a146699c6c02f470323c68/merged major:0 minor:299 fsType:overlay blockSize:0} overlay_0-312:{mountpoint:/var/lib/containers/storage/overlay/1876a658617973d3739a8d019e3c4ed622e734caa940aa4936ce151ca4bd358f/merged major:0 minor:312 fsType:overlay blockSize:0} overlay_0-314:{mountpoint:/var/lib/containers/storage/overlay/18af9a1efba787ca8f6ec0e42ae004e7dccca259b615331b8202f33ae9fd512b/merged major:0 minor:314 fsType:overlay blockSize:0} overlay_0-316:{mountpoint:/var/lib/containers/storage/overlay/75196d45ae72da0c87735912847f207616a750cf7bdc903974bb99f07c51bfac/merged major:0 minor:316 fsType:overlay blockSize:0} overlay_0-326:{mountpoint:/var/lib/containers/storage/overlay/06bd0e1deada8830916421fbf76c3c059c165d96b88cf03c91a0400ea32244f2/merged major:0 minor:326 fsType:overlay blockSize:0} overlay_0-328:{mountpoint:/var/lib/containers/storage/overlay/afccb783a0e34401a79d2c4e330b2a32c115ee2579cef24fb0511c7ec331292c/merged major:0 minor:328 fsType:overlay blockSize:0} overlay_0-339:{mountpoint:/var/lib/containers/storage/overlay/2453e22cfc10f856580b957ec304d5e8422953ad8995f9ecd25fd123873764ca/merged major:0 minor:339 fsType:overlay blockSize:0} overlay_0-341:{mountpoint:/var/lib/containers/storage/overlay/9dfb6e5c08d76e78b63f70f78c63be7302e3d52bf6fd5a6dc5c2f2535af72251/merged major:0 minor:341 fsType:overlay blockSize:0} overlay_0-361:{mountpoint:/var/lib/containers/storage/overlay/f3e9666432f8b15d8cf3a743f8e4a7c62b0db4822983c9768819361c7aa00c05/merged major:0 minor:361 fsType:overlay blockSize:0} overlay_0-363:{mountpoint:/var/lib/containers/storage/overlay/664ca0fd734d0813c5b3f74b92663300a5e340c592f495b733d4f6f8f7e3b2b6/merged major:0 minor:363 fsType:overlay blockSize:0} overlay_0-365:{mountpoint:/var/lib/containers/storage/overlay/5e99c91c7fa2b6a5a10ca6058a96b406bbae361bfb5b94d6261f82cdaa8550aa/merged major:0 minor:365 fsType:overlay blockSize:0} overlay_0-375:{mountpoint:/var/lib/containers/storage/overlay/6a25fe36212f79283eb9ae8486d9d89f3e83e47b17d818ae19eccf5cc169710b/merged major:0 minor:375 fsType:overlay blockSize:0} overlay_0-396:{mountpoint:/var/lib/containers/storage/overlay/a07faf04efc87df91b28f016ab3acac5f53fbae6d5899f0a479a1533219d0434/merged major:0 minor:396 fsType:overlay blockSize:0} overlay_0-398:{mountpoint:/var/lib/containers/storage/overlay/4289b2590d549366b5323c9996c472aef65e2cbb79bed785a7ab5f6a689c1e4a/merged major:0 minor:398 fsType:overlay blockSize:0} overlay_0-402:{mountpoint:/var/lib/containers/storage/overlay/39dc61da4c37d2a461fc62f1b49c69d919ef9d1c9bf928459c2ef0de7ce32b59/merged major:0 minor:402 fsType:overlay blockSize:0} overlay_0-403:{mountpoint:/var/lib/containers/storage/overlay/bd242fed94b6cc90e01a2637bcbd512b8aa7ebd07c10e18794ad338feb9dc4f1/merged major:0 minor:403 fsType:overlay blockSize:0} overlay_0-405:{mountpoint:/var/lib/containers/storage/overlay/ad503be6879f00e6ce477eea47140f17c34bda72b3849f69e7b37d88d13aae7a/merged major:0 minor:405 fsType:overlay blockSize:0} overlay_0-411:{mountpoint:/var/lib/containers/storage/overlay/29f072fcb299e1e334ab9bbe9b881c6a0dbeed6c43c86a3d4e09da0664d65d22/merged major:0 minor:411 fsType:overlay blockSize:0} overlay_0-418:{mountpoint:/var/lib/containers/storage/overlay/957a9234aa4e89512c13be09436c2048e065f4e78b22fd6c11314644f69400ae/merged major:0 minor:418 fsType:overlay blockSize:0} overlay_0-419:{mountpoint:/var/lib/containers/storage/overlay/cf7373af26c7c131bca6a98e7fd9af623517ae5f17de34a822851d8ab0796ca1/merged major:0 minor:419 fsType:overlay blockSize:0} overlay_0-426:{mountpoint:/var/lib/containers/storage/overlay/61f02cc0c9dd72fce7512df252e8eca89f06e6fe43db862c07008edd8ca714f7/merged major:0 minor:426 fsType:overlay blockSize:0} overlay_0-437:{mountpoint:/var/lib/containers/storage/overlay/b720de39f0f6fdbb95ec414d0bf276919311923a63dfed15602d6f77bb8e0c1e/merged major:0 minor:437 fsType:overlay blockSize:0} overlay_0-439:{mountpoint:/var/lib/containers/storage/overlay/e4f0e7c70e722d22d564410ae14b0ab6d83ea8e58e3dbec9552dc6b6f4cd18b2/merged major:0 minor:439 fsType:overlay blockSize:0} overlay_0-441:{mountpoint:/var/lib/containers/storage/overlay/cf3c55d6afa7d14182ad4b62fdd4fcccabaeee167c0b8a3facd20b75fcc8e8ce/merged major:0 minor:441 fsType:overlay blockSize:0} overlay_0-443:{mountpoint:/var/lib/containers/storage/overlay/e16d0921915505b5e482e161f4a664043686e81a00de2d18ecedee5274d80221/merged major:0 minor:443 fsType:overlay blockSize:0} overlay_0-449:{mountpoint:/var/lib/containers/storage/overlay/b41c9feb470824cc02c20ab217c9447a5b55e43f016a003b576a7289aaf1d188/merged major:0 minor:449 fsType:overlay blockSize:0} overlay_0-451:{mountpoint:/var/lib/containers/storage/overlay/9adb0dee42d2af484105d2e16dc0bbc683baeda4f258fefd1d542b67447e4167/merged major:0 minor:451 fsType:overlay blockSize:0} overlay_0-460:{mountpoint:/var/lib/containers/storage/overlay/8c8467102e087326b290337407a8c60e5a3b404eb93d04f2aca97e2793fc9fdc/merged major:0 minor:460 fsType:overlay blockSize:0} overlay_0-465:{mountpoint:/var/lib/containers/storage/overlay/12c2956510500b2dc2a0ef69a91fa35de1a5ec1c06451fa894930e2095084966/merged major:0 minor:465 fsType:overlay blockSize:0} overlay_0-471:{mountpoint:/var/lib/containers/storage/overlay/ea7d53843eaebafd9627c3a0b02e289e36aac323db73809effb20a34ffa60949/merged major:0 minor:471 fsType:overlay blockSize:0} overlay_0-477:{mountpoint:/var/lib/containers/storage/overlay/0281e63d03db784e2d3a1b483ffc4a79442879c07cf08812ff51494df9ef03bb/merged major:0 minor:477 fsType:overlay blockSize:0} overlay_0-482:{mountpoint:/var/lib/containers/storage/overlay/8f7385b1602030048eddaa6ca2c2488970a95b73da1989fc7905fc12e1a6d974/merged major:0 minor:482 fsType:overlay blockSize:0} overlay_0-487:{mountpoint:/var/lib/containers/storage/overlay/31caecbfef7e6f56082314f547a4b7317fdbcdcb95f11d839299f1de51acbdae/merged major:0 minor:487 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/23d4974bcf1a3c6e17417de72bc1dc7a2f002deb771c5d362e98e327cd8c9584/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/ca1f8a42a3fd7cd0053a4b35343061e1b0e7b1cb7aecbef3268f979f535db699/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/7eb8216d583297a533aedd5442e3b453404273b6ba484783bdeefd7f4a806051/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/2b98aa70e08a47bf70bea04e44aa1f3b916655bbe34426e9ce01c19d304f72fb/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/965709a1400a0d3a3c0587ce356a693c74f306cde7514d27db2a3f3e3a8432df/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/de906f9b68064ded2b6096fe40b76725ed1f5848b9b3d434257ca8eefe172990/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/45e5b13f252f26ad6ca4cbc48c56d34b881f1c27c20b56aad30aad1fe2209af8/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/3bce912bf53ea1998999e4e5363e3d6b779e55b1cda072cc1cff9c7e4cc04591/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/2e63fb27dbf2fab52f94648583cc4a85d1cfd6f0ec0f4feed38e5452adb00f80/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/d99f5e47a312fd6fe227f75fa2852d0c05d256c6a44c73e85c08b1e0367a2dc4/merged major:0 minor:96 fsType:overlay blockSize:0}] Oct 31 00:56:23.510362 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.509929 5821 manager.go:217] Machine: {Timestamp:2026-10-31 00:56:23.509467898 +0000 UTC m=+0.088881796 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100164 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27dd9caf45879e983a03de6a4a70e8 SystemUUID:ec27dd9c-af45-879e-983a-03de6a4a70e8 BootID:4243692a-ab75-4d8f-ae75-cad200410e8d Filesystems:[{Device:overlay_0-449 DeviceMajor:0 DeviceMinor:449 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-487 DeviceMajor:0 DeviceMinor:487 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/314bbfb5-1511-4a13-9a52-9bee729f1b2e/volumes/kubernetes.io~projected/kube-api-access-n55jw DeviceMajor:0 DeviceMinor:205 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/623cf6bc7f1411291483e34bb2e2037270fe2ca00f5d112901dddae279229715/userdata/shm DeviceMajor:0 DeviceMinor:357 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-405 DeviceMajor:0 DeviceMinor:405 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-441 DeviceMajor:0 DeviceMinor:441 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-465 DeviceMajor:0 DeviceMinor:465 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e4573d06-669b-4764-9609-9bdc204c419a/volumes/kubernetes.io~projected/kube-api-access-mcpm8 DeviceMajor:0 DeviceMinor:202 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/fccb0eb9-af8a-494e-b629-37a428d87ea5/volumes/kubernetes.io~projected/kube-api-access-m8f7j DeviceMajor:0 DeviceMinor:207 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3737c365-6bb7-4e45-a487-5a6ed8eda295/volumes/kubernetes.io~projected/kube-api-access-4z68r DeviceMajor:0 DeviceMinor:352 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-363 DeviceMajor:0 DeviceMinor:363 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/edf682ca-dae8-42a1-a573-0995bbb7188d/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:385 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/511046d629e07bb8d2c40a6f46cb60c3c0ba11a1e830e30568d299700028528e/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-149 DeviceMajor:0 DeviceMinor:149 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9a3528e4-8866-4d92-889c-db7d8a7271b4/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:210 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-312 DeviceMajor:0 DeviceMinor:312 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-229 DeviceMajor:0 DeviceMinor:229 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-411 DeviceMajor:0 DeviceMinor:411 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9a3528e4-8866-4d92-889c-db7d8a7271b4/volumes/kubernetes.io~projected/kube-api-access-6jgr2 DeviceMajor:0 DeviceMinor:216 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-316 DeviceMajor:0 DeviceMinor:316 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-339 DeviceMajor:0 DeviceMinor:339 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-471 DeviceMajor:0 DeviceMinor:471 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cc7e25dc0e3412dcca46df370c2ba4c161be97bdcdc6fb57295a313482a3c911/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-267 DeviceMajor:0 DeviceMinor:267 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-398 DeviceMajor:0 DeviceMinor:398 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fccb0eb9-af8a-494e-b629-37a428d87ea5/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c21eb5eb1093fe216589c3bc7ee8119c13ed65eac6f72ecd12aaf93d06829b9c/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/70788e0e0bd25b9fae1c4ceba2418dbc64b31d36078b88801801710caee38dcb/userdata/shm DeviceMajor:0 DeviceMinor:69 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-443 DeviceMajor:0 DeviceMinor:443 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/3adb1944-49fd-4158-b195-4e80ebfd8f58/volumes/kubernetes.io~projected/kube-api-access-25sgt DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/159fdfbd-fdcc-4655-b273-f0964617ed13/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:428 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-437 DeviceMajor:0 DeviceMinor:437 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e51caef4-2776-4216-9143-2c07435c062b/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:208 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b686e125-10ef-4399-b811-42858a543682/volumes/kubernetes.io~projected/kube-api-access-gg55m DeviceMajor:0 DeviceMinor:231 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bf3cd60ef6a76cbfd77fdd4af4d53843a3e0d7f9132680f095101d988dee1abf/userdata/shm DeviceMajor:0 DeviceMinor:355 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bd607c44404b912d6dbd433803ce7b66e4e8294b684dae4c841c1ea26a44f0f9/userdata/shm DeviceMajor:0 DeviceMinor:359 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-477 DeviceMajor:0 DeviceMinor:477 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2104fbd04fee4ec819bbfaf482e72c2fb86a731e88288e50f6c97eca1c2bf6e0/userdata/shm DeviceMajor:0 DeviceMinor:235 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/330d9526-3090-4286-ab5c-db9eb532f4c5/volumes/kubernetes.io~projected/kube-api-access-wnw8h DeviceMajor:0 DeviceMinor:60 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6dda3bac-470c-46f8-b510-8a73f6dc76c6/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/50554e95-e3c9-4f06-84ca-dd86c85bcf8a/volumes/kubernetes.io~projected/kube-api-access-2rmxd DeviceMajor:0 DeviceMinor:217 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-341 DeviceMajor:0 DeviceMinor:341 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-451 DeviceMajor:0 DeviceMinor:451 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/330d9526-3090-4286-ab5c-db9eb532f4c5/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d050f2b3-1f51-4f94-8d13-075aa3288bd1/volumes/kubernetes.io~projected/kube-api-access-5lzml DeviceMajor:0 DeviceMinor:204 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f6434cdd-b8a7-4fdb-ab00-53f19ce35b98/volumes/kubernetes.io~projected/kube-api-access-8rcsn DeviceMajor:0 DeviceMinor:63 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/05787044-8eb5-4158-a092-69f7266871fb/volumes/kubernetes.io~projected/kube-api-access-fsv9v DeviceMajor:0 DeviceMinor:214 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/03e53a8a-f8cb-4821-bd6b-ee63d0e25623/volumes/kubernetes.io~projected/kube-api-access-xldv4 DeviceMajor:0 DeviceMinor:354 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-375 DeviceMajor:0 DeviceMinor:375 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fe4d93b4-1929-4fbe-9bf3-834f03268472/volumes/kubernetes.io~secret/cluster-monitoring-operator-tls DeviceMajor:0 DeviceMinor:383 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/330d9526-3090-4286-ab5c-db9eb532f4c5/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/42d46af4-addb-42c6-a15f-d1b717fb91b8/volumes/kubernetes.io~projected/kube-api-access-gmvgr DeviceMajor:0 DeviceMinor:234 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2e3fe36b22cd9c673702a5c7682dbc42b9da359d298d88561386f76831aab893/userdata/shm DeviceMajor:0 DeviceMinor:399 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/edf682ca-dae8-42a1-a573-0995bbb7188d/volumes/kubernetes.io~projected/kube-api-access-ks7rn DeviceMajor:0 DeviceMinor:241 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-328 DeviceMajor:0 DeviceMinor:328 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ffdf3e696376dd3a528363ea11f4813e9ee0e7b058dbf654d99bcccf5733f4b6/userdata/shm DeviceMajor:0 DeviceMinor:224 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/42d46af4-addb-42c6-a15f-d1b717fb91b8/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:226 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/77501eedb58e5542a24e2aab078b4d7ad14ec809de93d1ccd806262557dc3b37/userdata/shm DeviceMajor:0 DeviceMinor:287 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/fccb0eb9-af8a-494e-b629-37a428d87ea5/volumes/kubernetes.io~projected/registry-tls DeviceMajor:0 DeviceMinor:377 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9b23111a-a892-4d92-990d-742a857450fa/volumes/kubernetes.io~projected/kube-api-access-txczj DeviceMajor:0 DeviceMinor:66 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/58a9ea73-4db8-44ee-83ac-55504736d028/volumes/kubernetes.io~projected/kube-api-access-4whx4 DeviceMajor:0 DeviceMinor:67 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/354fc15ac80d0e1a7d05a61557fd1d6c00a4a67ed851ba9a282f6aa8bd1e2fd2/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9fb838b9-ac5c-4029-9f11-98b610e5b375/volumes/kubernetes.io~projected/kube-api-access-7nhbc DeviceMajor:0 DeviceMinor:213 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-265 DeviceMajor:0 DeviceMinor:265 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5/volumes/kubernetes.io~projected/kube-api-access-msq52 DeviceMajor:0 DeviceMinor:347 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-232 DeviceMajor:0 DeviceMinor:232 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-426 DeviceMajor:0 DeviceMinor:426 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3a83a3f55a00baa4436649f6e7086410ffafccb32c6aae404e206ad6ed2d456b/userdata/shm DeviceMajor:0 DeviceMinor:433 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0b70fccbbc03bc8d398592b7eaa1f8c681a4e478cb6cddd930b838ec69648206/userdata/shm DeviceMajor:0 DeviceMinor:222 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0ec69a84f19a38cfb1a6aa7224d2730314a7a9d3212fca4f63932fa0afe5c66b/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9fb838b9-ac5c-4029-9f11-98b610e5b375/volumes/kubernetes.io~secret/samples-operator-tls DeviceMajor:0 DeviceMinor:382 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-271 DeviceMajor:0 DeviceMinor:271 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-326 DeviceMajor:0 DeviceMinor:326 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1ade9bce13703eda75a9543fc2ee307e596ff048dcbf9053da1f66e614997986/userdata/shm DeviceMajor:0 DeviceMinor:390 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8740c4c69ef0590c0f9ef9e183dabc84981a93856c967ed1085cf072b83bf963/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-289 DeviceMajor:0 DeviceMinor:289 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51/volumes/kubernetes.io~secret/networking-console-plugin-cert DeviceMajor:0 DeviceMinor:384 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e51caef4-2776-4216-9143-2c07435c062b/volumes/kubernetes.io~projected/kube-api-access-l9gzn DeviceMajor:0 DeviceMinor:212 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-291 DeviceMajor:0 DeviceMinor:291 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-402 DeviceMajor:0 DeviceMinor:402 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d06ebfd727a4b1a42b9bfc7d2e249d1cb64ad9ccbc71624dadd566ced112104d/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/034a5b503f54141e3a56cc53c0c3d91105ec9a38c7538cbf41ee7a7eace549d9/userdata/shm DeviceMajor:0 DeviceMinor:239 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-293 DeviceMajor:0 DeviceMinor:293 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/56e14829bb5be1872c2b183c2c3f089aad1f32b42c2f0db1e147ef6bb1dfac51/userdata/shm DeviceMajor:0 DeviceMinor:435 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-111 DeviceMajor:0 DeviceMinor:111 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6dda3bac-470c-46f8-b510-8a73f6dc76c6/volumes/kubernetes.io~projected/kube-api-access-tccp5 DeviceMajor:0 DeviceMinor:203 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/be2cb70fe3c74712d7df80d215733b281a66e0dba88f5e7633c84720eca0a90b/userdata/shm DeviceMajor:0 DeviceMinor:218 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-361 DeviceMajor:0 DeviceMinor:361 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/51be789d-183b-4988-9099-d5d33ad634c4/volumes/kubernetes.io~projected/kube-api-access-mw5wp DeviceMajor:0 DeviceMinor:233 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-263 DeviceMajor:0 DeviceMinor:263 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7bfe63663352988c9221141cd28716101dbb706234e1b3adeb3787a6a5a345ca/userdata/shm DeviceMajor:0 DeviceMinor:388 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-439 DeviceMajor:0 DeviceMinor:439 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-482 DeviceMajor:0 DeviceMinor:482 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fccb0eb9-af8a-494e-b629-37a428d87ea5/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:206 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/50554e95-e3c9-4f06-84ca-dd86c85bcf8a/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:209 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/51be789d-183b-4988-9099-d5d33ad634c4/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:227 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/166ed07caade26a201d728ceb1829f9bf1f1df0d11160b46bf6fdb4e8ae54655/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/33816f29-a274-4bbb-83d7-72820504fee3/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/159fdfbd-fdcc-4655-b273-f0964617ed13/volumes/kubernetes.io~projected/kube-api-access-tj9gv DeviceMajor:0 DeviceMinor:61 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5/volumes/kubernetes.io~projected/kube-api-access-wrtm2 DeviceMajor:0 DeviceMinor:62 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b0086739-e8c7-4143-b297-87002d2f7dfb/volumes/kubernetes.io~projected/kube-api-access-gvd5m DeviceMajor:0 DeviceMinor:65 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a1a12f14-a3aa-43b0-8ada-4568a87f7186/volumes/kubernetes.io~projected/kube-api-access-ktcbp DeviceMajor:0 DeviceMinor:262 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e51caef4-2776-4216-9143-2c07435c062b/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:334 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/03e53a8a-f8cb-4821-bd6b-ee63d0e25623/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:353 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d1c319e27efaccf939b4525ae53eb20e0206b9380af03c16e39630104f458272/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fccb0eb9-af8a-494e-b629-37a428d87ea5/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7479eff13b042006c3acd658daf8e57fd5b91e2d2c98cba23f205dd61d80c154/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/32eee51493c70164676708ebd1d346d8bd51f0f5ddb6236e4a40fc331e63f728/userdata/shm DeviceMajor:0 DeviceMinor:310 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-365 DeviceMajor:0 DeviceMinor:365 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/7885b2e1-6437-402d-9335-f2b5bb2be17a/volumes/kubernetes.io~projected/kube-api-access-rlnkr DeviceMajor:0 DeviceMinor:64 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fe4d93b4-1929-4fbe-9bf3-834f03268472/volumes/kubernetes.io~projected/kube-api-access-67qqz DeviceMajor:0 DeviceMinor:215 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b1c4990622b03017c61e7ec684aa2a18adf42cbe971ec9ac605343d7d346ae8c/userdata/shm DeviceMajor:0 DeviceMinor:220 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-269 DeviceMajor:0 DeviceMinor:269 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b570d68ad7275fbafce394d39b2da7af4d3d396f07bb155bc66e2895d3f25b47/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e2270aa8fda01802802363dc62d4765a2089b071a4dc109bd9541e7562a7afee/userdata/shm DeviceMajor:0 DeviceMinor:237 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-299 DeviceMajor:0 DeviceMinor:299 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-314 DeviceMajor:0 DeviceMinor:314 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-396 DeviceMajor:0 DeviceMinor:396 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-403 DeviceMajor:0 DeviceMinor:403 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-105 DeviceMajor:0 DeviceMinor:105 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e51caef4-2776-4216-9143-2c07435c062b/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:211 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/854f8ddceeea905e740290da5f9cbb66218b5da287949628742ca469425c69aa/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5e4324985f86cec518f63e5371a1092224ab27f0e3a94b14bfee0bf809ec8be7/userdata/shm DeviceMajor:0 DeviceMinor:386 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/61963d0d602361e419f13ec7172bd0f4f319bbbb7143c0e35944769e065359e6/userdata/shm DeviceMajor:0 DeviceMinor:391 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-418 DeviceMajor:0 DeviceMinor:418 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6d207e59-c491-43cb-a331-5b89a78f470c/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:432 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-460 DeviceMajor:0 DeviceMinor:460 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-284 DeviceMajor:0 DeviceMinor:284 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b93a7d1a-904e-4d81-a425-f4d3b3055354/volumes/kubernetes.io~projected/kube-api-access-kb4g2 DeviceMajor:0 DeviceMinor:301 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/720be370902f1282f3b4eb2840d68e21773874c9ddacef1b0ee4557dbdd6e8bf/userdata/shm DeviceMajor:0 DeviceMinor:394 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-419 DeviceMajor:0 DeviceMinor:419 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:034a5b503f54141 MacAddress:9a:24:ae:49:58:b2 Speed:10000 Mtu:8901} {Name:0b70fccbbc03bc8 MacAddress:86:0b:c8:28:02:dc Speed:10000 Mtu:8901} {Name:0ec69a84f19a38c MacAddress:72:40:f2:1a:d2:08 Speed:10000 Mtu:8901} {Name:1ade9bce13703ed MacAddress:4e:06:c8:11:1b:9b Speed:10000 Mtu:8901} {Name:2104fbd04fee4ec MacAddress:0e:0f:17:9c:11:6c Speed:10000 Mtu:8901} {Name:2e3fe36b22cd9c6 MacAddress:b2:ee:57:a8:8b:c2 Speed:10000 Mtu:8901} {Name:32eee51493c7016 MacAddress:0e:4a:5e:f6:69:93 Speed:10000 Mtu:8901} {Name:3a83a3f55a00baa MacAddress:32:47:8b:34:0c:4e Speed:10000 Mtu:8901} {Name:56e14829bb5be18 MacAddress:fa:65:b6:99:0d:d1 Speed:10000 Mtu:8901} {Name:5e4324985f86cec MacAddress:0e:87:7c:7a:9a:07 Speed:10000 Mtu:8901} {Name:61963d0d602361e MacAddress:82:cc:06:d0:e7:2d Speed:10000 Mtu:8901} {Name:623cf6bc7f14112 MacAddress:f6:b3:a1:cd:f8:ce Speed:10000 Mtu:8901} {Name:720be370902f128 MacAddress:1e:e2:cf:13:95:fd Speed:10000 Mtu:8901} {Name:7479eff13b04200 MacAddress:6e:a1:9a:d9:28:02 Speed:10000 Mtu:8901} {Name:77501eedb58e554 MacAddress:46:e6:c9:2f:88:16 Speed:10000 Mtu:8901} {Name:7bfe63663352988 MacAddress:42:b1:3b:2c:33:d0 Speed:10000 Mtu:8901} {Name:854f8ddceeea905 MacAddress:02:91:60:67:fa:e7 Speed:10000 Mtu:8901} {Name:b1c4990622b0301 MacAddress:6e:67:3b:27:3f:a7 Speed:10000 Mtu:8901} {Name:bd607c44404b912 MacAddress:06:64:f6:46:b0:a2 Speed:10000 Mtu:8901} {Name:be2cb70fe3c7471 MacAddress:8e:f6:6d:0a:b3:39 Speed:10000 Mtu:8901} {Name:bf3cd60ef6a76cb MacAddress:a6:db:61:ac:b2:df Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:e1:0d:a0:77 Speed:0 Mtu:9001} {Name:br-int MacAddress:72:86:0d:cf:90:ab Speed:0 Mtu:8901} {Name:e2270aa8fda0180 MacAddress:d2:c1:6b:0c:a5:76 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:e1:0d:a0:77 Speed:0 Mtu:9001} {Name:ffdf3e696376dd3 MacAddress:82:2f:58:f6:d0:4c Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:8a:97:25:00:af:44 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:2e:01:20:72:cc:1d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 31 00:56:23.510612 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.510366 5821 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 31 00:56:23.510612 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.510411 5821 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 31 00:56:23.510788 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.510762 5821 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 31 00:56:23.510917 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.510790 5821 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-179.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 31 00:56:23.510960 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.510919 5821 topology_manager.go:143] "Creating topology manager with none policy" Oct 31 00:56:23.510960 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.510927 5821 container_manager_linux.go:311] "Creating device plugin manager" Oct 31 00:56:23.510960 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.510940 5821 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 31 00:56:23.511041 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.510962 5821 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 31 00:56:23.511041 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.511033 5821 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 31 00:56:23.511204 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.511195 5821 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 31 00:56:23.511321 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.511312 5821 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 31 00:56:23.511353 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.511346 5821 kubelet.go:493] "Attempting to sync node with API server" Oct 31 00:56:23.511380 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.511361 5821 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 31 00:56:23.511380 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.511373 5821 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 31 00:56:23.511448 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.511382 5821 kubelet.go:405] "Adding apiserver pod source" Oct 31 00:56:23.511448 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.511390 5821 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 31 00:56:23.512526 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.512511 5821 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 31 00:56:23.512635 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.512528 5821 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 31 00:56:23.513039 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.513018 5821 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 31 00:56:23.515985 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.515971 5821 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 31 00:56:23.515985 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.515983 5821 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 31 00:56:23.516086 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.516075 5821 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Oct 31 00:56:23.516263 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.516252 5821 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 31 00:56:23.516307 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.516282 5821 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 31 00:56:23.516400 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.516390 5821 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 31 00:56:23.516431 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.516410 5821 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 31 00:56:23.516431 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.516419 5821 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 31 00:56:23.516431 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.516427 5821 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 31 00:56:23.516505 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.516436 5821 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 31 00:56:23.516505 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.516445 5821 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 31 00:56:23.516505 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.516463 5821 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 31 00:56:23.516505 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.516469 5821 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 31 00:56:23.516505 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.516475 5821 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 31 00:56:23.516505 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.516481 5821 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 31 00:56:23.516505 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.516496 5821 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 31 00:56:23.516505 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.516506 5821 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 31 00:56:23.516734 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.516529 5821 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 31 00:56:23.516734 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.516536 5821 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 31 00:56:23.520255 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.520237 5821 server.go:1263] "Started kubelet" Oct 31 00:56:23.520942 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.520407 5821 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 31 00:56:23.520942 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.520524 5821 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 31 00:56:23.520942 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.520860 5821 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 31 00:56:23.520866 ip-10-0-132-179 systemd[1]: Started Kubernetes Kubelet. Oct 31 00:56:23.521539 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.520935 5821 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 31 00:56:23.525081 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.523871 5821 server.go:317] "Adding debug handlers to kubelet server" Oct 31 00:56:23.526032 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.526010 5821 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 31 00:56:23.527040 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.526752 5821 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 31 00:56:23.527040 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.526767 5821 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 31 00:56:23.527040 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.526837 5821 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 31 00:56:23.527040 ip-10-0-132-179 kubenswrapper[5821]: E1031 00:56:23.526917 5821 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-179.us-east-2.compute.internal\" not found" Oct 31 00:56:23.527418 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.527318 5821 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 31 00:56:23.527418 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.527364 5821 factory.go:55] Registering systemd factory Oct 31 00:56:23.527418 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.527382 5821 factory.go:223] Registration of the systemd container factory successfully Oct 31 00:56:23.527418 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.527378 5821 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 00:50:13 +0000 UTC" deadline="2028-07-17 00:40:20.713833748 +0000 UTC" Oct 31 00:56:23.527418 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.527399 5821 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14999h43m57.186437716s" Oct 31 00:56:23.528610 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.528537 5821 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:56:23.529269 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.529218 5821 factory.go:153] Registering CRI-O factory Oct 31 00:56:23.529269 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.529236 5821 factory.go:223] Registration of the crio container factory successfully Oct 31 00:56:23.529413 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.529289 5821 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 31 00:56:23.529413 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.529307 5821 factory.go:103] Registering Raw factory Oct 31 00:56:23.529413 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.529324 5821 manager.go:1199] Started watching for new ooms in manager Oct 31 00:56:23.529734 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.529713 5821 manager.go:319] Starting recovery of all containers Oct 31 00:56:23.530000 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.529973 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03e53a8a-f8cb-4821-bd6b-ee63d0e25623" volumeName="kubernetes.io/empty-dir/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-data-volume" seLinuxMountContext="" Oct 31 00:56:23.530066 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530002 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="159fdfbd-fdcc-4655-b273-f0964617ed13" volumeName="kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs" seLinuxMountContext="" Oct 31 00:56:23.530066 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530013 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="42d46af4-addb-42c6-a15f-d1b717fb91b8" volumeName="kubernetes.io/projected/42d46af4-addb-42c6-a15f-d1b717fb91b8-kube-api-access-gmvgr" seLinuxMountContext="" Oct 31 00:56:23.530066 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530022 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="42d46af4-addb-42c6-a15f-d1b717fb91b8" volumeName="kubernetes.io/secret/42d46af4-addb-42c6-a15f-d1b717fb91b8-cert" seLinuxMountContext="" Oct 31 00:56:23.530066 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530034 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51" volumeName="kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert" seLinuxMountContext="" Oct 31 00:56:23.530066 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530046 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="edf682ca-dae8-42a1-a573-0995bbb7188d" volumeName="kubernetes.io/empty-dir/edf682ca-dae8-42a1-a573-0995bbb7188d-tmp-dir" seLinuxMountContext="" Oct 31 00:56:23.530066 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530064 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03e53a8a-f8cb-4821-bd6b-ee63d0e25623" volumeName="kubernetes.io/projected/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-kube-api-access-xldv4" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530078 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5" volumeName="kubernetes.io/configmap/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-trusted-ca-bundle" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530097 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6dda3bac-470c-46f8-b510-8a73f6dc76c6" volumeName="kubernetes.io/empty-dir/6dda3bac-470c-46f8-b510-8a73f6dc76c6-tmp" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530109 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1a12f14-a3aa-43b0-8ada-4568a87f7186" volumeName="kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530122 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0086739-e8c7-4143-b297-87002d2f7dfb" volumeName="kubernetes.io/projected/b0086739-e8c7-4143-b297-87002d2f7dfb-kube-api-access-gvd5m" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530136 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="50554e95-e3c9-4f06-84ca-dd86c85bcf8a" volumeName="kubernetes.io/secret/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-serving-cert" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530150 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="51be789d-183b-4988-9099-d5d33ad634c4" volumeName="kubernetes.io/configmap/51be789d-183b-4988-9099-d5d33ad634c4-config" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530164 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9b23111a-a892-4d92-990d-742a857450fa" volumeName="kubernetes.io/configmap/9b23111a-a892-4d92-990d-742a857450fa-serviceca" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530183 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e51caef4-2776-4216-9143-2c07435c062b" volumeName="kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530196 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fccb0eb9-af8a-494e-b629-37a428d87ea5" volumeName="kubernetes.io/configmap/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-certificates" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530223 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5" volumeName="kubernetes.io/configmap/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-ovnkube-script-lib" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530235 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="50554e95-e3c9-4f06-84ca-dd86c85bcf8a" volumeName="kubernetes.io/projected/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-kube-api-access-2rmxd" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530249 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e51caef4-2776-4216-9143-2c07435c062b" volumeName="kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-metrics-certs" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530262 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fccb0eb9-af8a-494e-b629-37a428d87ea5" volumeName="kubernetes.io/configmap/fccb0eb9-af8a-494e-b629-37a428d87ea5-trusted-ca" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530275 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fccb0eb9-af8a-494e-b629-37a428d87ea5" volumeName="kubernetes.io/secret/fccb0eb9-af8a-494e-b629-37a428d87ea5-image-registry-private-configuration" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530289 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="330d9526-3090-4286-ab5c-db9eb532f4c5" volumeName="kubernetes.io/empty-dir/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-tuned" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530301 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="58a9ea73-4db8-44ee-83ac-55504736d028" volumeName="kubernetes.io/configmap/58a9ea73-4db8-44ee-83ac-55504736d028-cni-sysctl-allowlist" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530314 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51" volumeName="kubernetes.io/configmap/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-nginx-conf" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530326 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e51caef4-2776-4216-9143-2c07435c062b" volumeName="kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-stats-auth" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530340 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="edf682ca-dae8-42a1-a573-0995bbb7188d" volumeName="kubernetes.io/projected/edf682ca-dae8-42a1-a573-0995bbb7188d-kube-api-access-ks7rn" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530354 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="edf682ca-dae8-42a1-a573-0995bbb7188d" volumeName="kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530366 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9b23111a-a892-4d92-990d-742a857450fa" volumeName="kubernetes.io/projected/9b23111a-a892-4d92-990d-742a857450fa-kube-api-access-txczj" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530386 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03e53a8a-f8cb-4821-bd6b-ee63d0e25623" volumeName="kubernetes.io/configmap/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-kube-rbac-proxy-cm" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530412 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="314bbfb5-1511-4a13-9a52-9bee729f1b2e" volumeName="kubernetes.io/projected/314bbfb5-1511-4a13-9a52-9bee729f1b2e-kube-api-access-n55jw" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530431 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3737c365-6bb7-4e45-a487-5a6ed8eda295" volumeName="kubernetes.io/projected/3737c365-6bb7-4e45-a487-5a6ed8eda295-kube-api-access-4z68r" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530444 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="50554e95-e3c9-4f06-84ca-dd86c85bcf8a" volumeName="kubernetes.io/configmap/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-config" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530458 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9fb838b9-ac5c-4029-9f11-98b610e5b375" volumeName="kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530470 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b93a7d1a-904e-4d81-a425-f4d3b3055354" volumeName="kubernetes.io/projected/b93a7d1a-904e-4d81-a425-f4d3b3055354-kube-api-access-kb4g2" seLinuxMountContext="" Oct 31 00:56:23.530460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530483 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e51caef4-2776-4216-9143-2c07435c062b" volumeName="kubernetes.io/projected/e51caef4-2776-4216-9143-2c07435c062b-kube-api-access-l9gzn" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530496 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3737c365-6bb7-4e45-a487-5a6ed8eda295" volumeName="kubernetes.io/configmap/3737c365-6bb7-4e45-a487-5a6ed8eda295-trusted-ca-bundle" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530509 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3adb1944-49fd-4158-b195-4e80ebfd8f58" volumeName="kubernetes.io/projected/3adb1944-49fd-4158-b195-4e80ebfd8f58-kube-api-access-25sgt" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530522 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5" volumeName="kubernetes.io/empty-dir/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-archives-path" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530537 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="50554e95-e3c9-4f06-84ca-dd86c85bcf8a" volumeName="kubernetes.io/configmap/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-trusted-ca" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530569 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="51be789d-183b-4988-9099-d5d33ad634c4" volumeName="kubernetes.io/projected/51be789d-183b-4988-9099-d5d33ad634c4-kube-api-access-mw5wp" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530584 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d207e59-c491-43cb-a331-5b89a78f470c" volumeName="kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530597 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6dda3bac-470c-46f8-b510-8a73f6dc76c6" volumeName="kubernetes.io/projected/6dda3bac-470c-46f8-b510-8a73f6dc76c6-kube-api-access-tccp5" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530611 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b686e125-10ef-4399-b811-42858a543682" volumeName="kubernetes.io/projected/b686e125-10ef-4399-b811-42858a543682-kube-api-access-gg55m" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530623 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5" volumeName="kubernetes.io/configmap/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-env-overrides" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530637 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6dda3bac-470c-46f8-b510-8a73f6dc76c6" volumeName="kubernetes.io/configmap/6dda3bac-470c-46f8-b510-8a73f6dc76c6-service-ca-bundle" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530651 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9fb838b9-ac5c-4029-9f11-98b610e5b375" volumeName="kubernetes.io/configmap/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-config" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530664 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fe4d93b4-1929-4fbe-9bf3-834f03268472" volumeName="kubernetes.io/configmap/fe4d93b4-1929-4fbe-9bf3-834f03268472-telemetry-config" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530677 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fe4d93b4-1929-4fbe-9bf3-834f03268472" volumeName="kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530689 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5" volumeName="kubernetes.io/configmap/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-ovnkube-config" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530701 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5" volumeName="kubernetes.io/projected/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-kube-api-access-wrtm2" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530714 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3737c365-6bb7-4e45-a487-5a6ed8eda295" volumeName="kubernetes.io/configmap/3737c365-6bb7-4e45-a487-5a6ed8eda295-service-ca-bundle" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530726 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7885b2e1-6437-402d-9335-f2b5bb2be17a" volumeName="kubernetes.io/configmap/7885b2e1-6437-402d-9335-f2b5bb2be17a-cni-binary-copy" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530736 5821 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531196 5821 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.530739 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="edf682ca-dae8-42a1-a573-0995bbb7188d" volumeName="kubernetes.io/configmap/edf682ca-dae8-42a1-a573-0995bbb7188d-config-volume" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531593 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fccb0eb9-af8a-494e-b629-37a428d87ea5" volumeName="kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531614 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fe4d93b4-1929-4fbe-9bf3-834f03268472" volumeName="kubernetes.io/projected/fe4d93b4-1929-4fbe-9bf3-834f03268472-kube-api-access-67qqz" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531630 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="58a9ea73-4db8-44ee-83ac-55504736d028" volumeName="kubernetes.io/projected/58a9ea73-4db8-44ee-83ac-55504736d028-kube-api-access-4whx4" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531674 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d050f2b3-1f51-4f94-8d13-075aa3288bd1" volumeName="kubernetes.io/projected/d050f2b3-1f51-4f94-8d13-075aa3288bd1-kube-api-access-5lzml" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531689 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f6434cdd-b8a7-4fdb-ab00-53f19ce35b98" volumeName="kubernetes.io/empty-dir/f6434cdd-b8a7-4fdb-ab00-53f19ce35b98-tmp-dir" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531702 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5" volumeName="kubernetes.io/projected/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-kube-api-access-msq52" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531716 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="51be789d-183b-4988-9099-d5d33ad634c4" volumeName="kubernetes.io/secret/51be789d-183b-4988-9099-d5d33ad634c4-serving-cert" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531728 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fccb0eb9-af8a-494e-b629-37a428d87ea5" volumeName="kubernetes.io/empty-dir/fccb0eb9-af8a-494e-b629-37a428d87ea5-ca-trust-extracted" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531739 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03e53a8a-f8cb-4821-bd6b-ee63d0e25623" volumeName="kubernetes.io/secret/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-insights-runtime-extractor-tls" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531754 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3737c365-6bb7-4e45-a487-5a6ed8eda295" volumeName="kubernetes.io/empty-dir/3737c365-6bb7-4e45-a487-5a6ed8eda295-archives-path" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531765 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="58a9ea73-4db8-44ee-83ac-55504736d028" volumeName="kubernetes.io/configmap/58a9ea73-4db8-44ee-83ac-55504736d028-cni-binary-copy" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531777 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e51caef4-2776-4216-9143-2c07435c062b" volumeName="kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-default-certificate" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531788 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5" volumeName="kubernetes.io/secret/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-ovn-node-metrics-cert" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531800 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33816f29-a274-4bbb-83d7-72820504fee3" volumeName="kubernetes.io/secret/33816f29-a274-4bbb-83d7-72820504fee3-agent-certs" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531813 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6dda3bac-470c-46f8-b510-8a73f6dc76c6" volumeName="kubernetes.io/configmap/6dda3bac-470c-46f8-b510-8a73f6dc76c6-trusted-ca-bundle" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531825 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7885b2e1-6437-402d-9335-f2b5bb2be17a" volumeName="kubernetes.io/projected/7885b2e1-6437-402d-9335-f2b5bb2be17a-kube-api-access-rlnkr" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531837 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a3528e4-8866-4d92-889c-db7d8a7271b4" volumeName="kubernetes.io/configmap/9a3528e4-8866-4d92-889c-db7d8a7271b4-config" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531849 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a3528e4-8866-4d92-889c-db7d8a7271b4" volumeName="kubernetes.io/secret/9a3528e4-8866-4d92-889c-db7d8a7271b4-serving-cert" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531860 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fccb0eb9-af8a-494e-b629-37a428d87ea5" volumeName="kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-bound-sa-token" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531873 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fccb0eb9-af8a-494e-b629-37a428d87ea5" volumeName="kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-kube-api-access-m8f7j" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531885 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33816f29-a274-4bbb-83d7-72820504fee3" volumeName="kubernetes.io/configmap/33816f29-a274-4bbb-83d7-72820504fee3-konnectivity-ca" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531896 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="58a9ea73-4db8-44ee-83ac-55504736d028" volumeName="kubernetes.io/configmap/58a9ea73-4db8-44ee-83ac-55504736d028-whereabouts-flatfile-configmap" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531908 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6dda3bac-470c-46f8-b510-8a73f6dc76c6" volumeName="kubernetes.io/empty-dir/6dda3bac-470c-46f8-b510-8a73f6dc76c6-snapshots" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531922 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a3528e4-8866-4d92-889c-db7d8a7271b4" volumeName="kubernetes.io/projected/9a3528e4-8866-4d92-889c-db7d8a7271b4-kube-api-access-6jgr2" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531935 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9fb838b9-ac5c-4029-9f11-98b610e5b375" volumeName="kubernetes.io/projected/9fb838b9-ac5c-4029-9f11-98b610e5b375-kube-api-access-7nhbc" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531948 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="05787044-8eb5-4158-a092-69f7266871fb" volumeName="kubernetes.io/projected/05787044-8eb5-4158-a092-69f7266871fb-kube-api-access-fsv9v" seLinuxMountContext="" Oct 31 00:56:23.531930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531960 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="159fdfbd-fdcc-4655-b273-f0964617ed13" volumeName="kubernetes.io/projected/159fdfbd-fdcc-4655-b273-f0964617ed13-kube-api-access-tj9gv" seLinuxMountContext="" Oct 31 00:56:23.534090 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531972 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="330d9526-3090-4286-ab5c-db9eb532f4c5" volumeName="kubernetes.io/projected/330d9526-3090-4286-ab5c-db9eb532f4c5-kube-api-access-wnw8h" seLinuxMountContext="" Oct 31 00:56:23.534090 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531986 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5" volumeName="kubernetes.io/configmap/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-service-ca-bundle" seLinuxMountContext="" Oct 31 00:56:23.534090 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.531998 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6dda3bac-470c-46f8-b510-8a73f6dc76c6" volumeName="kubernetes.io/secret/6dda3bac-470c-46f8-b510-8a73f6dc76c6-serving-cert" seLinuxMountContext="" Oct 31 00:56:23.534090 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.532010 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f6434cdd-b8a7-4fdb-ab00-53f19ce35b98" volumeName="kubernetes.io/projected/f6434cdd-b8a7-4fdb-ab00-53f19ce35b98-kube-api-access-8rcsn" seLinuxMountContext="" Oct 31 00:56:23.534090 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.532023 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="330d9526-3090-4286-ab5c-db9eb532f4c5" volumeName="kubernetes.io/empty-dir/330d9526-3090-4286-ab5c-db9eb532f4c5-tmp" seLinuxMountContext="" Oct 31 00:56:23.534090 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.532034 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7885b2e1-6437-402d-9335-f2b5bb2be17a" volumeName="kubernetes.io/configmap/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-daemon-config" seLinuxMountContext="" Oct 31 00:56:23.534090 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.532046 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0086739-e8c7-4143-b297-87002d2f7dfb" volumeName="kubernetes.io/configmap/b0086739-e8c7-4143-b297-87002d2f7dfb-iptables-alerter-script" seLinuxMountContext="" Oct 31 00:56:23.534090 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.532057 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4573d06-669b-4764-9609-9bdc204c419a" volumeName="kubernetes.io/projected/e4573d06-669b-4764-9609-9bdc204c419a-kube-api-access-mcpm8" seLinuxMountContext="" Oct 31 00:56:23.534090 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.532070 5821 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fccb0eb9-af8a-494e-b629-37a428d87ea5" volumeName="kubernetes.io/secret/fccb0eb9-af8a-494e-b629-37a428d87ea5-installation-pull-secrets" seLinuxMountContext="" Oct 31 00:56:23.534090 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.532082 5821 reconstruct.go:97] "Volume reconstruction finished" Oct 31 00:56:23.534090 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.532088 5821 reconciler.go:29] "Reconciler: start to sync state" Oct 31 00:56:23.536052 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.536031 5821 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Oct 31 00:56:23.554254 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.554228 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/1.log" Oct 31 00:56:23.554366 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.554228 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/1.log" Oct 31 00:56:23.556949 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.556919 5821 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 31 00:56:23.558476 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.558449 5821 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 31 00:56:23.558476 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.558471 5821 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 31 00:56:23.558662 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.558492 5821 kubelet.go:2521] "Starting kubelet main sync loop" Oct 31 00:56:23.558662 ip-10-0-132-179 kubenswrapper[5821]: E1031 00:56:23.558535 5821 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 31 00:56:23.564900 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.562656 5821 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 31 00:56:23.595275 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.595250 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/1.log" Oct 31 00:56:23.595390 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.595282 5821 generic.go:356] "Generic (PLEG): container finished" podID="50554e95-e3c9-4f06-84ca-dd86c85bcf8a" containerID="fc3eea3b3dbedee8a2622cc589a65c73f1195478bf203060dfca8c7396bea6d9" exitCode=255 Oct 31 00:56:23.597676 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.597648 5821 generic.go:356] "Generic (PLEG): container finished" podID="6dda3bac-470c-46f8-b510-8a73f6dc76c6" containerID="b00a290acfe998e127ec71d0107eb5de897b8e9390fb36b62e6c00bfdcc2f211" exitCode=0 Oct 31 00:56:23.608726 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.608702 5821 generic.go:356] "Generic (PLEG): container finished" podID="d8e91b3b436f98c50afdd4fa50ff7ebd" containerID="517820daec75189a43a495d15d663b6a3af0e119baeca473ef63a16f33da02cb" exitCode=0 Oct 31 00:56:23.626310 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.626249 5821 generic.go:356] "Generic (PLEG): container finished" podID="58a9ea73-4db8-44ee-83ac-55504736d028" containerID="f11ece74ec58928153e860f27a359ac81fb04177942e78fffd155e9484719d4e" exitCode=0 Oct 31 00:56:23.626310 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.626279 5821 generic.go:356] "Generic (PLEG): container finished" podID="58a9ea73-4db8-44ee-83ac-55504736d028" containerID="5cf2038ea5fe42865c10f9d5103a271d4d2160855491d1023fafe537417aa4c6" exitCode=0 Oct 31 00:56:23.626310 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.626291 5821 generic.go:356] "Generic (PLEG): container finished" podID="58a9ea73-4db8-44ee-83ac-55504736d028" containerID="75f198f5c49509add9b6e3aacd6ec61b09dce49fcbc3018821ed92975b9eeda8" exitCode=0 Oct 31 00:56:23.626310 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.626300 5821 generic.go:356] "Generic (PLEG): container finished" podID="58a9ea73-4db8-44ee-83ac-55504736d028" containerID="f1b57e461d8ba2a6cc04df6479684ebbff35820efe43a0ad4f10ee78f8b6ef22" exitCode=0 Oct 31 00:56:23.626310 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.626309 5821 generic.go:356] "Generic (PLEG): container finished" podID="58a9ea73-4db8-44ee-83ac-55504736d028" containerID="63fd89da8b674d4ea3ed037d0c1cf4bd0eb3ac014a1c2cd3bdf5c60cd6f88ab7" exitCode=0 Oct 31 00:56:23.626527 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.626317 5821 generic.go:356] "Generic (PLEG): container finished" podID="58a9ea73-4db8-44ee-83ac-55504736d028" containerID="8d6a00b144a0b346f4859f3dcd6ec6fb8ce601dde3f352fb7315056731e85728" exitCode=0 Oct 31 00:56:23.645628 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.645610 5821 manager.go:324] Recovery completed Oct 31 00:56:23.659162 ip-10-0-132-179 kubenswrapper[5821]: E1031 00:56:23.659140 5821 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Oct 31 00:56:23.668152 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.668135 5821 cpu_manager.go:226] "Starting" policy="none" Oct 31 00:56:23.668152 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.668148 5821 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 31 00:56:23.668313 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.668164 5821 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 31 00:56:23.668313 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.668271 5821 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Oct 31 00:56:23.668313 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.668281 5821 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Oct 31 00:56:23.668313 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.668298 5821 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Oct 31 00:56:23.668313 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.668303 5821 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Oct 31 00:56:23.668313 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.668308 5821 policy_none.go:50] "Start" Oct 31 00:56:23.668313 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.668317 5821 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 31 00:56:23.668548 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.668327 5821 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 31 00:56:23.668548 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.668451 5821 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Oct 31 00:56:23.668548 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.668458 5821 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Oct 31 00:56:23.668548 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.668464 5821 policy_none.go:44] "Start" Oct 31 00:56:23.674264 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.674220 5821 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 31 00:56:23.676999 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.676981 5821 manager.go:341] "Starting Device Plugin manager" Oct 31 00:56:23.677458 ip-10-0-132-179 kubenswrapper[5821]: E1031 00:56:23.677013 5821 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 31 00:56:23.677537 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.677461 5821 server.go:87] "Starting device plugin registration server" Oct 31 00:56:23.677774 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.677760 5821 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 31 00:56:23.677854 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.677774 5821 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 31 00:56:23.677854 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.677839 5821 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 31 00:56:23.677954 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.677911 5821 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 31 00:56:23.677954 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.677941 5821 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 31 00:56:23.677954 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.677947 5821 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 31 00:56:23.678094 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.677999 5821 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T00:56:23.677933526Z","UUID":"ece0c020-457d-465c-b0eb-72036c4f557f","Handler":null,"Name":"","Endpoint":""} Oct 31 00:56:23.679582 ip-10-0-132-179 kubenswrapper[5821]: E1031 00:56:23.679542 5821 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 31 00:56:23.679685 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.679622 5821 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 31 00:56:23.679685 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.679652 5821 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 31 00:56:23.778843 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.778817 5821 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 31 00:56:23.780692 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.780669 5821 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 31 00:56:23.780861 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.780704 5821 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 31 00:56:23.780861 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.780715 5821 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-179.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 31 00:56:23.780861 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.780758 5821 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:56:23.793687 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.793668 5821 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:56:23.793765 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.793731 5821 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:56:23.859792 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.859737 5821 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal"] Oct 31 00:56:23.860378 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.860362 5821 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:56:23.860463 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.860344 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal" event={"ID":"0222b47fe84780a8d4956385717c70a6","Type":"ContainerStarted","Data":"7182ee49e1cca425bc7e912464f04030ff83f980b15a8c76a649c70c95739d2b"} Oct 31 00:56:23.860517 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.860472 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal" event={"ID":"0222b47fe84780a8d4956385717c70a6","Type":"ContainerStarted","Data":"c21eb5eb1093fe216589c3bc7ee8119c13ed65eac6f72ecd12aaf93d06829b9c"} Oct 31 00:56:23.860517 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.860489 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" event={"ID":"d8e91b3b436f98c50afdd4fa50ff7ebd","Type":"ContainerStarted","Data":"e6d159dd51822082c3ba944956da8e9b34dce5378ffccf43f62fdf8dfa44b7b0"} Oct 31 00:56:23.860517 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.860505 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" event={"ID":"d8e91b3b436f98c50afdd4fa50ff7ebd","Type":"ContainerDied","Data":"517820daec75189a43a495d15d663b6a3af0e119baeca473ef63a16f33da02cb"} Oct 31 00:56:23.860673 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.860522 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" event={"ID":"d8e91b3b436f98c50afdd4fa50ff7ebd","Type":"ContainerStarted","Data":"166ed07caade26a201d728ceb1829f9bf1f1df0d11160b46bf6fdb4e8ae54655"} Oct 31 00:56:23.860673 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.860526 5821 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:56:23.872589 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.872573 5821 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 00:56:23.872672 ip-10-0-132-179 kubenswrapper[5821]: E1031 00:56:23.872611 5821 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:56:23.873091 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.873068 5821 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 00:56:23.873192 ip-10-0-132-179 kubenswrapper[5821]: E1031 00:56:23.873103 5821 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:56:23.938396 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.938342 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0222b47fe84780a8d4956385717c70a6-config\") pod \"kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal\" (UID: \"0222b47fe84780a8d4956385717c70a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:56:23.938396 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.938372 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d8e91b3b436f98c50afdd4fa50ff7ebd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal\" (UID: \"d8e91b3b436f98c50afdd4fa50ff7ebd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:56:23.938396 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:23.938388 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8e91b3b436f98c50afdd4fa50ff7ebd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal\" (UID: \"d8e91b3b436f98c50afdd4fa50ff7ebd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:56:24.038935 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.038908 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0222b47fe84780a8d4956385717c70a6-config\") pod \"kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal\" (UID: \"0222b47fe84780a8d4956385717c70a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:56:24.039048 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.038938 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d8e91b3b436f98c50afdd4fa50ff7ebd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal\" (UID: \"d8e91b3b436f98c50afdd4fa50ff7ebd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:56:24.039048 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.038958 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8e91b3b436f98c50afdd4fa50ff7ebd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal\" (UID: \"d8e91b3b436f98c50afdd4fa50ff7ebd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:56:24.039048 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.039002 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8e91b3b436f98c50afdd4fa50ff7ebd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal\" (UID: \"d8e91b3b436f98c50afdd4fa50ff7ebd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:56:24.039048 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.039021 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d8e91b3b436f98c50afdd4fa50ff7ebd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal\" (UID: \"d8e91b3b436f98c50afdd4fa50ff7ebd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:56:24.039048 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.039023 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0222b47fe84780a8d4956385717c70a6-config\") pod \"kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal\" (UID: \"0222b47fe84780a8d4956385717c70a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:56:24.511790 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.511756 5821 apiserver.go:52] "Watching apiserver" Oct 31 00:56:24.530714 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.530682 5821 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 31 00:56:24.531403 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.531371 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-jwv8k","openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl","openshift-cluster-node-tuning-operator/tuned-cbsws","openshift-ingress-canary/ingress-canary-wqhkd","openshift-insights/insights-runtime-extractor-66jgl","kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal","openshift-network-operator/iptables-alerter-gsdzf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wffrk","openshift-network-console/networking-console-plugin-86c478bb88-fb9mh","openshift-dns/dns-default-kg2kz","openshift-dns/node-resolver-twq8q","openshift-image-registry/image-registry-786bfcf6b7-n7gm9","kube-system/kas-connection-checker-685895c7c9-s8pvr","openshift-multus/multus-additional-cni-plugins-qbrtn","openshift-network-diagnostics/network-check-target-r8q7t","openshift-insights/insights-operator-7c4986d449-7sfl6","openshift-multus/network-metrics-daemon-4bzzq","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp","kube-system/global-pull-secret-syncer-wtcjv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal","openshift-ovn-kubernetes/ovnkube-node-4kgjb","kube-system/kas-connection-checker-685895c7c9-l8fz4","kube-system/konnectivity-agent-fzjbb","openshift-image-registry/node-ca-6mv8k","openshift-insights/periodic-gathering-kgzkz-wqj59","openshift-multus/multus-nl27p","openshift-kube-storage-version-migrator/migrator-66df5d496b-bfx9m","openshift-insights/periodic-gathering-gqgf7-x4kfr","kube-system/kas-connection-checker-685895c7c9-md87z","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l","openshift-ingress/router-default-788b97d875-vrvqf","openshift-console-operator/console-operator-7cd56b8dbc-qtvqf","openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb"] Oct 31 00:56:24.536843 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.536812 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Oct 31 00:56:24.536944 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.536861 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-b7f5d\"" Oct 31 00:56:24.537206 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.537185 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Oct 31 00:56:24.537281 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.537220 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 31 00:56:24.537281 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.537246 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Oct 31 00:56:24.538467 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.538443 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Oct 31 00:56:24.544588 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.544541 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Oct 31 00:56:24.544689 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.544588 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-v2vnh\"" Oct 31 00:56:24.545908 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.545885 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-x6mdk\"" Oct 31 00:56:24.546135 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.546101 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-plh8z\"" Oct 31 00:56:24.546135 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.546109 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Oct 31 00:56:24.546252 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.546150 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Oct 31 00:56:24.546344 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.546328 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 31 00:56:24.546400 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.546360 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:56:24.546400 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.546369 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:56:24.546400 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.546354 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Oct 31 00:56:24.546400 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.546386 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Oct 31 00:56:24.546400 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.546388 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:56:24.546615 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.546470 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 31 00:56:24.546648 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.546633 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Oct 31 00:56:24.547314 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.547297 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 31 00:56:24.547366 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.547327 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 31 00:56:24.547397 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.547374 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Oct 31 00:56:24.547531 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.547511 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Oct 31 00:56:24.547736 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.547715 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Oct 31 00:56:24.547736 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.547718 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Oct 31 00:56:24.547901 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.547722 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 31 00:56:24.547901 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.547752 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Oct 31 00:56:24.547901 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.547794 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Oct 31 00:56:24.547901 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.547850 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Oct 31 00:56:24.548086 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.548022 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Oct 31 00:56:24.548086 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.548078 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Oct 31 00:56:24.548237 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.548123 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4k65v\"" Oct 31 00:56:24.548237 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.548217 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-z766m\"" Oct 31 00:56:24.549338 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.549318 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Oct 31 00:56:24.549417 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.549357 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Oct 31 00:56:24.549417 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.549404 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Oct 31 00:56:24.549527 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.549463 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:56:24.549527 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.549492 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dxd8s\"" Oct 31 00:56:24.549527 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.549495 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Oct 31 00:56:24.549527 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.549510 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Oct 31 00:56:24.549527 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.549510 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:56:24.549781 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.549582 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-9n8qj\"" Oct 31 00:56:24.549781 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.549768 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 31 00:56:24.549879 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.549808 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 31 00:56:24.549879 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.549816 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Oct 31 00:56:24.549879 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.549843 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 31 00:56:24.549879 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.549850 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 31 00:56:24.549879 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.549860 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 31 00:56:24.551038 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.551019 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Oct 31 00:56:24.551154 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.551140 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Oct 31 00:56:24.551224 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.551216 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9nr5w\"" Oct 31 00:56:24.551628 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.551610 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-46xb4\"" Oct 31 00:56:24.551727 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.551714 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-89pfs\"" Oct 31 00:56:24.551819 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.551804 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-xb7hg\"" Oct 31 00:56:24.551856 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.551839 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dlpqk\"" Oct 31 00:56:24.553185 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.553170 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 31 00:56:24.553261 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.553213 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 31 00:56:24.553261 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.553231 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 31 00:56:24.556807 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.556789 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 31 00:56:24.557770 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.557754 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 31 00:56:24.558651 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.558637 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 31 00:56:24.558691 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.558664 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 31 00:56:24.558741 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.558695 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 31 00:56:24.558812 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.558798 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Oct 31 00:56:24.558861 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.558812 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 31 00:56:24.558861 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.558848 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Oct 31 00:56:24.558949 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.558852 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 31 00:56:24.558949 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.558883 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 31 00:56:24.558949 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.558906 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 31 00:56:24.559081 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.558958 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 31 00:56:24.559081 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.558973 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 31 00:56:24.559081 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.558996 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 31 00:56:24.559081 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.559025 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:56:24.559321 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.559304 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-gczx4\"" Oct 31 00:56:24.559365 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.559322 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 31 00:56:24.559406 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.559393 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9dpj5\"" Oct 31 00:56:24.560320 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.560305 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 31 00:56:24.560370 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.560362 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-89rf9\"" Oct 31 00:56:24.560417 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.560383 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-xxmpd\"" Oct 31 00:56:24.560464 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.560450 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m2wnh\"" Oct 31 00:56:24.560959 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.560885 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xcm4p\"" Oct 31 00:56:24.561091 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.560986 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 31 00:56:24.561146 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.560885 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 31 00:56:24.561146 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.561112 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j9qsc\"" Oct 31 00:56:24.561287 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.561270 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 31 00:56:24.561334 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.561288 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 31 00:56:24.561460 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.561442 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 31 00:56:24.561508 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.561490 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 31 00:56:24.561760 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.561743 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4j5v2\"" Oct 31 00:56:24.564921 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.564900 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 31 00:56:24.565001 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.564921 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 31 00:56:24.565001 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.564946 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 31 00:56:24.565001 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.564958 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 31 00:56:24.565001 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.564900 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Oct 31 00:56:24.565001 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.564921 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 31 00:56:24.565001 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.564921 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ht5gb\"" Oct 31 00:56:24.565253 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.564989 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 31 00:56:24.565253 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.565013 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-jrg45\"" Oct 31 00:56:24.565253 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.565159 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xgrpm\"" Oct 31 00:56:24.565253 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.565215 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Oct 31 00:56:24.565429 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.565294 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Oct 31 00:56:24.565429 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.565359 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-72bs2\"" Oct 31 00:56:24.565429 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.565404 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-58wnq\"" Oct 31 00:56:24.565661 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.565636 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 31 00:56:24.566602 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.566576 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p5vm9\"" Oct 31 00:56:24.566679 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.566666 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 31 00:56:24.568159 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.568145 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 31 00:56:24.568333 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.568319 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Oct 31 00:56:24.629855 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.629836 5821 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 31 00:56:24.634513 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.634496 5821 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:56:24.634647 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.634633 5821 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:56:24.641701 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.641683 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51be789d-183b-4988-9099-d5d33ad634c4-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l\" (UID: \"51be789d-183b-4988-9099-d5d33ad634c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" Oct 31 00:56:24.641757 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.641710 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-kubernetes\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.641757 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.641732 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/330d9526-3090-4286-ab5c-db9eb532f4c5-tmp\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.641818 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.641758 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6434cdd-b8a7-4fdb-ab00-53f19ce35b98-hosts-file\") pod \"node-resolver-twq8q\" (UID: \"f6434cdd-b8a7-4fdb-ab00-53f19ce35b98\") " pod="openshift-dns/node-resolver-twq8q" Oct 31 00:56:24.641818 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.641782 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-system-cni-dir\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.641873 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.641817 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-cni-dir\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.641873 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.641853 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj9gv\" (UniqueName: \"kubernetes.io/projected/159fdfbd-fdcc-4655-b273-f0964617ed13-kube-api-access-tj9gv\") pod \"network-metrics-daemon-4bzzq\" (UID: \"159fdfbd-fdcc-4655-b273-f0964617ed13\") " pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:56:24.641930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.641879 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-socket-dir-parent\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.641930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.641921 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-run-netns\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.641990 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.641953 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-node-log\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.642020 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.641997 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/330d9526-3090-4286-ab5c-db9eb532f4c5-tmp\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.642052 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642040 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-sys\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.642093 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642076 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-ovnkube-config\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.642127 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642119 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51be789d-183b-4988-9099-d5d33ad634c4-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l\" (UID: \"51be789d-183b-4988-9099-d5d33ad634c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" Oct 31 00:56:24.642157 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642142 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3737c365-6bb7-4e45-a487-5a6ed8eda295-trusted-ca-bundle\") pod \"periodic-gathering-gqgf7-x4kfr\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:24.642186 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642172 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-nginx-conf\") pod \"networking-console-plugin-86c478bb88-fb9mh\" (UID: \"a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fb9mh" Oct 31 00:56:24.642218 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642191 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-daemon-config\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.642218 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642208 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/edf682ca-dae8-42a1-a573-0995bbb7188d-config-volume\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:56:24.642289 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642228 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fccb0eb9-af8a-494e-b629-37a428d87ea5-image-registry-private-configuration\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:24.642289 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642255 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fb9mh\" (UID: \"a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fb9mh" Oct 31 00:56:24.642289 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642278 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67qqz\" (UniqueName: \"kubernetes.io/projected/fe4d93b4-1929-4fbe-9bf3-834f03268472-kube-api-access-67qqz\") pod \"cluster-monitoring-operator-884576c57-znxnl\" (UID: \"fe4d93b4-1929-4fbe-9bf3-834f03268472\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:56:24.642436 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642304 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-archives-path\") pod \"periodic-gathering-kgzkz-wqj59\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:24.642436 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642317 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-ovnkube-config\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.642436 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642329 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nhbc\" (UniqueName: \"kubernetes.io/projected/9fb838b9-ac5c-4029-9f11-98b610e5b375-kube-api-access-7nhbc\") pod \"cluster-samples-operator-6ddb6c8b94-rsxrp\" (UID: \"9fb838b9-ac5c-4029-9f11-98b610e5b375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:56:24.642436 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642355 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3737c365-6bb7-4e45-a487-5a6ed8eda295-service-ca-bundle\") pod \"periodic-gathering-gqgf7-x4kfr\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:24.642436 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642379 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33816f29-a274-4bbb-83d7-72820504fee3-konnectivity-ca\") pod \"konnectivity-agent-fzjbb\" (UID: \"33816f29-a274-4bbb-83d7-72820504fee3\") " pod="kube-system/konnectivity-agent-fzjbb" Oct 31 00:56:24.642436 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642407 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-systemd-units\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.642436 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642415 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3737c365-6bb7-4e45-a487-5a6ed8eda295-trusted-ca-bundle\") pod \"periodic-gathering-gqgf7-x4kfr\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:24.642436 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642433 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:24.642436 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642420 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-daemon-config\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642437 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-nginx-conf\") pod \"networking-console-plugin-86c478bb88-fb9mh\" (UID: \"a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fb9mh" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642457 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42d46af4-addb-42c6-a15f-d1b717fb91b8-cert\") pod \"ingress-canary-wqhkd\" (UID: \"42d46af4-addb-42c6-a15f-d1b717fb91b8\") " pod="openshift-ingress-canary/ingress-canary-wqhkd" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642481 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642481 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/edf682ca-dae8-42a1-a573-0995bbb7188d-config-volume\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642504 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-trusted-ca-bundle\") pod \"periodic-gathering-kgzkz-wqj59\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642513 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-archives-path\") pod \"periodic-gathering-kgzkz-wqj59\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642532 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-registration-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642538 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fccb0eb9-af8a-494e-b629-37a428d87ea5-image-registry-private-configuration\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642582 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25sgt\" (UniqueName: \"kubernetes.io/projected/3adb1944-49fd-4158-b195-4e80ebfd8f58-kube-api-access-25sgt\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642612 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fccb0eb9-af8a-494e-b629-37a428d87ea5-ca-trust-extracted\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642627 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3737c365-6bb7-4e45-a487-5a6ed8eda295-service-ca-bundle\") pod \"periodic-gathering-gqgf7-x4kfr\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642637 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8f7j\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-kube-api-access-m8f7j\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642628 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fb9mh\" (UID: \"a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fb9mh" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642663 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/58a9ea73-4db8-44ee-83ac-55504736d028-cnibin\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642690 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4whx4\" (UniqueName: \"kubernetes.io/projected/58a9ea73-4db8-44ee-83ac-55504736d028-kube-api-access-4whx4\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642700 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e51caef4-2776-4216-9143-2c07435c062b-service-ca-bundle\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642717 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642786 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33816f29-a274-4bbb-83d7-72820504fee3-konnectivity-ca\") pod \"konnectivity-agent-fzjbb\" (UID: \"33816f29-a274-4bbb-83d7-72820504fee3\") " pod="kube-system/konnectivity-agent-fzjbb" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642795 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-run-netns\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642807 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42d46af4-addb-42c6-a15f-d1b717fb91b8-cert\") pod \"ingress-canary-wqhkd\" (UID: \"42d46af4-addb-42c6-a15f-d1b717fb91b8\") " pod="openshift-ingress-canary/ingress-canary-wqhkd" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642821 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edf682ca-dae8-42a1-a573-0995bbb7188d-metrics-tls\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642827 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-run-multus-certs\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.642876 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642878 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rmxd\" (UniqueName: \"kubernetes.io/projected/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-kube-api-access-2rmxd\") pod \"console-operator-7cd56b8dbc-qtvqf\" (UID: \"50554e95-e3c9-4f06-84ca-dd86c85bcf8a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.642951 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-znxnl\" (UID: \"fe4d93b4-1929-4fbe-9bf3-834f03268472\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643027 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643051 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fccb0eb9-af8a-494e-b629-37a428d87ea5-ca-trust-extracted\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643084 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-etc-openvswitch\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643142 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-run-ovn-kubernetes\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643172 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6434cdd-b8a7-4fdb-ab00-53f19ce35b98-tmp-dir\") pod \"node-resolver-twq8q\" (UID: \"f6434cdd-b8a7-4fdb-ab00-53f19ce35b98\") " pod="openshift-dns/node-resolver-twq8q" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643183 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe4d93b4-1929-4fbe-9bf3-834f03268472-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-znxnl\" (UID: \"fe4d93b4-1929-4fbe-9bf3-834f03268472\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643200 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-sys-fs\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643201 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-trusted-ca-bundle\") pod \"periodic-gathering-kgzkz-wqj59\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643245 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33816f29-a274-4bbb-83d7-72820504fee3-agent-certs\") pod \"konnectivity-agent-fzjbb\" (UID: \"33816f29-a274-4bbb-83d7-72820504fee3\") " pod="kube-system/konnectivity-agent-fzjbb" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643279 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6434cdd-b8a7-4fdb-ab00-53f19ce35b98-tmp-dir\") pod \"node-resolver-twq8q\" (UID: \"f6434cdd-b8a7-4fdb-ab00-53f19ce35b98\") " pod="openshift-dns/node-resolver-twq8q" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643282 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-bound-sa-token\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643325 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs\") pod \"network-metrics-daemon-4bzzq\" (UID: \"159fdfbd-fdcc-4655-b273-f0964617ed13\") " pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643361 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/58a9ea73-4db8-44ee-83ac-55504736d028-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643378 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-data-volume\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643394 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-var-lib-kubelet\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643445 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33816f29-a274-4bbb-83d7-72820504fee3-agent-certs\") pod \"konnectivity-agent-fzjbb\" (UID: \"33816f29-a274-4bbb-83d7-72820504fee3\") " pod="kube-system/konnectivity-agent-fzjbb" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643469 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-data-volume\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643568 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/58a9ea73-4db8-44ee-83ac-55504736d028-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643575 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-cni-netd\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643608 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b0086739-e8c7-4143-b297-87002d2f7dfb-iptables-alerter-script\") pod \"iptables-alerter-gsdzf\" (UID: \"b0086739-e8c7-4143-b297-87002d2f7dfb\") " pod="openshift-network-operator/iptables-alerter-gsdzf" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643635 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-lib-modules\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643679 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-kubelet\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643686 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/159fdfbd-fdcc-4655-b273-f0964617ed13-metrics-certs\") pod \"network-metrics-daemon-4bzzq\" (UID: \"159fdfbd-fdcc-4655-b273-f0964617ed13\") " pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643747 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-slash\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643770 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b0086739-e8c7-4143-b297-87002d2f7dfb-iptables-alerter-script\") pod \"iptables-alerter-gsdzf\" (UID: \"b0086739-e8c7-4143-b297-87002d2f7dfb\") " pod="openshift-network-operator/iptables-alerter-gsdzf" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643799 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-default-certificate\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643823 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-metrics-certs\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643838 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-sysconfig\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643883 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643912 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9gzn\" (UniqueName: \"kubernetes.io/projected/e51caef4-2776-4216-9143-2c07435c062b-kube-api-access-l9gzn\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643928 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-crio-socket\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.643969 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-var-lib-kubelet\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644001 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-metrics-certs\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:24.644018 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644030 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmvgr\" (UniqueName: \"kubernetes.io/projected/42d46af4-addb-42c6-a15f-d1b717fb91b8-kube-api-access-gmvgr\") pod \"ingress-canary-wqhkd\" (UID: \"42d46af4-addb-42c6-a15f-d1b717fb91b8\") " pod="openshift-ingress-canary/ingress-canary-wqhkd" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644067 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txczj\" (UniqueName: \"kubernetes.io/projected/9b23111a-a892-4d92-990d-742a857450fa-kube-api-access-txczj\") pod \"node-ca-6mv8k\" (UID: \"9b23111a-a892-4d92-990d-742a857450fa\") " pod="openshift-image-registry/node-ca-6mv8k" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644126 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-rsxrp\" (UID: \"9fb838b9-ac5c-4029-9f11-98b610e5b375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644138 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-default-certificate\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644167 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b23111a-a892-4d92-990d-742a857450fa-serviceca\") pod \"node-ca-6mv8k\" (UID: \"9b23111a-a892-4d92-990d-742a857450fa\") " pod="openshift-image-registry/node-ca-6mv8k" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644268 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-rsxrp\" (UID: \"9fb838b9-ac5c-4029-9f11-98b610e5b375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644287 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-run-ovn\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644307 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-ovn-node-metrics-cert\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644332 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a3528e4-8866-4d92-889c-db7d8a7271b4-serving-cert\") pod \"service-ca-operator-544d749c8c-wd5gb\" (UID: \"9a3528e4-8866-4d92-889c-db7d8a7271b4\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644436 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlnkr\" (UniqueName: \"kubernetes.io/projected/7885b2e1-6437-402d-9335-f2b5bb2be17a-kube-api-access-rlnkr\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644469 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edf682ca-dae8-42a1-a573-0995bbb7188d-tmp-dir\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644507 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lzml\" (UniqueName: \"kubernetes.io/projected/d050f2b3-1f51-4f94-8d13-075aa3288bd1-kube-api-access-5lzml\") pod \"kas-connection-checker-685895c7c9-s8pvr\" (UID: \"d050f2b3-1f51-4f94-8d13-075aa3288bd1\") " pod="kube-system/kas-connection-checker-685895c7c9-s8pvr" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644538 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-socket-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644581 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d207e59-c491-43cb-a331-5b89a78f470c-dbus\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644568 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-ovn-node-metrics-cert\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644607 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fccb0eb9-af8a-494e-b629-37a428d87ea5-trusted-ca\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644721 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-cnibin\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644751 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-var-lib-cni-bin\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644778 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dda3bac-470c-46f8-b510-8a73f6dc76c6-service-ca-bundle\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644812 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edf682ca-dae8-42a1-a573-0995bbb7188d-tmp-dir\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644817 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b23111a-a892-4d92-990d-742a857450fa-serviceca\") pod \"node-ca-6mv8k\" (UID: \"9b23111a-a892-4d92-990d-742a857450fa\") " pod="openshift-image-registry/node-ca-6mv8k" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644826 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a3528e4-8866-4d92-889c-db7d8a7271b4-serving-cert\") pod \"service-ca-operator-544d749c8c-wd5gb\" (UID: \"9a3528e4-8866-4d92-889c-db7d8a7271b4\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644832 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-host\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644847 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fccb0eb9-af8a-494e-b629-37a428d87ea5-trusted-ca\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644875 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-run-k8s-cni-cncf-io\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644906 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z68r\" (UniqueName: \"kubernetes.io/projected/3737c365-6bb7-4e45-a487-5a6ed8eda295-kube-api-access-4z68r\") pod \"periodic-gathering-gqgf7-x4kfr\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.644910 5821 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: E1031 00:56:24.644954 5821 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645013 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dda3bac-470c-46f8-b510-8a73f6dc76c6-service-ca-bundle\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645041 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n55jw\" (UniqueName: \"kubernetes.io/projected/314bbfb5-1511-4a13-9a52-9bee729f1b2e-kube-api-access-n55jw\") pod \"kas-connection-checker-685895c7c9-l8fz4\" (UID: \"314bbfb5-1511-4a13-9a52-9bee729f1b2e\") " pod="kube-system/kas-connection-checker-685895c7c9-l8fz4" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645111 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645132 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645149 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnw8h\" (UniqueName: \"kubernetes.io/projected/330d9526-3090-4286-ab5c-db9eb532f4c5-kube-api-access-wnw8h\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645284 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-var-lib-openvswitch\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645309 5821 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645318 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-service-ca-bundle\") pod \"periodic-gathering-kgzkz-wqj59\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645347 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51be789d-183b-4988-9099-d5d33ad634c4-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l\" (UID: \"51be789d-183b-4988-9099-d5d33ad634c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645377 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-hostroot\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645400 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645406 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-conf-dir\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: E1031 00:56:24.645350 5821 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-179.us-east-2.compute.internal" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645421 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d207e59-c491-43cb-a331-5b89a78f470c-original-pull-secret\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645433 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvd5m\" (UniqueName: \"kubernetes.io/projected/b0086739-e8c7-4143-b297-87002d2f7dfb-kube-api-access-gvd5m\") pod \"iptables-alerter-gsdzf\" (UID: \"b0086739-e8c7-4143-b297-87002d2f7dfb\") " pod="openshift-network-operator/iptables-alerter-gsdzf" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645457 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-serving-cert\") pod \"console-operator-7cd56b8dbc-qtvqf\" (UID: \"50554e95-e3c9-4f06-84ca-dd86c85bcf8a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645507 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-service-ca-bundle\") pod \"periodic-gathering-kgzkz-wqj59\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:24.645501 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645518 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-env-overrides\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645547 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fe4d93b4-1929-4fbe-9bf3-834f03268472-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-znxnl\" (UID: \"fe4d93b4-1929-4fbe-9bf3-834f03268472\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645585 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51be789d-183b-4988-9099-d5d33ad634c4-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l\" (UID: \"51be789d-183b-4988-9099-d5d33ad634c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645598 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-run-systemd\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645618 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rcsn\" (UniqueName: \"kubernetes.io/projected/f6434cdd-b8a7-4fdb-ab00-53f19ce35b98-kube-api-access-8rcsn\") pod \"node-resolver-twq8q\" (UID: \"f6434cdd-b8a7-4fdb-ab00-53f19ce35b98\") " pod="openshift-dns/node-resolver-twq8q" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645635 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d207e59-c491-43cb-a331-5b89a78f470c-kubelet-config\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645672 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fccb0eb9-af8a-494e-b629-37a428d87ea5-installation-pull-secrets\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645673 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-env-overrides\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645698 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-etc-kubernetes\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645749 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-config\") pod \"console-operator-7cd56b8dbc-qtvqf\" (UID: \"50554e95-e3c9-4f06-84ca-dd86c85bcf8a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645775 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-serving-cert\") pod \"console-operator-7cd56b8dbc-qtvqf\" (UID: \"50554e95-e3c9-4f06-84ca-dd86c85bcf8a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645792 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcpm8\" (UniqueName: \"kubernetes.io/projected/e4573d06-669b-4764-9609-9bdc204c419a-kube-api-access-mcpm8\") pod \"kas-connection-checker-685895c7c9-md87z\" (UID: \"e4573d06-669b-4764-9609-9bdc204c419a\") " pod="kube-system/kas-connection-checker-685895c7c9-md87z" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645814 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-stats-auth\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645838 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xldv4\" (UniqueName: \"kubernetes.io/projected/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-kube-api-access-xldv4\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645903 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-config\") pod \"console-operator-7cd56b8dbc-qtvqf\" (UID: \"50554e95-e3c9-4f06-84ca-dd86c85bcf8a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645905 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fe4d93b4-1929-4fbe-9bf3-834f03268472-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-znxnl\" (UID: \"fe4d93b4-1929-4fbe-9bf3-834f03268472\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645957 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-var-lib-cni-multus\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.645999 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fccb0eb9-af8a-494e-b629-37a428d87ea5-installation-pull-secrets\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646059 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dda3bac-470c-46f8-b510-8a73f6dc76c6-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646086 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-trusted-ca\") pod \"console-operator-7cd56b8dbc-qtvqf\" (UID: \"50554e95-e3c9-4f06-84ca-dd86c85bcf8a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646104 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e51caef4-2776-4216-9143-2c07435c062b-stats-auth\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646144 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-device-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646245 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/58a9ea73-4db8-44ee-83ac-55504736d028-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646286 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7885b2e1-6437-402d-9335-f2b5bb2be17a-cni-binary-copy\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646302 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-systemd\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646319 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrtm2\" (UniqueName: \"kubernetes.io/projected/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-kube-api-access-wrtm2\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646343 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-certificates\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646399 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-sysctl-d\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646410 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dda3bac-470c-46f8-b510-8a73f6dc76c6-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646425 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/58a9ea73-4db8-44ee-83ac-55504736d028-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646411 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-trusted-ca\") pod \"console-operator-7cd56b8dbc-qtvqf\" (UID: \"50554e95-e3c9-4f06-84ca-dd86c85bcf8a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646459 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-etc-selinux\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646485 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/58a9ea73-4db8-44ee-83ac-55504736d028-system-cni-dir\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646506 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/58a9ea73-4db8-44ee-83ac-55504736d028-cni-binary-copy\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646516 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7885b2e1-6437-402d-9335-f2b5bb2be17a-cni-binary-copy\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646522 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b0086739-e8c7-4143-b297-87002d2f7dfb-host-slash\") pod \"iptables-alerter-gsdzf\" (UID: \"b0086739-e8c7-4143-b297-87002d2f7dfb\") " pod="openshift-network-operator/iptables-alerter-gsdzf" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646569 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-certificates\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646576 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6dda3bac-470c-46f8-b510-8a73f6dc76c6-serving-cert\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646608 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw5wp\" (UniqueName: \"kubernetes.io/projected/51be789d-183b-4988-9099-d5d33ad634c4-kube-api-access-mw5wp\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l\" (UID: \"51be789d-183b-4988-9099-d5d33ad634c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646665 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg55m\" (UniqueName: \"kubernetes.io/projected/b686e125-10ef-4399-b811-42858a543682-kube-api-access-gg55m\") pod \"network-check-source-6f78d59f99-jwv8k\" (UID: \"b686e125-10ef-4399-b811-42858a543682\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-jwv8k" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646697 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-sysctl-conf\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646712 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/58a9ea73-4db8-44ee-83ac-55504736d028-cni-binary-copy\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646724 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b23111a-a892-4d92-990d-742a857450fa-host\") pod \"node-ca-6mv8k\" (UID: \"9b23111a-a892-4d92-990d-742a857450fa\") " pod="openshift-image-registry/node-ca-6mv8k" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646753 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jgr2\" (UniqueName: \"kubernetes.io/projected/9a3528e4-8866-4d92-889c-db7d8a7271b4-kube-api-access-6jgr2\") pod \"service-ca-operator-544d749c8c-wd5gb\" (UID: \"9a3528e4-8866-4d92-889c-db7d8a7271b4\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646780 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tccp5\" (UniqueName: \"kubernetes.io/projected/6dda3bac-470c-46f8-b510-8a73f6dc76c6-kube-api-access-tccp5\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646807 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646821 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6dda3bac-470c-46f8-b510-8a73f6dc76c6-serving-cert\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646833 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rsxrp\" (UID: \"9fb838b9-ac5c-4029-9f11-98b610e5b375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646948 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks7rn\" (UniqueName: \"kubernetes.io/projected/edf682ca-dae8-42a1-a573-0995bbb7188d-kube-api-access-ks7rn\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646980 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-modprobe-d\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.646984 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647008 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsv9v\" (UniqueName: \"kubernetes.io/projected/05787044-8eb5-4158-a092-69f7266871fb-kube-api-access-fsv9v\") pod \"volume-data-source-validator-58c9f5f46d-wffrk\" (UID: \"05787044-8eb5-4158-a092-69f7266871fb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wffrk" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647032 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-run-openvswitch\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647047 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-run\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647056 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fb838b9-ac5c-4029-9f11-98b610e5b375-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rsxrp\" (UID: \"9fb838b9-ac5c-4029-9f11-98b610e5b375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647062 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-tuned\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647092 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-cni-bin\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647127 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-ovnkube-script-lib\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647170 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3737c365-6bb7-4e45-a487-5a6ed8eda295-archives-path\") pod \"periodic-gathering-gqgf7-x4kfr\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647195 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:56:24.647197 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647211 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-tuned\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.648978 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647252 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3737c365-6bb7-4e45-a487-5a6ed8eda295-archives-path\") pod \"periodic-gathering-gqgf7-x4kfr\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:24.648978 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647282 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/58a9ea73-4db8-44ee-83ac-55504736d028-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:56:24.648978 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647293 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-ovnkube-script-lib\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.648978 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647303 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb4g2\" (UniqueName: \"kubernetes.io/projected/b93a7d1a-904e-4d81-a425-f4d3b3055354-kube-api-access-kb4g2\") pod \"migrator-66df5d496b-bfx9m\" (UID: \"b93a7d1a-904e-4d81-a425-f4d3b3055354\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bfx9m" Oct 31 00:56:24.648978 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647369 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6dda3bac-470c-46f8-b510-8a73f6dc76c6-snapshots\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:56:24.648978 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647394 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-log-socket\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.648978 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647411 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msq52\" (UniqueName: \"kubernetes.io/projected/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-kube-api-access-msq52\") pod \"periodic-gathering-kgzkz-wqj59\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:24.648978 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647449 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a3528e4-8866-4d92-889c-db7d8a7271b4-config\") pod \"service-ca-operator-544d749c8c-wd5gb\" (UID: \"9a3528e4-8866-4d92-889c-db7d8a7271b4\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" Oct 31 00:56:24.648978 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647482 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktcbp\" (UniqueName: \"kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp\") pod \"network-check-target-r8q7t\" (UID: \"a1a12f14-a3aa-43b0-8ada-4568a87f7186\") " pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:56:24.648978 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647506 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6dda3bac-470c-46f8-b510-8a73f6dc76c6-tmp\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:56:24.648978 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647639 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6dda3bac-470c-46f8-b510-8a73f6dc76c6-tmp\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:56:24.648978 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647644 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6dda3bac-470c-46f8-b510-8a73f6dc76c6-snapshots\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:56:24.648978 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.647682 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a3528e4-8866-4d92-889c-db7d8a7271b4-config\") pod \"service-ca-operator-544d749c8c-wd5gb\" (UID: \"9a3528e4-8866-4d92-889c-db7d8a7271b4\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" Oct 31 00:56:24.652700 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.652676 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj9gv\" (UniqueName: \"kubernetes.io/projected/159fdfbd-fdcc-4655-b273-f0964617ed13-kube-api-access-tj9gv\") pod \"network-metrics-daemon-4bzzq\" (UID: \"159fdfbd-fdcc-4655-b273-f0964617ed13\") " pod="openshift-multus/network-metrics-daemon-4bzzq" Oct 31 00:56:24.652829 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.652812 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4whx4\" (UniqueName: \"kubernetes.io/projected/58a9ea73-4db8-44ee-83ac-55504736d028-kube-api-access-4whx4\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:56:24.653278 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.653257 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25sgt\" (UniqueName: \"kubernetes.io/projected/3adb1944-49fd-4158-b195-4e80ebfd8f58-kube-api-access-25sgt\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:56:24.653748 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.653729 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rmxd\" (UniqueName: \"kubernetes.io/projected/50554e95-e3c9-4f06-84ca-dd86c85bcf8a-kube-api-access-2rmxd\") pod \"console-operator-7cd56b8dbc-qtvqf\" (UID: \"50554e95-e3c9-4f06-84ca-dd86c85bcf8a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:56:24.653813 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.653732 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-bound-sa-token\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:24.653858 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.653842 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67qqz\" (UniqueName: \"kubernetes.io/projected/fe4d93b4-1929-4fbe-9bf3-834f03268472-kube-api-access-67qqz\") pod \"cluster-monitoring-operator-884576c57-znxnl\" (UID: \"fe4d93b4-1929-4fbe-9bf3-834f03268472\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-znxnl" Oct 31 00:56:24.654109 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.654092 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nhbc\" (UniqueName: \"kubernetes.io/projected/9fb838b9-ac5c-4029-9f11-98b610e5b375-kube-api-access-7nhbc\") pod \"cluster-samples-operator-6ddb6c8b94-rsxrp\" (UID: \"9fb838b9-ac5c-4029-9f11-98b610e5b375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rsxrp" Oct 31 00:56:24.654678 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.654663 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lzml\" (UniqueName: \"kubernetes.io/projected/d050f2b3-1f51-4f94-8d13-075aa3288bd1-kube-api-access-5lzml\") pod \"kas-connection-checker-685895c7c9-s8pvr\" (UID: \"d050f2b3-1f51-4f94-8d13-075aa3288bd1\") " pod="kube-system/kas-connection-checker-685895c7c9-s8pvr" Oct 31 00:56:24.656180 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.656138 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw5wp\" (UniqueName: \"kubernetes.io/projected/51be789d-183b-4988-9099-d5d33ad634c4-kube-api-access-mw5wp\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l\" (UID: \"51be789d-183b-4988-9099-d5d33ad634c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" Oct 31 00:56:24.656333 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.656305 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsv9v\" (UniqueName: \"kubernetes.io/projected/05787044-8eb5-4158-a092-69f7266871fb-kube-api-access-fsv9v\") pod \"volume-data-source-validator-58c9f5f46d-wffrk\" (UID: \"05787044-8eb5-4158-a092-69f7266871fb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wffrk" Oct 31 00:56:24.656333 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.656323 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg55m\" (UniqueName: \"kubernetes.io/projected/b686e125-10ef-4399-b811-42858a543682-kube-api-access-gg55m\") pod \"network-check-source-6f78d59f99-jwv8k\" (UID: \"b686e125-10ef-4399-b811-42858a543682\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-jwv8k" Oct 31 00:56:24.656464 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.656387 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jgr2\" (UniqueName: \"kubernetes.io/projected/9a3528e4-8866-4d92-889c-db7d8a7271b4-kube-api-access-6jgr2\") pod \"service-ca-operator-544d749c8c-wd5gb\" (UID: \"9a3528e4-8866-4d92-889c-db7d8a7271b4\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" Oct 31 00:56:24.656568 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.656532 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8f7j\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-kube-api-access-m8f7j\") pod \"image-registry-786bfcf6b7-n7gm9\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:24.660853 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.660828 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrtm2\" (UniqueName: \"kubernetes.io/projected/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-kube-api-access-wrtm2\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.660932 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.660905 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rcsn\" (UniqueName: \"kubernetes.io/projected/f6434cdd-b8a7-4fdb-ab00-53f19ce35b98-kube-api-access-8rcsn\") pod \"node-resolver-twq8q\" (UID: \"f6434cdd-b8a7-4fdb-ab00-53f19ce35b98\") " pod="openshift-dns/node-resolver-twq8q" Oct 31 00:56:24.661074 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.661051 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvd5m\" (UniqueName: \"kubernetes.io/projected/b0086739-e8c7-4143-b297-87002d2f7dfb-kube-api-access-gvd5m\") pod \"iptables-alerter-gsdzf\" (UID: \"b0086739-e8c7-4143-b297-87002d2f7dfb\") " pod="openshift-network-operator/iptables-alerter-gsdzf" Oct 31 00:56:24.661152 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.661136 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msq52\" (UniqueName: \"kubernetes.io/projected/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-kube-api-access-msq52\") pod \"periodic-gathering-kgzkz-wqj59\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:56:24.661422 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.661396 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z68r\" (UniqueName: \"kubernetes.io/projected/3737c365-6bb7-4e45-a487-5a6ed8eda295-kube-api-access-4z68r\") pod \"periodic-gathering-gqgf7-x4kfr\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:56:24.661649 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.661631 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb4g2\" (UniqueName: \"kubernetes.io/projected/b93a7d1a-904e-4d81-a425-f4d3b3055354-kube-api-access-kb4g2\") pod \"migrator-66df5d496b-bfx9m\" (UID: \"b93a7d1a-904e-4d81-a425-f4d3b3055354\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bfx9m" Oct 31 00:56:24.661717 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.661701 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txczj\" (UniqueName: \"kubernetes.io/projected/9b23111a-a892-4d92-990d-742a857450fa-kube-api-access-txczj\") pod \"node-ca-6mv8k\" (UID: \"9b23111a-a892-4d92-990d-742a857450fa\") " pod="openshift-image-registry/node-ca-6mv8k" Oct 31 00:56:24.661763 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.661721 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlnkr\" (UniqueName: \"kubernetes.io/projected/7885b2e1-6437-402d-9335-f2b5bb2be17a-kube-api-access-rlnkr\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.661993 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.661973 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xldv4\" (UniqueName: \"kubernetes.io/projected/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-kube-api-access-xldv4\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:24.662043 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.662025 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktcbp\" (UniqueName: \"kubernetes.io/projected/a1a12f14-a3aa-43b0-8ada-4568a87f7186-kube-api-access-ktcbp\") pod \"network-check-target-r8q7t\" (UID: \"a1a12f14-a3aa-43b0-8ada-4568a87f7186\") " pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:56:24.662087 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.662073 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmvgr\" (UniqueName: \"kubernetes.io/projected/42d46af4-addb-42c6-a15f-d1b717fb91b8-kube-api-access-gmvgr\") pod \"ingress-canary-wqhkd\" (UID: \"42d46af4-addb-42c6-a15f-d1b717fb91b8\") " pod="openshift-ingress-canary/ingress-canary-wqhkd" Oct 31 00:56:24.662287 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.662271 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks7rn\" (UniqueName: \"kubernetes.io/projected/edf682ca-dae8-42a1-a573-0995bbb7188d-kube-api-access-ks7rn\") pod \"dns-default-kg2kz\" (UID: \"edf682ca-dae8-42a1-a573-0995bbb7188d\") " pod="openshift-dns/dns-default-kg2kz" Oct 31 00:56:24.662540 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.662509 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcpm8\" (UniqueName: \"kubernetes.io/projected/e4573d06-669b-4764-9609-9bdc204c419a-kube-api-access-mcpm8\") pod \"kas-connection-checker-685895c7c9-md87z\" (UID: \"e4573d06-669b-4764-9609-9bdc204c419a\") " pod="kube-system/kas-connection-checker-685895c7c9-md87z" Oct 31 00:56:24.662816 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.662785 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n55jw\" (UniqueName: \"kubernetes.io/projected/314bbfb5-1511-4a13-9a52-9bee729f1b2e-kube-api-access-n55jw\") pod \"kas-connection-checker-685895c7c9-l8fz4\" (UID: \"314bbfb5-1511-4a13-9a52-9bee729f1b2e\") " pod="kube-system/kas-connection-checker-685895c7c9-l8fz4" Oct 31 00:56:24.663271 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.663255 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tccp5\" (UniqueName: \"kubernetes.io/projected/6dda3bac-470c-46f8-b510-8a73f6dc76c6-kube-api-access-tccp5\") pod \"insights-operator-7c4986d449-7sfl6\" (UID: \"6dda3bac-470c-46f8-b510-8a73f6dc76c6\") " pod="openshift-insights/insights-operator-7c4986d449-7sfl6" Oct 31 00:56:24.663309 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.663285 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9gzn\" (UniqueName: \"kubernetes.io/projected/e51caef4-2776-4216-9143-2c07435c062b-kube-api-access-l9gzn\") pod \"router-default-788b97d875-vrvqf\" (UID: \"e51caef4-2776-4216-9143-2c07435c062b\") " pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:24.664648 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.664632 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnw8h\" (UniqueName: \"kubernetes.io/projected/330d9526-3090-4286-ab5c-db9eb532f4c5-kube-api-access-wnw8h\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.748326 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748298 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-kubernetes\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.748467 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748330 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6434cdd-b8a7-4fdb-ab00-53f19ce35b98-hosts-file\") pod \"node-resolver-twq8q\" (UID: \"f6434cdd-b8a7-4fdb-ab00-53f19ce35b98\") " pod="openshift-dns/node-resolver-twq8q" Oct 31 00:56:24.748467 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748349 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-system-cni-dir\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.748467 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748364 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-cni-dir\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.748467 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748381 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-socket-dir-parent\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.748467 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748403 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-run-netns\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.748467 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748426 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-node-log\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.748467 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748440 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6434cdd-b8a7-4fdb-ab00-53f19ce35b98-hosts-file\") pod \"node-resolver-twq8q\" (UID: \"f6434cdd-b8a7-4fdb-ab00-53f19ce35b98\") " pod="openshift-dns/node-resolver-twq8q" Oct 31 00:56:24.748467 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748451 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-system-cni-dir\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.748467 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748459 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-kubernetes\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748449 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-sys\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748486 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-sys\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748494 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-socket-dir-parent\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748526 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-run-netns\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748533 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-node-log\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748537 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-cni-dir\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748527 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-systemd-units\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748594 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-registration-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748611 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/58a9ea73-4db8-44ee-83ac-55504736d028-cnibin\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748625 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-run-netns\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748569 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-systemd-units\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748676 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-run-multus-certs\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748690 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-run-netns\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748688 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/58a9ea73-4db8-44ee-83ac-55504736d028-cnibin\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748664 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-registration-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748701 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-etc-openvswitch\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748723 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-run-multus-certs\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748749 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-run-ovn-kubernetes\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748760 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-etc-openvswitch\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748776 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-sys-fs\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748791 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-run-ovn-kubernetes\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748802 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-var-lib-kubelet\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748831 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-cni-netd\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748835 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-sys-fs\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748840 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-var-lib-kubelet\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748851 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-lib-modules\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748867 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-cni-netd\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748872 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-kubelet\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748896 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-slash\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748920 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-sysconfig\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.748928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748945 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-kubelet\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748948 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-slash\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748944 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748972 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-sysconfig\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748982 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748992 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-lib-modules\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.748994 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-crio-socket\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749028 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-var-lib-kubelet\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749032 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/03e53a8a-f8cb-4821-bd6b-ee63d0e25623-crio-socket\") pod \"insights-runtime-extractor-66jgl\" (UID: \"03e53a8a-f8cb-4821-bd6b-ee63d0e25623\") " pod="openshift-insights/insights-runtime-extractor-66jgl" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749058 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-run-ovn\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749085 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-socket-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749087 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-var-lib-kubelet\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749107 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d207e59-c491-43cb-a331-5b89a78f470c-dbus\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749113 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-run-ovn\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749132 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-cnibin\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749139 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-socket-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749155 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-var-lib-cni-bin\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749180 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-host\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749184 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-cnibin\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749203 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-run-k8s-cni-cncf-io\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749206 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d207e59-c491-43cb-a331-5b89a78f470c-dbus\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749220 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-var-lib-cni-bin\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749231 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-var-lib-openvswitch\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749245 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-host\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749254 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-run-k8s-cni-cncf-io\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749255 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-hostroot\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749258 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-var-lib-openvswitch\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749279 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-hostroot\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749305 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-conf-dir\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749335 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-multus-conf-dir\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749351 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-run-systemd\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749378 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d207e59-c491-43cb-a331-5b89a78f470c-kubelet-config\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749400 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-etc-kubernetes\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749423 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-var-lib-cni-multus\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749443 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-run-systemd\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749443 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-device-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749475 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-systemd\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749484 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-device-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749499 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-sysctl-d\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749524 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-etc-selinux\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749537 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d207e59-c491-43cb-a331-5b89a78f470c-kubelet-config\") pod \"global-pull-secret-syncer-wtcjv\" (UID: \"6d207e59-c491-43cb-a331-5b89a78f470c\") " pod="kube-system/global-pull-secret-syncer-wtcjv" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749570 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/58a9ea73-4db8-44ee-83ac-55504736d028-system-cni-dir\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749595 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b0086739-e8c7-4143-b297-87002d2f7dfb-host-slash\") pod \"iptables-alerter-gsdzf\" (UID: \"b0086739-e8c7-4143-b297-87002d2f7dfb\") " pod="openshift-network-operator/iptables-alerter-gsdzf" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749601 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-etc-kubernetes\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749623 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-sysctl-conf\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749636 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7885b2e1-6437-402d-9335-f2b5bb2be17a-host-var-lib-cni-multus\") pod \"multus-nl27p\" (UID: \"7885b2e1-6437-402d-9335-f2b5bb2be17a\") " pod="openshift-multus/multus-nl27p" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749644 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b23111a-a892-4d92-990d-742a857450fa-host\") pod \"node-ca-6mv8k\" (UID: \"9b23111a-a892-4d92-990d-742a857450fa\") " pod="openshift-image-registry/node-ca-6mv8k" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749671 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-modprobe-d\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749679 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-etc-selinux\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749692 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-run-openvswitch\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749727 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-run\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749733 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-run-openvswitch\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749751 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-cni-bin\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749774 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749778 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/58a9ea73-4db8-44ee-83ac-55504736d028-system-cni-dir\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749794 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/58a9ea73-4db8-44ee-83ac-55504736d028-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749812 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b0086739-e8c7-4143-b297-87002d2f7dfb-host-slash\") pod \"iptables-alerter-gsdzf\" (UID: \"b0086739-e8c7-4143-b297-87002d2f7dfb\") " pod="openshift-network-operator/iptables-alerter-gsdzf" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749818 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-log-socket\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749877 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-log-socket\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749909 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-sysctl-conf\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749937 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b23111a-a892-4d92-990d-742a857450fa-host\") pod \"node-ca-6mv8k\" (UID: \"9b23111a-a892-4d92-990d-742a857450fa\") " pod="openshift-image-registry/node-ca-6mv8k" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749929 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-systemd\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.749998 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5-host-cni-bin\") pod \"ovnkube-node-4kgjb\" (UID: \"2c6a244e-e29d-492d-a16f-bf1c1ebc5ea5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.750024 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-modprobe-d\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.750043 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3adb1944-49fd-4158-b195-4e80ebfd8f58-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hpvs6\" (UID: \"3adb1944-49fd-4158-b195-4e80ebfd8f58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hpvs6" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.750060 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-run\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.750088 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/58a9ea73-4db8-44ee-83ac-55504736d028-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qbrtn\" (UID: \"58a9ea73-4db8-44ee-83ac-55504736d028\") " pod="openshift-multus/multus-additional-cni-plugins-qbrtn" Oct 31 00:56:24.750387 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.750124 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/330d9526-3090-4286-ab5c-db9eb532f4c5-etc-sysctl-d\") pod \"tuned-cbsws\" (UID: \"330d9526-3090-4286-ab5c-db9eb532f4c5\") " pod="openshift-cluster-node-tuning-operator/tuned-cbsws" Oct 31 00:56:24.834763 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:24.834699 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:25.641763 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:25.641730 5821 generic.go:356] "Generic (PLEG): container finished" podID="51be789d-183b-4988-9099-d5d33ad634c4" containerID="a2046ceacffcedfc643fcf20a12c3a87961bc913984f249761db25bc7324de09" exitCode=0 Oct 31 00:56:25.642135 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:25.641803 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" event={"ID":"51be789d-183b-4988-9099-d5d33ad634c4","Type":"ContainerDied","Data":"a2046ceacffcedfc643fcf20a12c3a87961bc913984f249761db25bc7324de09"} Oct 31 00:56:25.642508 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:25.642491 5821 scope.go:122] "RemoveContainer" containerID="a2046ceacffcedfc643fcf20a12c3a87961bc913984f249761db25bc7324de09" Oct 31 00:56:25.836689 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:25.836661 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:25.988409 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:25.988339 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:25.989428 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:25.989406 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-788b97d875-vrvqf" Oct 31 00:56:26.647610 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:26.647573 5821 generic.go:356] "Generic (PLEG): container finished" podID="9a3528e4-8866-4d92-889c-db7d8a7271b4" containerID="946b457d52a466a15f132a463705e1e7b85399c05d67f412f3fb78c224738a28" exitCode=0 Oct 31 00:56:26.648048 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:26.647647 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" event={"ID":"9a3528e4-8866-4d92-889c-db7d8a7271b4","Type":"ContainerDied","Data":"946b457d52a466a15f132a463705e1e7b85399c05d67f412f3fb78c224738a28"} Oct 31 00:56:26.648048 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:26.648006 5821 scope.go:122] "RemoveContainer" containerID="946b457d52a466a15f132a463705e1e7b85399c05d67f412f3fb78c224738a28" Oct 31 00:56:26.649912 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:26.649887 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-w8b7l" event={"ID":"51be789d-183b-4988-9099-d5d33ad634c4","Type":"ContainerStarted","Data":"6046aebb0db0f32694da1dc6faf57d68363731e545a408733ba49a509100af22"} Oct 31 00:56:27.114209 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.114169 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kg2kz" Oct 31 00:56:27.482071 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.481995 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-86lqd"] Oct 31 00:56:27.484457 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.484435 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.510774 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.510753 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 31 00:56:27.510902 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.510835 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 31 00:56:27.565719 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.565697 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 31 00:56:27.566298 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.566279 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 31 00:56:27.566420 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.566391 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qgqml\"" Oct 31 00:56:27.573662 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.573638 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/941502cf-4052-466b-bccd-6208772eb8c0-metrics-client-ca\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.573768 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.573677 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/941502cf-4052-466b-bccd-6208772eb8c0-node-exporter-textfile\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.573768 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.573709 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/941502cf-4052-466b-bccd-6208772eb8c0-sys\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.573871 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.573849 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/941502cf-4052-466b-bccd-6208772eb8c0-root\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.573930 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.573915 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpn62\" (UniqueName: \"kubernetes.io/projected/941502cf-4052-466b-bccd-6208772eb8c0-kube-api-access-qpn62\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.573989 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.573967 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/941502cf-4052-466b-bccd-6208772eb8c0-node-exporter-wtmp\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.574031 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.574007 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/941502cf-4052-466b-bccd-6208772eb8c0-node-exporter-tls\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.574068 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.574033 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/941502cf-4052-466b-bccd-6208772eb8c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.574120 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.574106 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/941502cf-4052-466b-bccd-6208772eb8c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.655855 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.655826 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wd5gb" event={"ID":"9a3528e4-8866-4d92-889c-db7d8a7271b4","Type":"ContainerStarted","Data":"cd16f3232fcdf78cc9c071d615f5d9a762d137593c53aecd8f5e856e9ba9be73"} Oct 31 00:56:27.674900 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.674646 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/941502cf-4052-466b-bccd-6208772eb8c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.674900 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.674698 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/941502cf-4052-466b-bccd-6208772eb8c0-metrics-client-ca\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.674900 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.674747 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/941502cf-4052-466b-bccd-6208772eb8c0-node-exporter-textfile\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.674900 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.674788 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/941502cf-4052-466b-bccd-6208772eb8c0-sys\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.674900 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.674823 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/941502cf-4052-466b-bccd-6208772eb8c0-root\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.674900 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.674855 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpn62\" (UniqueName: \"kubernetes.io/projected/941502cf-4052-466b-bccd-6208772eb8c0-kube-api-access-qpn62\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.674900 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.674886 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/941502cf-4052-466b-bccd-6208772eb8c0-node-exporter-wtmp\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.675323 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.674912 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/941502cf-4052-466b-bccd-6208772eb8c0-node-exporter-tls\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.675323 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.674945 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/941502cf-4052-466b-bccd-6208772eb8c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.675323 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.674971 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/941502cf-4052-466b-bccd-6208772eb8c0-sys\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.675323 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.675028 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/941502cf-4052-466b-bccd-6208772eb8c0-root\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.675323 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.675254 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/941502cf-4052-466b-bccd-6208772eb8c0-node-exporter-wtmp\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.675528 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.675351 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/941502cf-4052-466b-bccd-6208772eb8c0-node-exporter-textfile\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.675528 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.675434 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/941502cf-4052-466b-bccd-6208772eb8c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.675629 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.675583 5821 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 31 00:56:27.675629 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.675603 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/941502cf-4052-466b-bccd-6208772eb8c0-metrics-client-ca\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.677611 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.677594 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/941502cf-4052-466b-bccd-6208772eb8c0-node-exporter-tls\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.677715 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.677655 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/941502cf-4052-466b-bccd-6208772eb8c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.688928 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.688904 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpn62\" (UniqueName: \"kubernetes.io/projected/941502cf-4052-466b-bccd-6208772eb8c0-kube-api-access-qpn62\") pod \"node-exporter-86lqd\" (UID: \"941502cf-4052-466b-bccd-6208772eb8c0\") " pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.798022 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.797954 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-86lqd" Oct 31 00:56:27.810047 ip-10-0-132-179 kubenswrapper[5821]: W1031 00:56:27.810015 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod941502cf_4052_466b_bccd_6208772eb8c0.slice/crio-80d520a864d0560556cb41cd9b2741928c79b114fc624ad6841466c4f15064e8 WatchSource:0}: Error finding container 80d520a864d0560556cb41cd9b2741928c79b114fc624ad6841466c4f15064e8: Status 404 returned error can't find the container with id 80d520a864d0560556cb41cd9b2741928c79b114fc624ad6841466c4f15064e8 Oct 31 00:56:27.811542 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:27.811522 5821 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 31 00:56:28.448990 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:28.448953 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r8q7t" Oct 31 00:56:28.623191 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:28.623159 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-qtvqf" Oct 31 00:56:28.670592 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:28.662756 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-86lqd" event={"ID":"941502cf-4052-466b-bccd-6208772eb8c0","Type":"ContainerStarted","Data":"80d520a864d0560556cb41cd9b2741928c79b114fc624ad6841466c4f15064e8"} Oct 31 00:56:29.667927 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:29.667894 5821 generic.go:356] "Generic (PLEG): container finished" podID="941502cf-4052-466b-bccd-6208772eb8c0" containerID="18ab6a793c5bd197a87b4c6b84e34dbe573546f446f71cf70f50b106b088c806" exitCode=0 Oct 31 00:56:29.668117 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:29.667969 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-86lqd" event={"ID":"941502cf-4052-466b-bccd-6208772eb8c0","Type":"ContainerDied","Data":"18ab6a793c5bd197a87b4c6b84e34dbe573546f446f71cf70f50b106b088c806"} Oct 31 00:56:30.117381 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:30.117347 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kg2kz" Oct 31 00:56:30.643399 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:30.643372 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:30.673908 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:30.673831 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-86lqd" event={"ID":"941502cf-4052-466b-bccd-6208772eb8c0","Type":"ContainerStarted","Data":"a07b7ef17c28a72a26559384534dd2ff2f149d4c4d69c82ff4c4f0094b1c4ee7"} Oct 31 00:56:30.674108 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:30.673929 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-86lqd" event={"ID":"941502cf-4052-466b-bccd-6208772eb8c0","Type":"ContainerStarted","Data":"4589c3607b116399406379c08e9449abcb17ad0fd2f9bf6829bac5dd153fbf86"} Oct 31 00:56:30.706882 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:30.706823 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-86lqd" podStartSLOduration=2.564249303 podStartE2EDuration="3.706807727s" totalImagesPullingTime="1.071447404s" totalInitContainerRuntime="71.11102ms" isStatefulPod=true podCreationTimestamp="2026-10-31 00:56:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:56:30.706471696 +0000 UTC m=+7.285885604" watchObservedRunningTime="2026-10-31 00:56:30.706807727 +0000 UTC m=+7.286221635" Oct 31 00:56:31.566966 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:31.566939 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fzjbb" Oct 31 00:56:31.940469 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:31.940432 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:31.944517 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:31.944489 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:56:32.173620 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:32.173587 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:32.173892 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:32.173874 5821 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 31 00:56:34.062220 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:34.062130 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4kgjb" Oct 31 00:56:37.953632 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:56:37.953593 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-786bfcf6b7-n7gm9"] Oct 31 00:56:47.198088 ip-10-0-132-179 kubenswrapper[5821]: E1031 00:56:47.198052 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 00:57:02.974166 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:02.974104 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" podUID="fccb0eb9-af8a-494e-b629-37a428d87ea5" containerName="registry" containerID="cri-o://cde7039986a3ebfed9012f7d6cd75cba7d7e071c4a462fa244d635916a1d50e5" gracePeriod=30 Oct 31 00:57:03.221776 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.221748 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:57:03.288491 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.288398 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls\") pod \"fccb0eb9-af8a-494e-b629-37a428d87ea5\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " Oct 31 00:57:03.288491 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.288444 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fccb0eb9-af8a-494e-b629-37a428d87ea5-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fccb0eb9-af8a-494e-b629-37a428d87ea5-installation-pull-secrets\") pod \"fccb0eb9-af8a-494e-b629-37a428d87ea5\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " Oct 31 00:57:03.288773 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.288497 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fccb0eb9-af8a-494e-b629-37a428d87ea5-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fccb0eb9-af8a-494e-b629-37a428d87ea5-ca-trust-extracted\") pod \"fccb0eb9-af8a-494e-b629-37a428d87ea5\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " Oct 31 00:57:03.288773 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.288603 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fccb0eb9-af8a-494e-b629-37a428d87ea5-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fccb0eb9-af8a-494e-b629-37a428d87ea5-trusted-ca\") pod \"fccb0eb9-af8a-494e-b629-37a428d87ea5\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " Oct 31 00:57:03.288773 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.288653 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fccb0eb9-af8a-494e-b629-37a428d87ea5-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fccb0eb9-af8a-494e-b629-37a428d87ea5-image-registry-private-configuration\") pod \"fccb0eb9-af8a-494e-b629-37a428d87ea5\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " Oct 31 00:57:03.288773 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.288731 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-kube-api-access-m8f7j\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-kube-api-access-m8f7j\") pod \"fccb0eb9-af8a-494e-b629-37a428d87ea5\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " Oct 31 00:57:03.288980 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.288781 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-bound-sa-token\") pod \"fccb0eb9-af8a-494e-b629-37a428d87ea5\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " Oct 31 00:57:03.288980 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.288814 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-certificates\") pod \"fccb0eb9-af8a-494e-b629-37a428d87ea5\" (UID: \"fccb0eb9-af8a-494e-b629-37a428d87ea5\") " Oct 31 00:57:03.289772 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.289403 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-certificates" pod "fccb0eb9-af8a-494e-b629-37a428d87ea5" (UID: "fccb0eb9-af8a-494e-b629-37a428d87ea5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:57:03.290444 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.290350 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fccb0eb9-af8a-494e-b629-37a428d87ea5-trusted-ca" pod "fccb0eb9-af8a-494e-b629-37a428d87ea5" (UID: "fccb0eb9-af8a-494e-b629-37a428d87ea5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:57:03.292724 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.292611 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls" pod "fccb0eb9-af8a-494e-b629-37a428d87ea5" (UID: "fccb0eb9-af8a-494e-b629-37a428d87ea5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:57:03.292724 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.292704 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fccb0eb9-af8a-494e-b629-37a428d87ea5-image-registry-private-configuration" pod "fccb0eb9-af8a-494e-b629-37a428d87ea5" (UID: "fccb0eb9-af8a-494e-b629-37a428d87ea5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:57:03.292897 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.292873 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fccb0eb9-af8a-494e-b629-37a428d87ea5-installation-pull-secrets" pod "fccb0eb9-af8a-494e-b629-37a428d87ea5" (UID: "fccb0eb9-af8a-494e-b629-37a428d87ea5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 00:57:03.297825 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.297791 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fccb0eb9-af8a-494e-b629-37a428d87ea5-ca-trust-extracted" pod "fccb0eb9-af8a-494e-b629-37a428d87ea5" (UID: "fccb0eb9-af8a-494e-b629-37a428d87ea5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:57:03.297934 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.297803 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-kube-api-access-m8f7j" pod "fccb0eb9-af8a-494e-b629-37a428d87ea5" (UID: "fccb0eb9-af8a-494e-b629-37a428d87ea5"). InnerVolumeSpecName "kube-api-access-m8f7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:57:03.298002 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.297931 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-bound-sa-token" pod "fccb0eb9-af8a-494e-b629-37a428d87ea5" (UID: "fccb0eb9-af8a-494e-b629-37a428d87ea5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:57:03.389976 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.389934 5821 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-bound-sa-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:57:03.389976 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.389972 5821 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-certificates\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:57:03.389976 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.389986 5821 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-registry-tls\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:57:03.390241 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.389996 5821 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fccb0eb9-af8a-494e-b629-37a428d87ea5-installation-pull-secrets\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:57:03.390241 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.390005 5821 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fccb0eb9-af8a-494e-b629-37a428d87ea5-ca-trust-extracted\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:57:03.390241 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.390016 5821 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fccb0eb9-af8a-494e-b629-37a428d87ea5-trusted-ca\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:57:03.390241 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.390026 5821 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fccb0eb9-af8a-494e-b629-37a428d87ea5-image-registry-private-configuration\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:57:03.390241 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.390036 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8f7j\" (UniqueName: \"kubernetes.io/projected/fccb0eb9-af8a-494e-b629-37a428d87ea5-kube-api-access-m8f7j\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:57:03.815060 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.815029 5821 generic.go:356] "Generic (PLEG): container finished" podID="fccb0eb9-af8a-494e-b629-37a428d87ea5" containerID="cde7039986a3ebfed9012f7d6cd75cba7d7e071c4a462fa244d635916a1d50e5" exitCode=0 Oct 31 00:57:03.815226 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.815084 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" Oct 31 00:57:03.815226 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.815081 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" event={"ID":"fccb0eb9-af8a-494e-b629-37a428d87ea5","Type":"ContainerDied","Data":"cde7039986a3ebfed9012f7d6cd75cba7d7e071c4a462fa244d635916a1d50e5"} Oct 31 00:57:03.815304 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.815253 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-786bfcf6b7-n7gm9" event={"ID":"fccb0eb9-af8a-494e-b629-37a428d87ea5","Type":"ContainerDied","Data":"5e4324985f86cec518f63e5371a1092224ab27f0e3a94b14bfee0bf809ec8be7"} Oct 31 00:57:03.815304 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.815280 5821 scope.go:122] "RemoveContainer" containerID="cde7039986a3ebfed9012f7d6cd75cba7d7e071c4a462fa244d635916a1d50e5" Oct 31 00:57:03.829626 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.829607 5821 scope.go:122] "RemoveContainer" containerID="cde7039986a3ebfed9012f7d6cd75cba7d7e071c4a462fa244d635916a1d50e5" Oct 31 00:57:03.829931 ip-10-0-132-179 kubenswrapper[5821]: E1031 00:57:03.829907 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cde7039986a3ebfed9012f7d6cd75cba7d7e071c4a462fa244d635916a1d50e5\": container with ID starting with cde7039986a3ebfed9012f7d6cd75cba7d7e071c4a462fa244d635916a1d50e5 not found: ID does not exist" containerID="cde7039986a3ebfed9012f7d6cd75cba7d7e071c4a462fa244d635916a1d50e5" Oct 31 00:57:03.830004 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.829940 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cde7039986a3ebfed9012f7d6cd75cba7d7e071c4a462fa244d635916a1d50e5"} err="failed to get container status \"cde7039986a3ebfed9012f7d6cd75cba7d7e071c4a462fa244d635916a1d50e5\": rpc error: code = NotFound desc = could not find container \"cde7039986a3ebfed9012f7d6cd75cba7d7e071c4a462fa244d635916a1d50e5\": container with ID starting with cde7039986a3ebfed9012f7d6cd75cba7d7e071c4a462fa244d635916a1d50e5 not found: ID does not exist" Oct 31 00:57:03.835977 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.835946 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-786bfcf6b7-n7gm9"] Oct 31 00:57:03.837817 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:03.837790 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-786bfcf6b7-n7gm9"] Oct 31 00:57:05.564198 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:05.564162 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fccb0eb9-af8a-494e-b629-37a428d87ea5" path="/var/lib/kubelet/pods/fccb0eb9-af8a-494e-b629-37a428d87ea5/volumes" Oct 31 00:57:17.199252 ip-10-0-132-179 kubenswrapper[5821]: E1031 00:57:17.199213 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 00:57:41.956963 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:41.956926 5821 generic.go:356] "Generic (PLEG): container finished" podID="3737c365-6bb7-4e45-a487-5a6ed8eda295" containerID="d0e7bad687cd6f20e987a295b2a86ac6b43f2395999b7efd0b731992dcce03e4" exitCode=0 Oct 31 00:57:41.957416 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:41.956995 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" event={"ID":"3737c365-6bb7-4e45-a487-5a6ed8eda295","Type":"ContainerDied","Data":"d0e7bad687cd6f20e987a295b2a86ac6b43f2395999b7efd0b731992dcce03e4"} Oct 31 00:57:41.958509 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:41.958487 5821 generic.go:356] "Generic (PLEG): container finished" podID="4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5" containerID="876bab5f7a370fcae5e80132f586652b476838b692de9b5b5b07c9f727b97f4f" exitCode=0 Oct 31 00:57:41.958576 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:41.958547 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-kgzkz-wqj59" event={"ID":"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5","Type":"ContainerDied","Data":"876bab5f7a370fcae5e80132f586652b476838b692de9b5b5b07c9f727b97f4f"} Oct 31 00:57:43.121637 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.121607 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:57:43.124497 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.124474 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:57:43.208807 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.208770 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-trusted-ca-bundle\") pod \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " Oct 31 00:57:43.208985 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.208825 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3737c365-6bb7-4e45-a487-5a6ed8eda295-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3737c365-6bb7-4e45-a487-5a6ed8eda295-archives-path\") pod \"3737c365-6bb7-4e45-a487-5a6ed8eda295\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " Oct 31 00:57:43.208985 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.208847 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3737c365-6bb7-4e45-a487-5a6ed8eda295-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3737c365-6bb7-4e45-a487-5a6ed8eda295-trusted-ca-bundle\") pod \"3737c365-6bb7-4e45-a487-5a6ed8eda295\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " Oct 31 00:57:43.208985 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.208884 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-service-ca-bundle\") pod \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " Oct 31 00:57:43.208985 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.208906 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-kube-api-access-msq52\" (UniqueName: \"kubernetes.io/projected/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-kube-api-access-msq52\") pod \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " Oct 31 00:57:43.208985 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.208959 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3737c365-6bb7-4e45-a487-5a6ed8eda295-kube-api-access-4z68r\" (UniqueName: \"kubernetes.io/projected/3737c365-6bb7-4e45-a487-5a6ed8eda295-kube-api-access-4z68r\") pod \"3737c365-6bb7-4e45-a487-5a6ed8eda295\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " Oct 31 00:57:43.209270 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.208988 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-archives-path\") pod \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\" (UID: \"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5\") " Oct 31 00:57:43.209270 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.209017 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3737c365-6bb7-4e45-a487-5a6ed8eda295-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3737c365-6bb7-4e45-a487-5a6ed8eda295-service-ca-bundle\") pod \"3737c365-6bb7-4e45-a487-5a6ed8eda295\" (UID: \"3737c365-6bb7-4e45-a487-5a6ed8eda295\") " Oct 31 00:57:43.209367 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.209310 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3737c365-6bb7-4e45-a487-5a6ed8eda295-archives-path" pod "3737c365-6bb7-4e45-a487-5a6ed8eda295" (UID: "3737c365-6bb7-4e45-a487-5a6ed8eda295"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:57:43.209419 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.209392 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-archives-path" pod "4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5" (UID: "4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 00:57:43.209472 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.209333 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-trusted-ca-bundle" pod "4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5" (UID: "4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:57:43.209472 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.209449 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-service-ca-bundle" pod "4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5" (UID: "4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:57:43.209472 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.209466 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3737c365-6bb7-4e45-a487-5a6ed8eda295-trusted-ca-bundle" pod "3737c365-6bb7-4e45-a487-5a6ed8eda295" (UID: "3737c365-6bb7-4e45-a487-5a6ed8eda295"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:57:43.209613 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.209508 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3737c365-6bb7-4e45-a487-5a6ed8eda295-service-ca-bundle" pod "3737c365-6bb7-4e45-a487-5a6ed8eda295" (UID: "3737c365-6bb7-4e45-a487-5a6ed8eda295"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 00:57:43.211356 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.211335 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3737c365-6bb7-4e45-a487-5a6ed8eda295-kube-api-access-4z68r" pod "3737c365-6bb7-4e45-a487-5a6ed8eda295" (UID: "3737c365-6bb7-4e45-a487-5a6ed8eda295"). InnerVolumeSpecName "kube-api-access-4z68r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:57:43.211451 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.211359 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-kube-api-access-msq52" pod "4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5" (UID: "4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5"). InnerVolumeSpecName "kube-api-access-msq52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 00:57:43.309754 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.309719 5821 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3737c365-6bb7-4e45-a487-5a6ed8eda295-archives-path\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:57:43.309754 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.309750 5821 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3737c365-6bb7-4e45-a487-5a6ed8eda295-trusted-ca-bundle\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:57:43.309754 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.309760 5821 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-service-ca-bundle\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:57:43.309990 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.309768 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msq52\" (UniqueName: \"kubernetes.io/projected/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-kube-api-access-msq52\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:57:43.309990 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.309779 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4z68r\" (UniqueName: \"kubernetes.io/projected/3737c365-6bb7-4e45-a487-5a6ed8eda295-kube-api-access-4z68r\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:57:43.309990 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.309787 5821 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-archives-path\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:57:43.309990 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.309795 5821 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3737c365-6bb7-4e45-a487-5a6ed8eda295-service-ca-bundle\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:57:43.309990 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.309803 5821 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5-trusted-ca-bundle\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 00:57:43.966707 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.966666 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-kgzkz-wqj59" event={"ID":"4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5","Type":"ContainerDied","Data":"bf3cd60ef6a76cbfd77fdd4af4d53843a3e0d7f9132680f095101d988dee1abf"} Oct 31 00:57:43.966917 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.966723 5821 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf3cd60ef6a76cbfd77fdd4af4d53843a3e0d7f9132680f095101d988dee1abf" Oct 31 00:57:43.966917 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.966684 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-kgzkz-wqj59" Oct 31 00:57:43.968004 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.967977 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" event={"ID":"3737c365-6bb7-4e45-a487-5a6ed8eda295","Type":"ContainerDied","Data":"623cf6bc7f1411291483e34bb2e2037270fe2ca00f5d112901dddae279229715"} Oct 31 00:57:43.968103 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.968014 5821 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="623cf6bc7f1411291483e34bb2e2037270fe2ca00f5d112901dddae279229715" Oct 31 00:57:43.968103 ip-10-0-132-179 kubenswrapper[5821]: I1031 00:57:43.968037 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-gqgf7-x4kfr" Oct 31 00:57:47.197944 ip-10-0-132-179 kubenswrapper[5821]: E1031 00:57:47.197902 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 00:58:17.200007 ip-10-0-132-179 kubenswrapper[5821]: E1031 00:58:17.199918 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 00:58:47.198410 ip-10-0-132-179 kubenswrapper[5821]: E1031 00:58:47.198369 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 00:59:17.198979 ip-10-0-132-179 kubenswrapper[5821]: E1031 00:59:17.198937 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 00:59:47.199136 ip-10-0-132-179 kubenswrapper[5821]: E1031 00:59:47.199098 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:00:17.197762 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:00:17.197723 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:00:47.198925 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:00:47.198885 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:01:17.198576 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:01:17.198475 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:01:23.583975 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:01:23.583945 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/1.log" Oct 31 01:01:23.587653 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:01:23.587628 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/1.log" Oct 31 01:01:47.198482 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:01:47.198440 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:02:17.197638 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:02:17.197599 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:02:46.251173 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.251084 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt"] Oct 31 01:02:46.251579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.251391 5821 cpu_manager.go:414] "containerMap: removing container" podUID="fccb0eb9-af8a-494e-b629-37a428d87ea5" containerName="registry" Oct 31 01:02:46.251579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.251403 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fccb0eb9-af8a-494e-b629-37a428d87ea5" containerName="registry" Oct 31 01:02:46.251579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.251426 5821 cpu_manager.go:414] "containerMap: removing container" podUID="4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5" containerName="insights-gathering" Oct 31 01:02:46.251579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.251431 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5" containerName="insights-gathering" Oct 31 01:02:46.251579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.251452 5821 cpu_manager.go:414] "containerMap: removing container" podUID="3737c365-6bb7-4e45-a487-5a6ed8eda295" containerName="insights-gathering" Oct 31 01:02:46.251579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.251458 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3737c365-6bb7-4e45-a487-5a6ed8eda295" containerName="insights-gathering" Oct 31 01:02:46.251579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.251504 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="3737c365-6bb7-4e45-a487-5a6ed8eda295" containerName="insights-gathering" Oct 31 01:02:46.251579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.251512 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="fccb0eb9-af8a-494e-b629-37a428d87ea5" containerName="registry" Oct 31 01:02:46.251579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.251521 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5" containerName="insights-gathering" Oct 31 01:02:46.254470 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.254452 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.268604 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.268584 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Oct 31 01:02:46.276637 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.276610 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt"] Oct 31 01:02:46.326059 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.326012 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Oct 31 01:02:46.326059 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.326055 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Oct 31 01:02:46.326265 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.326080 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Oct 31 01:02:46.326265 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.326198 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-clrlv\"" Oct 31 01:02:46.394446 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.394404 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-jg7pt\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.394446 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.394442 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-jg7pt\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.394692 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.394539 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-jg7pt\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.394692 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.394617 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhv2h\" (UniqueName: \"kubernetes.io/projected/a77eeead-f91a-4ebe-817a-af29d676ee76-kube-api-access-fhv2h\") pod \"istiod-openshift-gateway-7876bfcb74-jg7pt\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.394692 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.394646 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a77eeead-f91a-4ebe-817a-af29d676ee76-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-jg7pt\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.394788 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.394723 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-jg7pt\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.394788 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.394751 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a77eeead-f91a-4ebe-817a-af29d676ee76-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-jg7pt\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.495384 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.495340 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-jg7pt\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.495384 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.495385 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a77eeead-f91a-4ebe-817a-af29d676ee76-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-jg7pt\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.495684 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.495418 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-jg7pt\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.495684 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.495435 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-jg7pt\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.495684 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.495465 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-jg7pt\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.495684 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.495489 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhv2h\" (UniqueName: \"kubernetes.io/projected/a77eeead-f91a-4ebe-817a-af29d676ee76-kube-api-access-fhv2h\") pod \"istiod-openshift-gateway-7876bfcb74-jg7pt\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.495684 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.495514 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a77eeead-f91a-4ebe-817a-af29d676ee76-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-jg7pt\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.496210 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.496180 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-jg7pt\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.497915 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.497891 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a77eeead-f91a-4ebe-817a-af29d676ee76-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-jg7pt\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.498221 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.498193 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-jg7pt\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.498303 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.498206 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a77eeead-f91a-4ebe-817a-af29d676ee76-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-jg7pt\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.498303 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.498208 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-jg7pt\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.504522 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.504458 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhv2h\" (UniqueName: \"kubernetes.io/projected/a77eeead-f91a-4ebe-817a-af29d676ee76-kube-api-access-fhv2h\") pod \"istiod-openshift-gateway-7876bfcb74-jg7pt\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.504760 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.504739 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-jg7pt\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.565532 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.565498 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:46.842158 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.842079 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt"] Oct 31 01:02:46.845809 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:02:46.845779 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77eeead_f91a_4ebe_817a_af29d676ee76.slice/crio-42a78ac4bc478da2afd0a99a51418a4f68a3513f9e211177dbfb65a3bf0f0b87 WatchSource:0}: Error finding container 42a78ac4bc478da2afd0a99a51418a4f68a3513f9e211177dbfb65a3bf0f0b87: Status 404 returned error can't find the container with id 42a78ac4bc478da2afd0a99a51418a4f68a3513f9e211177dbfb65a3bf0f0b87 Oct 31 01:02:46.848489 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:46.848472 5821 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 31 01:02:47.057237 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:47.057203 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" event={"ID":"a77eeead-f91a-4ebe-817a-af29d676ee76","Type":"ContainerStarted","Data":"42a78ac4bc478da2afd0a99a51418a4f68a3513f9e211177dbfb65a3bf0f0b87"} Oct 31 01:02:47.201670 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:02:47.201633 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:02:49.876165 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:49.876134 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:02:49.876457 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:49.876201 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:02:50.073274 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:50.073228 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" event={"ID":"a77eeead-f91a-4ebe-817a-af29d676ee76","Type":"ContainerStarted","Data":"d9d8eecd342f75edbaf2a20e65b4501f3158a2366962c93da1e497090b1975fc"} Oct 31 01:02:50.073482 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:50.073299 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:50.075038 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:50.075008 5821 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-jg7pt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 31 01:02:50.075170 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:50.075063 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" podUID="a77eeead-f91a-4ebe-817a-af29d676ee76" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:02:51.078098 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:51.078069 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:02:51.104959 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:02:51.104898 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" podStartSLOduration=2.078189355 podStartE2EDuration="5.104883393s" totalImagesPullingTime="3.026694038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:02:50.096012914 +0000 UTC m=+386.675426821" watchObservedRunningTime="2026-10-31 01:02:51.104883393 +0000 UTC m=+387.684297280" Oct 31 01:03:17.199712 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:03:17.199669 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:03:43.310947 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.310914 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw"] Oct 31 01:03:43.314092 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.314075 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:03:43.340051 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.340022 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw"] Oct 31 01:03:43.376345 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.376313 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Oct 31 01:03:43.376505 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.376365 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Oct 31 01:03:43.377755 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.377710 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Oct 31 01:03:43.377884 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.377839 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Oct 31 01:03:43.377949 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.377905 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-tml79\"" Oct 31 01:03:43.378002 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.377986 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Oct 31 01:03:43.444170 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.444140 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d1e23261-b317-48d7-a8a0-c65ecc6597ed-manifests\") pod \"opendatahub-operator-controller-manager-7f58f8c74c-znbxw\" (UID: \"d1e23261-b317-48d7-a8a0-c65ecc6597ed\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:03:43.444170 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.444174 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d1e23261-b317-48d7-a8a0-c65ecc6597ed-metrics-cert\") pod \"opendatahub-operator-controller-manager-7f58f8c74c-znbxw\" (UID: \"d1e23261-b317-48d7-a8a0-c65ecc6597ed\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:03:43.444417 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.444193 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffvvk\" (UniqueName: \"kubernetes.io/projected/d1e23261-b317-48d7-a8a0-c65ecc6597ed-kube-api-access-ffvvk\") pod \"opendatahub-operator-controller-manager-7f58f8c74c-znbxw\" (UID: \"d1e23261-b317-48d7-a8a0-c65ecc6597ed\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:03:43.444417 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.444217 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1e23261-b317-48d7-a8a0-c65ecc6597ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f58f8c74c-znbxw\" (UID: \"d1e23261-b317-48d7-a8a0-c65ecc6597ed\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:03:43.444417 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.444368 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d1e23261-b317-48d7-a8a0-c65ecc6597ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f58f8c74c-znbxw\" (UID: \"d1e23261-b317-48d7-a8a0-c65ecc6597ed\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:03:43.444599 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.444484 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1e23261-b317-48d7-a8a0-c65ecc6597ed-tmp\") pod \"opendatahub-operator-controller-manager-7f58f8c74c-znbxw\" (UID: \"d1e23261-b317-48d7-a8a0-c65ecc6597ed\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:03:43.544890 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.544849 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1e23261-b317-48d7-a8a0-c65ecc6597ed-tmp\") pod \"opendatahub-operator-controller-manager-7f58f8c74c-znbxw\" (UID: \"d1e23261-b317-48d7-a8a0-c65ecc6597ed\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:03:43.545093 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.544914 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d1e23261-b317-48d7-a8a0-c65ecc6597ed-manifests\") pod \"opendatahub-operator-controller-manager-7f58f8c74c-znbxw\" (UID: \"d1e23261-b317-48d7-a8a0-c65ecc6597ed\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:03:43.545093 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.544936 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d1e23261-b317-48d7-a8a0-c65ecc6597ed-metrics-cert\") pod \"opendatahub-operator-controller-manager-7f58f8c74c-znbxw\" (UID: \"d1e23261-b317-48d7-a8a0-c65ecc6597ed\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:03:43.545093 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.544953 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffvvk\" (UniqueName: \"kubernetes.io/projected/d1e23261-b317-48d7-a8a0-c65ecc6597ed-kube-api-access-ffvvk\") pod \"opendatahub-operator-controller-manager-7f58f8c74c-znbxw\" (UID: \"d1e23261-b317-48d7-a8a0-c65ecc6597ed\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:03:43.545093 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.544974 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1e23261-b317-48d7-a8a0-c65ecc6597ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f58f8c74c-znbxw\" (UID: \"d1e23261-b317-48d7-a8a0-c65ecc6597ed\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:03:43.545093 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.545004 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d1e23261-b317-48d7-a8a0-c65ecc6597ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f58f8c74c-znbxw\" (UID: \"d1e23261-b317-48d7-a8a0-c65ecc6597ed\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:03:43.545388 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.545365 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d1e23261-b317-48d7-a8a0-c65ecc6597ed-manifests\") pod \"opendatahub-operator-controller-manager-7f58f8c74c-znbxw\" (UID: \"d1e23261-b317-48d7-a8a0-c65ecc6597ed\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:03:43.547391 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.547367 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1e23261-b317-48d7-a8a0-c65ecc6597ed-tmp\") pod \"opendatahub-operator-controller-manager-7f58f8c74c-znbxw\" (UID: \"d1e23261-b317-48d7-a8a0-c65ecc6597ed\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:03:43.547633 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.547614 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1e23261-b317-48d7-a8a0-c65ecc6597ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f58f8c74c-znbxw\" (UID: \"d1e23261-b317-48d7-a8a0-c65ecc6597ed\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:03:43.547784 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.547763 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d1e23261-b317-48d7-a8a0-c65ecc6597ed-metrics-cert\") pod \"opendatahub-operator-controller-manager-7f58f8c74c-znbxw\" (UID: \"d1e23261-b317-48d7-a8a0-c65ecc6597ed\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:03:43.547848 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.547763 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d1e23261-b317-48d7-a8a0-c65ecc6597ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f58f8c74c-znbxw\" (UID: \"d1e23261-b317-48d7-a8a0-c65ecc6597ed\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:03:43.554005 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.553981 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffvvk\" (UniqueName: \"kubernetes.io/projected/d1e23261-b317-48d7-a8a0-c65ecc6597ed-kube-api-access-ffvvk\") pod \"opendatahub-operator-controller-manager-7f58f8c74c-znbxw\" (UID: \"d1e23261-b317-48d7-a8a0-c65ecc6597ed\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:03:43.629158 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.629116 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:03:43.936705 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:43.936477 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw"] Oct 31 01:03:43.939842 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:03:43.939810 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e23261_b317_48d7_a8a0_c65ecc6597ed.slice/crio-4b19089a5b89aed95a5fdb009171460b08765335ab3b74b225208bfe18a7f5b0 WatchSource:0}: Error finding container 4b19089a5b89aed95a5fdb009171460b08765335ab3b74b225208bfe18a7f5b0: Status 404 returned error can't find the container with id 4b19089a5b89aed95a5fdb009171460b08765335ab3b74b225208bfe18a7f5b0 Oct 31 01:03:44.278665 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:44.278583 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" event={"ID":"d1e23261-b317-48d7-a8a0-c65ecc6597ed","Type":"ContainerStarted","Data":"4b19089a5b89aed95a5fdb009171460b08765335ab3b74b225208bfe18a7f5b0"} Oct 31 01:03:47.198728 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:03:47.198686 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:03:50.306871 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:50.306788 5821 generic.go:356] "Generic (PLEG): container finished" podID="d1e23261-b317-48d7-a8a0-c65ecc6597ed" containerID="0ebec2df153e7a9ad5f9b6cdff6c179e8abb67a7b506ba3131568d21d60c36c3" exitCode=0 Oct 31 01:03:50.307302 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:50.306866 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" event={"ID":"d1e23261-b317-48d7-a8a0-c65ecc6597ed","Type":"ContainerDied","Data":"0ebec2df153e7a9ad5f9b6cdff6c179e8abb67a7b506ba3131568d21d60c36c3"} Oct 31 01:03:51.313224 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:51.313182 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" event={"ID":"d1e23261-b317-48d7-a8a0-c65ecc6597ed","Type":"ContainerStarted","Data":"06b7071ebee9194b0e55a9faec2af9d2c014348f6fa50c74bb6621088c8371a3"} Oct 31 01:03:51.313664 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:51.313341 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:03:51.372885 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:03:51.372809 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" podStartSLOduration=1.91097249 podStartE2EDuration="8.372789301s" totalImagesPullingTime="6.025742545s" totalInitContainerRuntime="436.074266ms" isStatefulPod=false podCreationTimestamp="2026-10-31 01:03:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:03:51.368488888 +0000 UTC m=+447.947902863" watchObservedRunningTime="2026-10-31 01:03:51.372789301 +0000 UTC m=+447.952203210" Oct 31 01:04:02.319471 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:02.319437 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7f58f8c74c-znbxw" Oct 31 01:04:17.198242 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:04:17.198153 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:04:20.854767 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:20.854729 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-858778b8-kkgd8"] Oct 31 01:04:20.858092 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:20.858075 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-858778b8-kkgd8" Oct 31 01:04:20.867081 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:20.867060 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Oct 31 01:04:20.868625 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:20.868598 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Oct 31 01:04:20.868869 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:20.868850 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tqk4d\"" Oct 31 01:04:20.869825 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:20.869796 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-858778b8-kkgd8"] Oct 31 01:04:20.954222 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:20.954178 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7d07e59-68ee-4dd5-82e5-f1c353915f63-tls-certs\") pod \"kube-auth-proxy-858778b8-kkgd8\" (UID: \"b7d07e59-68ee-4dd5-82e5-f1c353915f63\") " pod="openshift-ingress/kube-auth-proxy-858778b8-kkgd8" Oct 31 01:04:20.954415 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:20.954234 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp297\" (UniqueName: \"kubernetes.io/projected/b7d07e59-68ee-4dd5-82e5-f1c353915f63-kube-api-access-gp297\") pod \"kube-auth-proxy-858778b8-kkgd8\" (UID: \"b7d07e59-68ee-4dd5-82e5-f1c353915f63\") " pod="openshift-ingress/kube-auth-proxy-858778b8-kkgd8" Oct 31 01:04:20.954415 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:20.954344 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7d07e59-68ee-4dd5-82e5-f1c353915f63-tmp\") pod \"kube-auth-proxy-858778b8-kkgd8\" (UID: \"b7d07e59-68ee-4dd5-82e5-f1c353915f63\") " pod="openshift-ingress/kube-auth-proxy-858778b8-kkgd8" Oct 31 01:04:21.054893 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:21.054857 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7d07e59-68ee-4dd5-82e5-f1c353915f63-tmp\") pod \"kube-auth-proxy-858778b8-kkgd8\" (UID: \"b7d07e59-68ee-4dd5-82e5-f1c353915f63\") " pod="openshift-ingress/kube-auth-proxy-858778b8-kkgd8" Oct 31 01:04:21.055068 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:21.054937 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7d07e59-68ee-4dd5-82e5-f1c353915f63-tls-certs\") pod \"kube-auth-proxy-858778b8-kkgd8\" (UID: \"b7d07e59-68ee-4dd5-82e5-f1c353915f63\") " pod="openshift-ingress/kube-auth-proxy-858778b8-kkgd8" Oct 31 01:04:21.055068 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:21.054965 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp297\" (UniqueName: \"kubernetes.io/projected/b7d07e59-68ee-4dd5-82e5-f1c353915f63-kube-api-access-gp297\") pod \"kube-auth-proxy-858778b8-kkgd8\" (UID: \"b7d07e59-68ee-4dd5-82e5-f1c353915f63\") " pod="openshift-ingress/kube-auth-proxy-858778b8-kkgd8" Oct 31 01:04:21.057162 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:21.057123 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7d07e59-68ee-4dd5-82e5-f1c353915f63-tmp\") pod \"kube-auth-proxy-858778b8-kkgd8\" (UID: \"b7d07e59-68ee-4dd5-82e5-f1c353915f63\") " pod="openshift-ingress/kube-auth-proxy-858778b8-kkgd8" Oct 31 01:04:21.057512 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:21.057489 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7d07e59-68ee-4dd5-82e5-f1c353915f63-tls-certs\") pod \"kube-auth-proxy-858778b8-kkgd8\" (UID: \"b7d07e59-68ee-4dd5-82e5-f1c353915f63\") " pod="openshift-ingress/kube-auth-proxy-858778b8-kkgd8" Oct 31 01:04:21.081156 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:21.081125 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp297\" (UniqueName: \"kubernetes.io/projected/b7d07e59-68ee-4dd5-82e5-f1c353915f63-kube-api-access-gp297\") pod \"kube-auth-proxy-858778b8-kkgd8\" (UID: \"b7d07e59-68ee-4dd5-82e5-f1c353915f63\") " pod="openshift-ingress/kube-auth-proxy-858778b8-kkgd8" Oct 31 01:04:21.170884 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:21.170844 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-858778b8-kkgd8" Oct 31 01:04:21.468415 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:21.468339 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-858778b8-kkgd8"] Oct 31 01:04:21.471972 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:04:21.471945 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d07e59_68ee_4dd5_82e5_f1c353915f63.slice/crio-29a37fbc059e67f42374b250350fc42ec8469670730ce06e856a050ec07ee8a1 WatchSource:0}: Error finding container 29a37fbc059e67f42374b250350fc42ec8469670730ce06e856a050ec07ee8a1: Status 404 returned error can't find the container with id 29a37fbc059e67f42374b250350fc42ec8469670730ce06e856a050ec07ee8a1 Oct 31 01:04:22.438135 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:22.438093 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-858778b8-kkgd8" event={"ID":"b7d07e59-68ee-4dd5-82e5-f1c353915f63","Type":"ContainerStarted","Data":"29a37fbc059e67f42374b250350fc42ec8469670730ce06e856a050ec07ee8a1"} Oct 31 01:04:24.050958 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:24.050933 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Oct 31 01:04:24.448814 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:24.448768 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-858778b8-kkgd8" event={"ID":"b7d07e59-68ee-4dd5-82e5-f1c353915f63","Type":"ContainerStarted","Data":"c39d932db088b8512f7aae630680363328024125aa448075b5d989e6068bee80"} Oct 31 01:04:24.470636 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:24.470571 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-858778b8-kkgd8" podStartSLOduration=1.898572913 podStartE2EDuration="4.470542351s" totalImagesPullingTime="2.571969438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:04:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:04:24.470243226 +0000 UTC m=+481.049657136" watchObservedRunningTime="2026-10-31 01:04:24.470542351 +0000 UTC m=+481.049956304" Oct 31 01:04:28.982816 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:28.982777 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-9m7w4"] Oct 31 01:04:28.986344 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:28.986325 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-9m7w4" Oct 31 01:04:29.005865 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:29.005841 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9t9bz\"" Oct 31 01:04:29.010280 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:29.010258 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkz9z\" (UniqueName: \"kubernetes.io/projected/790ffc27-b985-4e60-9706-382501b1a969-kube-api-access-kkz9z\") pod \"authorino-57f7f8659f-9m7w4\" (UID: \"790ffc27-b985-4e60-9706-382501b1a969\") " pod="kuadrant-system/authorino-57f7f8659f-9m7w4" Oct 31 01:04:29.026208 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:29.026182 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-9m7w4"] Oct 31 01:04:29.072158 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:29.072120 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Oct 31 01:04:29.072158 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:29.072160 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Oct 31 01:04:29.110744 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:29.110705 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkz9z\" (UniqueName: \"kubernetes.io/projected/790ffc27-b985-4e60-9706-382501b1a969-kube-api-access-kkz9z\") pod \"authorino-57f7f8659f-9m7w4\" (UID: \"790ffc27-b985-4e60-9706-382501b1a969\") " pod="kuadrant-system/authorino-57f7f8659f-9m7w4" Oct 31 01:04:29.125607 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:29.125578 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkz9z\" (UniqueName: \"kubernetes.io/projected/790ffc27-b985-4e60-9706-382501b1a969-kube-api-access-kkz9z\") pod \"authorino-57f7f8659f-9m7w4\" (UID: \"790ffc27-b985-4e60-9706-382501b1a969\") " pod="kuadrant-system/authorino-57f7f8659f-9m7w4" Oct 31 01:04:29.315174 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:29.315075 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-9m7w4" Oct 31 01:04:29.605746 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:29.605598 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-9m7w4"] Oct 31 01:04:29.608617 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:04:29.608579 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod790ffc27_b985_4e60_9706_382501b1a969.slice/crio-c22beebc667a3a6dd081711e1a5a540d0271564aea9cdeff9ac00745670f7a06 WatchSource:0}: Error finding container c22beebc667a3a6dd081711e1a5a540d0271564aea9cdeff9ac00745670f7a06: Status 404 returned error can't find the container with id c22beebc667a3a6dd081711e1a5a540d0271564aea9cdeff9ac00745670f7a06 Oct 31 01:04:30.473863 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:30.473820 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-9m7w4" event={"ID":"790ffc27-b985-4e60-9706-382501b1a969","Type":"ContainerStarted","Data":"c22beebc667a3a6dd081711e1a5a540d0271564aea9cdeff9ac00745670f7a06"} Oct 31 01:04:33.107600 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:33.107543 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-9m7w4"] Oct 31 01:04:34.493537 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:34.493499 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-9m7w4" event={"ID":"790ffc27-b985-4e60-9706-382501b1a969","Type":"ContainerStarted","Data":"116d7b71826aaa09498599e5eb3d693224d27340179bf1327dd057f0f8df5398"} Oct 31 01:04:34.493989 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:34.493536 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-9m7w4" podUID="790ffc27-b985-4e60-9706-382501b1a969" containerName="authorino" containerID="cri-o://116d7b71826aaa09498599e5eb3d693224d27340179bf1327dd057f0f8df5398" gracePeriod=30 Oct 31 01:04:34.524830 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:34.524784 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-9m7w4" podStartSLOduration=2.693507735 podStartE2EDuration="6.52476926s" totalImagesPullingTime="3.831261525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:04:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:04:34.522789338 +0000 UTC m=+491.102203247" watchObservedRunningTime="2026-10-31 01:04:34.52476926 +0000 UTC m=+491.104183175" Oct 31 01:04:34.747368 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:34.747283 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-9m7w4" Oct 31 01:04:34.754716 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:34.754686 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/790ffc27-b985-4e60-9706-382501b1a969-kube-api-access-kkz9z\" (UniqueName: \"kubernetes.io/projected/790ffc27-b985-4e60-9706-382501b1a969-kube-api-access-kkz9z\") pod \"790ffc27-b985-4e60-9706-382501b1a969\" (UID: \"790ffc27-b985-4e60-9706-382501b1a969\") " Oct 31 01:04:34.756867 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:34.756844 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/790ffc27-b985-4e60-9706-382501b1a969-kube-api-access-kkz9z" pod "790ffc27-b985-4e60-9706-382501b1a969" (UID: "790ffc27-b985-4e60-9706-382501b1a969"). InnerVolumeSpecName "kube-api-access-kkz9z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:04:34.855198 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:34.855159 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkz9z\" (UniqueName: \"kubernetes.io/projected/790ffc27-b985-4e60-9706-382501b1a969-kube-api-access-kkz9z\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:04:35.498976 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:35.498941 5821 generic.go:356] "Generic (PLEG): container finished" podID="790ffc27-b985-4e60-9706-382501b1a969" containerID="116d7b71826aaa09498599e5eb3d693224d27340179bf1327dd057f0f8df5398" exitCode=0 Oct 31 01:04:35.499430 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:35.498980 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-9m7w4" event={"ID":"790ffc27-b985-4e60-9706-382501b1a969","Type":"ContainerDied","Data":"116d7b71826aaa09498599e5eb3d693224d27340179bf1327dd057f0f8df5398"} Oct 31 01:04:35.499430 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:35.499025 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-9m7w4" event={"ID":"790ffc27-b985-4e60-9706-382501b1a969","Type":"ContainerDied","Data":"c22beebc667a3a6dd081711e1a5a540d0271564aea9cdeff9ac00745670f7a06"} Oct 31 01:04:35.499430 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:35.499043 5821 scope.go:122] "RemoveContainer" containerID="116d7b71826aaa09498599e5eb3d693224d27340179bf1327dd057f0f8df5398" Oct 31 01:04:35.499430 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:35.498996 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-9m7w4" Oct 31 01:04:35.508262 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:35.508241 5821 scope.go:122] "RemoveContainer" containerID="116d7b71826aaa09498599e5eb3d693224d27340179bf1327dd057f0f8df5398" Oct 31 01:04:35.508532 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:04:35.508514 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"116d7b71826aaa09498599e5eb3d693224d27340179bf1327dd057f0f8df5398\": container with ID starting with 116d7b71826aaa09498599e5eb3d693224d27340179bf1327dd057f0f8df5398 not found: ID does not exist" containerID="116d7b71826aaa09498599e5eb3d693224d27340179bf1327dd057f0f8df5398" Oct 31 01:04:35.508602 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:35.508542 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"116d7b71826aaa09498599e5eb3d693224d27340179bf1327dd057f0f8df5398"} err="failed to get container status \"116d7b71826aaa09498599e5eb3d693224d27340179bf1327dd057f0f8df5398\": rpc error: code = NotFound desc = could not find container \"116d7b71826aaa09498599e5eb3d693224d27340179bf1327dd057f0f8df5398\": container with ID starting with 116d7b71826aaa09498599e5eb3d693224d27340179bf1327dd057f0f8df5398 not found: ID does not exist" Oct 31 01:04:35.526408 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:35.526372 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-9m7w4"] Oct 31 01:04:35.531298 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:35.531271 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-9m7w4"] Oct 31 01:04:35.564868 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:35.564838 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="790ffc27-b985-4e60-9706-382501b1a969" path="/var/lib/kubelet/pods/790ffc27-b985-4e60-9706-382501b1a969/volumes" Oct 31 01:04:47.198606 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:04:47.198545 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:04:49.156720 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:49.156687 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-bjtx2"] Oct 31 01:04:49.157142 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:49.157026 5821 cpu_manager.go:414] "containerMap: removing container" podUID="790ffc27-b985-4e60-9706-382501b1a969" containerName="authorino" Oct 31 01:04:49.157142 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:49.157038 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="790ffc27-b985-4e60-9706-382501b1a969" containerName="authorino" Oct 31 01:04:49.157142 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:49.157104 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="790ffc27-b985-4e60-9706-382501b1a969" containerName="authorino" Oct 31 01:04:49.163419 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:49.163395 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bjtx2" Oct 31 01:04:49.171128 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:49.170708 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-bjtx2"] Oct 31 01:04:49.180427 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:49.178931 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 31 01:04:49.180427 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:49.179055 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 31 01:04:49.180427 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:49.179331 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Oct 31 01:04:49.180427 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:49.179483 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-jcx79\"" Oct 31 01:04:49.279232 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:49.279187 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9hqv\" (UniqueName: \"kubernetes.io/projected/83182bc7-dc7c-44b1-94ef-1084da38cc97-kube-api-access-r9hqv\") pod \"postgres-7cdbf6dc44-bjtx2\" (UID: \"83182bc7-dc7c-44b1-94ef-1084da38cc97\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bjtx2" Oct 31 01:04:49.279232 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:49.279240 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/83182bc7-dc7c-44b1-94ef-1084da38cc97-data\") pod \"postgres-7cdbf6dc44-bjtx2\" (UID: \"83182bc7-dc7c-44b1-94ef-1084da38cc97\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bjtx2" Oct 31 01:04:49.380546 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:49.380505 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9hqv\" (UniqueName: \"kubernetes.io/projected/83182bc7-dc7c-44b1-94ef-1084da38cc97-kube-api-access-r9hqv\") pod \"postgres-7cdbf6dc44-bjtx2\" (UID: \"83182bc7-dc7c-44b1-94ef-1084da38cc97\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bjtx2" Oct 31 01:04:49.380713 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:49.380670 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/83182bc7-dc7c-44b1-94ef-1084da38cc97-data\") pod \"postgres-7cdbf6dc44-bjtx2\" (UID: \"83182bc7-dc7c-44b1-94ef-1084da38cc97\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bjtx2" Oct 31 01:04:49.381041 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:49.381023 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/83182bc7-dc7c-44b1-94ef-1084da38cc97-data\") pod \"postgres-7cdbf6dc44-bjtx2\" (UID: \"83182bc7-dc7c-44b1-94ef-1084da38cc97\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bjtx2" Oct 31 01:04:49.405694 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:49.405661 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9hqv\" (UniqueName: \"kubernetes.io/projected/83182bc7-dc7c-44b1-94ef-1084da38cc97-kube-api-access-r9hqv\") pod \"postgres-7cdbf6dc44-bjtx2\" (UID: \"83182bc7-dc7c-44b1-94ef-1084da38cc97\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bjtx2" Oct 31 01:04:49.485598 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:49.485492 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bjtx2" Oct 31 01:04:49.846240 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:49.846162 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-bjtx2"] Oct 31 01:04:49.849718 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:04:49.849687 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83182bc7_dc7c_44b1_94ef_1084da38cc97.slice/crio-91d308e2ba409e647b120006cf08a4566e6d5ff708e84f3bc0b820575583bab4 WatchSource:0}: Error finding container 91d308e2ba409e647b120006cf08a4566e6d5ff708e84f3bc0b820575583bab4: Status 404 returned error can't find the container with id 91d308e2ba409e647b120006cf08a4566e6d5ff708e84f3bc0b820575583bab4 Oct 31 01:04:50.563911 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:50.563873 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bjtx2" event={"ID":"83182bc7-dc7c-44b1-94ef-1084da38cc97","Type":"ContainerStarted","Data":"91d308e2ba409e647b120006cf08a4566e6d5ff708e84f3bc0b820575583bab4"} Oct 31 01:04:56.591463 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:56.591379 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bjtx2" event={"ID":"83182bc7-dc7c-44b1-94ef-1084da38cc97","Type":"ContainerStarted","Data":"6777459feb884881033d542213224ca7f872a0555b3e16c5ef37592ea4254cd3"} Oct 31 01:04:56.591927 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:56.591527 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bjtx2" Oct 31 01:04:56.610926 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:04:56.610877 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bjtx2" podStartSLOduration=1.6901452799999999 podStartE2EDuration="7.610866523s" totalImagesPullingTime="5.920721243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:04:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:04:56.610471542 +0000 UTC m=+513.189885449" watchObservedRunningTime="2026-10-31 01:04:56.610866523 +0000 UTC m=+513.190280431" Oct 31 01:05:02.625695 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:02.625664 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bjtx2" Oct 31 01:05:09.800031 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:09.799991 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-579cf7c6d-ndnw7"] Oct 31 01:05:09.803678 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:09.803653 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-ndnw7" Oct 31 01:05:09.815123 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:09.815070 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Oct 31 01:05:09.815456 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:09.815162 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Oct 31 01:05:09.815456 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:09.815454 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Oct 31 01:05:09.815456 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:09.815180 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Oct 31 01:05:09.815739 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:09.815273 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hbl9k\"" Oct 31 01:05:09.815739 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:09.815361 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Oct 31 01:05:09.816715 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:09.816693 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-ndnw7"] Oct 31 01:05:09.967833 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:09.967789 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7987ff40-53a3-4c3e-8ac2-9db0ce704da6-webhook-cert\") pod \"maas-controller-579cf7c6d-ndnw7\" (UID: \"7987ff40-53a3-4c3e-8ac2-9db0ce704da6\") " pod="opendatahub/maas-controller-579cf7c6d-ndnw7" Oct 31 01:05:09.967833 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:09.967834 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hjnw\" (UniqueName: \"kubernetes.io/projected/7987ff40-53a3-4c3e-8ac2-9db0ce704da6-kube-api-access-5hjnw\") pod \"maas-controller-579cf7c6d-ndnw7\" (UID: \"7987ff40-53a3-4c3e-8ac2-9db0ce704da6\") " pod="opendatahub/maas-controller-579cf7c6d-ndnw7" Oct 31 01:05:09.968059 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:09.967864 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7987ff40-53a3-4c3e-8ac2-9db0ce704da6-metrics-certs\") pod \"maas-controller-579cf7c6d-ndnw7\" (UID: \"7987ff40-53a3-4c3e-8ac2-9db0ce704da6\") " pod="opendatahub/maas-controller-579cf7c6d-ndnw7" Oct 31 01:05:10.068758 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.068670 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7987ff40-53a3-4c3e-8ac2-9db0ce704da6-metrics-certs\") pod \"maas-controller-579cf7c6d-ndnw7\" (UID: \"7987ff40-53a3-4c3e-8ac2-9db0ce704da6\") " pod="opendatahub/maas-controller-579cf7c6d-ndnw7" Oct 31 01:05:10.068758 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.068753 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7987ff40-53a3-4c3e-8ac2-9db0ce704da6-webhook-cert\") pod \"maas-controller-579cf7c6d-ndnw7\" (UID: \"7987ff40-53a3-4c3e-8ac2-9db0ce704da6\") " pod="opendatahub/maas-controller-579cf7c6d-ndnw7" Oct 31 01:05:10.068939 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.068781 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hjnw\" (UniqueName: \"kubernetes.io/projected/7987ff40-53a3-4c3e-8ac2-9db0ce704da6-kube-api-access-5hjnw\") pod \"maas-controller-579cf7c6d-ndnw7\" (UID: \"7987ff40-53a3-4c3e-8ac2-9db0ce704da6\") " pod="opendatahub/maas-controller-579cf7c6d-ndnw7" Oct 31 01:05:10.071218 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.071187 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7987ff40-53a3-4c3e-8ac2-9db0ce704da6-webhook-cert\") pod \"maas-controller-579cf7c6d-ndnw7\" (UID: \"7987ff40-53a3-4c3e-8ac2-9db0ce704da6\") " pod="opendatahub/maas-controller-579cf7c6d-ndnw7" Oct 31 01:05:10.071364 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.071230 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7987ff40-53a3-4c3e-8ac2-9db0ce704da6-metrics-certs\") pod \"maas-controller-579cf7c6d-ndnw7\" (UID: \"7987ff40-53a3-4c3e-8ac2-9db0ce704da6\") " pod="opendatahub/maas-controller-579cf7c6d-ndnw7" Oct 31 01:05:10.077773 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.077746 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hjnw\" (UniqueName: \"kubernetes.io/projected/7987ff40-53a3-4c3e-8ac2-9db0ce704da6-kube-api-access-5hjnw\") pod \"maas-controller-579cf7c6d-ndnw7\" (UID: \"7987ff40-53a3-4c3e-8ac2-9db0ce704da6\") " pod="opendatahub/maas-controller-579cf7c6d-ndnw7" Oct 31 01:05:10.116652 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.116617 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-ndnw7" Oct 31 01:05:10.142318 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.142287 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dc84dbdd5-9n7zf"] Oct 31 01:05:10.146662 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.146637 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" Oct 31 01:05:10.156733 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.156708 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dc84dbdd5-9n7zf"] Oct 31 01:05:10.271152 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.271108 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1e051a8-bd2b-424e-8e0b-7819391b4673-webhook-cert\") pod \"maas-controller-dc84dbdd5-9n7zf\" (UID: \"c1e051a8-bd2b-424e-8e0b-7819391b4673\") " pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" Oct 31 01:05:10.271152 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.271156 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e051a8-bd2b-424e-8e0b-7819391b4673-metrics-certs\") pod \"maas-controller-dc84dbdd5-9n7zf\" (UID: \"c1e051a8-bd2b-424e-8e0b-7819391b4673\") " pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" Oct 31 01:05:10.271341 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.271259 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9xwm\" (UniqueName: \"kubernetes.io/projected/c1e051a8-bd2b-424e-8e0b-7819391b4673-kube-api-access-d9xwm\") pod \"maas-controller-dc84dbdd5-9n7zf\" (UID: \"c1e051a8-bd2b-424e-8e0b-7819391b4673\") " pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" Oct 31 01:05:10.372506 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.372463 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1e051a8-bd2b-424e-8e0b-7819391b4673-webhook-cert\") pod \"maas-controller-dc84dbdd5-9n7zf\" (UID: \"c1e051a8-bd2b-424e-8e0b-7819391b4673\") " pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" Oct 31 01:05:10.372730 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.372527 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e051a8-bd2b-424e-8e0b-7819391b4673-metrics-certs\") pod \"maas-controller-dc84dbdd5-9n7zf\" (UID: \"c1e051a8-bd2b-424e-8e0b-7819391b4673\") " pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" Oct 31 01:05:10.372730 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.372636 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9xwm\" (UniqueName: \"kubernetes.io/projected/c1e051a8-bd2b-424e-8e0b-7819391b4673-kube-api-access-d9xwm\") pod \"maas-controller-dc84dbdd5-9n7zf\" (UID: \"c1e051a8-bd2b-424e-8e0b-7819391b4673\") " pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" Oct 31 01:05:10.375292 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.375261 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1e051a8-bd2b-424e-8e0b-7819391b4673-webhook-cert\") pod \"maas-controller-dc84dbdd5-9n7zf\" (UID: \"c1e051a8-bd2b-424e-8e0b-7819391b4673\") " pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" Oct 31 01:05:10.375438 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.375391 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e051a8-bd2b-424e-8e0b-7819391b4673-metrics-certs\") pod \"maas-controller-dc84dbdd5-9n7zf\" (UID: \"c1e051a8-bd2b-424e-8e0b-7819391b4673\") " pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" Oct 31 01:05:10.381726 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.381704 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9xwm\" (UniqueName: \"kubernetes.io/projected/c1e051a8-bd2b-424e-8e0b-7819391b4673-kube-api-access-d9xwm\") pod \"maas-controller-dc84dbdd5-9n7zf\" (UID: \"c1e051a8-bd2b-424e-8e0b-7819391b4673\") " pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" Oct 31 01:05:10.397291 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.397261 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-ndnw7"] Oct 31 01:05:10.400054 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:05:10.400032 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7987ff40_53a3_4c3e_8ac2_9db0ce704da6.slice/crio-90f44918f151a11f2b1526b9dc4d57d24a7d7c015afcacbe8394317a9e7d3ac3 WatchSource:0}: Error finding container 90f44918f151a11f2b1526b9dc4d57d24a7d7c015afcacbe8394317a9e7d3ac3: Status 404 returned error can't find the container with id 90f44918f151a11f2b1526b9dc4d57d24a7d7c015afcacbe8394317a9e7d3ac3 Oct 31 01:05:10.463821 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.463785 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" Oct 31 01:05:10.648495 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.648407 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-ndnw7" event={"ID":"7987ff40-53a3-4c3e-8ac2-9db0ce704da6","Type":"ContainerStarted","Data":"90f44918f151a11f2b1526b9dc4d57d24a7d7c015afcacbe8394317a9e7d3ac3"} Oct 31 01:05:10.735699 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:10.735665 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dc84dbdd5-9n7zf"] Oct 31 01:05:10.738950 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:05:10.738919 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1e051a8_bd2b_424e_8e0b_7819391b4673.slice/crio-df21f6d3fcdf60802dfafdcc31a81b5bfe2dd90d1411c7cdadf8c9bd13652f00 WatchSource:0}: Error finding container df21f6d3fcdf60802dfafdcc31a81b5bfe2dd90d1411c7cdadf8c9bd13652f00: Status 404 returned error can't find the container with id df21f6d3fcdf60802dfafdcc31a81b5bfe2dd90d1411c7cdadf8c9bd13652f00 Oct 31 01:05:11.655820 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:11.655723 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" event={"ID":"c1e051a8-bd2b-424e-8e0b-7819391b4673","Type":"ContainerStarted","Data":"df21f6d3fcdf60802dfafdcc31a81b5bfe2dd90d1411c7cdadf8c9bd13652f00"} Oct 31 01:05:13.672662 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:13.672626 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-ndnw7" event={"ID":"7987ff40-53a3-4c3e-8ac2-9db0ce704da6","Type":"ContainerStarted","Data":"9a5968a82291c5fa14ea7ab201cac37a45d58fe254e00adaf9a7835481742361"} Oct 31 01:05:13.673114 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:13.672763 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-579cf7c6d-ndnw7" Oct 31 01:05:13.707236 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:13.707165 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-579cf7c6d-ndnw7" podStartSLOduration=1.6236865310000002 podStartE2EDuration="4.707142815s" totalImagesPullingTime="3.083456284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:05:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:05:13.706299453 +0000 UTC m=+530.285713368" watchObservedRunningTime="2026-10-31 01:05:13.707142815 +0000 UTC m=+530.286556721" Oct 31 01:05:14.678570 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:14.678514 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" event={"ID":"c1e051a8-bd2b-424e-8e0b-7819391b4673","Type":"ContainerStarted","Data":"f973df21685b5ff56ab05dcaa2d83a338269e75dd15e655bad0c4fa8a75c9601"} Oct 31 01:05:14.679010 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:14.678787 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" Oct 31 01:05:14.741920 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:14.741860 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" podStartSLOduration=1.59807584 podStartE2EDuration="4.741844456s" totalImagesPullingTime="3.143768616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:05:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:05:14.740168296 +0000 UTC m=+531.319582205" watchObservedRunningTime="2026-10-31 01:05:14.741844456 +0000 UTC m=+531.321258360" Oct 31 01:05:14.906283 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:14.906237 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7"] Oct 31 01:05:14.910479 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:14.910448 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7" Oct 31 01:05:14.923495 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:14.923453 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\"" Oct 31 01:05:14.923673 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:14.923525 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\"" Oct 31 01:05:14.923954 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:14.923676 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\"" Oct 31 01:05:14.924964 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:14.924687 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-vg4r7\"" Oct 31 01:05:14.925278 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:14.925231 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7"] Oct 31 01:05:15.014763 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:15.014647 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2513372-48c8-4227-909d-aed579f5a7d3-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-w7lk7\" (UID: \"c2513372-48c8-4227-909d-aed579f5a7d3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7" Oct 31 01:05:15.014941 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:15.014821 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzdtv\" (UniqueName: \"kubernetes.io/projected/c2513372-48c8-4227-909d-aed579f5a7d3-kube-api-access-bzdtv\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-w7lk7\" (UID: \"c2513372-48c8-4227-909d-aed579f5a7d3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7" Oct 31 01:05:15.014941 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:15.014908 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/c2513372-48c8-4227-909d-aed579f5a7d3-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-w7lk7\" (UID: \"c2513372-48c8-4227-909d-aed579f5a7d3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7" Oct 31 01:05:15.014941 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:15.014938 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c2513372-48c8-4227-909d-aed579f5a7d3-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-w7lk7\" (UID: \"c2513372-48c8-4227-909d-aed579f5a7d3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7" Oct 31 01:05:15.115534 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:15.115488 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzdtv\" (UniqueName: \"kubernetes.io/projected/c2513372-48c8-4227-909d-aed579f5a7d3-kube-api-access-bzdtv\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-w7lk7\" (UID: \"c2513372-48c8-4227-909d-aed579f5a7d3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7" Oct 31 01:05:15.115768 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:15.115565 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/c2513372-48c8-4227-909d-aed579f5a7d3-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-w7lk7\" (UID: \"c2513372-48c8-4227-909d-aed579f5a7d3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7" Oct 31 01:05:15.115768 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:15.115590 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c2513372-48c8-4227-909d-aed579f5a7d3-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-w7lk7\" (UID: \"c2513372-48c8-4227-909d-aed579f5a7d3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7" Oct 31 01:05:15.115768 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:15.115627 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2513372-48c8-4227-909d-aed579f5a7d3-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-w7lk7\" (UID: \"c2513372-48c8-4227-909d-aed579f5a7d3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7" Oct 31 01:05:15.115768 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:05:15.115758 5821 secret.go:189] Couldn't get secret opendatahub/usage-logs-tenancy-proxy-tls: secret "usage-logs-tenancy-proxy-tls" not found Oct 31 01:05:15.115966 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:05:15.115865 5821 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2513372-48c8-4227-909d-aed579f5a7d3-tls-cert podName:c2513372-48c8-4227-909d-aed579f5a7d3 nodeName:}" failed. No retries permitted until 2026-10-31 01:05:15.615834316 +0000 UTC m=+532.195248201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-cert" (UniqueName: "kubernetes.io/secret/c2513372-48c8-4227-909d-aed579f5a7d3-tls-cert") pod "usage-logs-tenancy-proxy-9c5d49bcd-w7lk7" (UID: "c2513372-48c8-4227-909d-aed579f5a7d3") : secret "usage-logs-tenancy-proxy-tls" not found Oct 31 01:05:15.116311 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:15.116293 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2513372-48c8-4227-909d-aed579f5a7d3-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-w7lk7\" (UID: \"c2513372-48c8-4227-909d-aed579f5a7d3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7" Oct 31 01:05:15.116597 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:15.116579 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/c2513372-48c8-4227-909d-aed579f5a7d3-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-w7lk7\" (UID: \"c2513372-48c8-4227-909d-aed579f5a7d3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7" Oct 31 01:05:15.129641 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:15.129616 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzdtv\" (UniqueName: \"kubernetes.io/projected/c2513372-48c8-4227-909d-aed579f5a7d3-kube-api-access-bzdtv\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-w7lk7\" (UID: \"c2513372-48c8-4227-909d-aed579f5a7d3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7" Oct 31 01:05:15.619927 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:15.619889 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c2513372-48c8-4227-909d-aed579f5a7d3-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-w7lk7\" (UID: \"c2513372-48c8-4227-909d-aed579f5a7d3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7" Oct 31 01:05:15.622378 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:15.622347 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c2513372-48c8-4227-909d-aed579f5a7d3-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-w7lk7\" (UID: \"c2513372-48c8-4227-909d-aed579f5a7d3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7" Oct 31 01:05:15.824904 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:15.824871 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7" Oct 31 01:05:16.128685 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:16.128612 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7"] Oct 31 01:05:16.132141 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:05:16.132115 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2513372_48c8_4227_909d_aed579f5a7d3.slice/crio-22e639477ac82cf0a95d857bb538eab0e608f67d3e37be8def844df920f6bebc WatchSource:0}: Error finding container 22e639477ac82cf0a95d857bb538eab0e608f67d3e37be8def844df920f6bebc: Status 404 returned error can't find the container with id 22e639477ac82cf0a95d857bb538eab0e608f67d3e37be8def844df920f6bebc Oct 31 01:05:16.688168 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:16.688130 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7" event={"ID":"c2513372-48c8-4227-909d-aed579f5a7d3","Type":"ContainerStarted","Data":"22e639477ac82cf0a95d857bb538eab0e608f67d3e37be8def844df920f6bebc"} Oct 31 01:05:17.199195 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:05:17.199093 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:05:20.247719 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.247685 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-wssxm"] Oct 31 01:05:20.251308 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.251282 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-wssxm" Oct 31 01:05:20.266984 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.266949 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d976b58-6172-43d5-a1b9-f2df6c0f0a01-cert\") pod \"kserve-controller-manager-776cc66d47-wssxm\" (UID: \"1d976b58-6172-43d5-a1b9-f2df6c0f0a01\") " pod="opendatahub/kserve-controller-manager-776cc66d47-wssxm" Oct 31 01:05:20.267154 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.267046 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5jdt\" (UniqueName: \"kubernetes.io/projected/1d976b58-6172-43d5-a1b9-f2df6c0f0a01-kube-api-access-r5jdt\") pod \"kserve-controller-manager-776cc66d47-wssxm\" (UID: \"1d976b58-6172-43d5-a1b9-f2df6c0f0a01\") " pod="opendatahub/kserve-controller-manager-776cc66d47-wssxm" Oct 31 01:05:20.267291 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.267267 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-blkf7\"" Oct 31 01:05:20.268938 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.268911 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Oct 31 01:05:20.285730 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.285693 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-wssxm"] Oct 31 01:05:20.294532 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.294505 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64"] Oct 31 01:05:20.298140 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.298117 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64" Oct 31 01:05:20.319013 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.318984 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64"] Oct 31 01:05:20.367615 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.367576 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d976b58-6172-43d5-a1b9-f2df6c0f0a01-cert\") pod \"kserve-controller-manager-776cc66d47-wssxm\" (UID: \"1d976b58-6172-43d5-a1b9-f2df6c0f0a01\") " pod="opendatahub/kserve-controller-manager-776cc66d47-wssxm" Oct 31 01:05:20.367615 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.367615 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5jdt\" (UniqueName: \"kubernetes.io/projected/1d976b58-6172-43d5-a1b9-f2df6c0f0a01-kube-api-access-r5jdt\") pod \"kserve-controller-manager-776cc66d47-wssxm\" (UID: \"1d976b58-6172-43d5-a1b9-f2df6c0f0a01\") " pod="opendatahub/kserve-controller-manager-776cc66d47-wssxm" Oct 31 01:05:20.367864 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.367636 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62443a9a-64bf-4e1a-aa5a-8f0c598b79e8-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-6mw64\" (UID: \"62443a9a-64bf-4e1a-aa5a-8f0c598b79e8\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64" Oct 31 01:05:20.367864 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.367652 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29fqf\" (UniqueName: \"kubernetes.io/projected/62443a9a-64bf-4e1a-aa5a-8f0c598b79e8-kube-api-access-29fqf\") pod \"llmisvc-controller-manager-869d5dcc5d-6mw64\" (UID: \"62443a9a-64bf-4e1a-aa5a-8f0c598b79e8\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64" Oct 31 01:05:20.370788 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.370756 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d976b58-6172-43d5-a1b9-f2df6c0f0a01-cert\") pod \"kserve-controller-manager-776cc66d47-wssxm\" (UID: \"1d976b58-6172-43d5-a1b9-f2df6c0f0a01\") " pod="opendatahub/kserve-controller-manager-776cc66d47-wssxm" Oct 31 01:05:20.380036 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.380011 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Oct 31 01:05:20.380178 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.380167 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-mf2v7\"" Oct 31 01:05:20.397146 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.397082 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5jdt\" (UniqueName: \"kubernetes.io/projected/1d976b58-6172-43d5-a1b9-f2df6c0f0a01-kube-api-access-r5jdt\") pod \"kserve-controller-manager-776cc66d47-wssxm\" (UID: \"1d976b58-6172-43d5-a1b9-f2df6c0f0a01\") " pod="opendatahub/kserve-controller-manager-776cc66d47-wssxm" Oct 31 01:05:20.468281 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.468240 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62443a9a-64bf-4e1a-aa5a-8f0c598b79e8-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-6mw64\" (UID: \"62443a9a-64bf-4e1a-aa5a-8f0c598b79e8\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64" Oct 31 01:05:20.468475 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.468294 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29fqf\" (UniqueName: \"kubernetes.io/projected/62443a9a-64bf-4e1a-aa5a-8f0c598b79e8-kube-api-access-29fqf\") pod \"llmisvc-controller-manager-869d5dcc5d-6mw64\" (UID: \"62443a9a-64bf-4e1a-aa5a-8f0c598b79e8\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64" Oct 31 01:05:20.471187 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.471157 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62443a9a-64bf-4e1a-aa5a-8f0c598b79e8-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-6mw64\" (UID: \"62443a9a-64bf-4e1a-aa5a-8f0c598b79e8\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64" Oct 31 01:05:20.490467 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.490374 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29fqf\" (UniqueName: \"kubernetes.io/projected/62443a9a-64bf-4e1a-aa5a-8f0c598b79e8-kube-api-access-29fqf\") pod \"llmisvc-controller-manager-869d5dcc5d-6mw64\" (UID: \"62443a9a-64bf-4e1a-aa5a-8f0c598b79e8\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64" Oct 31 01:05:20.568216 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.568120 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-wssxm" Oct 31 01:05:20.614258 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.614213 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64" Oct 31 01:05:20.719780 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.719751 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz"] Oct 31 01:05:20.724446 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.724420 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.743121 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.743089 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz"] Oct 31 01:05:20.771528 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.771486 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aec234d3-c4ae-46a2-8ee7-5f27b62be675-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xqkhz\" (UID: \"aec234d3-c4ae-46a2-8ee7-5f27b62be675\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.771748 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.771580 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aec234d3-c4ae-46a2-8ee7-5f27b62be675-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xqkhz\" (UID: \"aec234d3-c4ae-46a2-8ee7-5f27b62be675\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.771748 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.771610 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aec234d3-c4ae-46a2-8ee7-5f27b62be675-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xqkhz\" (UID: \"aec234d3-c4ae-46a2-8ee7-5f27b62be675\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.771748 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.771642 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aec234d3-c4ae-46a2-8ee7-5f27b62be675-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xqkhz\" (UID: \"aec234d3-c4ae-46a2-8ee7-5f27b62be675\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.771748 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.771678 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aec234d3-c4ae-46a2-8ee7-5f27b62be675-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xqkhz\" (UID: \"aec234d3-c4ae-46a2-8ee7-5f27b62be675\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.771748 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.771703 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aec234d3-c4ae-46a2-8ee7-5f27b62be675-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xqkhz\" (UID: \"aec234d3-c4ae-46a2-8ee7-5f27b62be675\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.772007 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.771757 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfv5n\" (UniqueName: \"kubernetes.io/projected/aec234d3-c4ae-46a2-8ee7-5f27b62be675-kube-api-access-gfv5n\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xqkhz\" (UID: \"aec234d3-c4ae-46a2-8ee7-5f27b62be675\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.855686 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.855467 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-wssxm"] Oct 31 01:05:20.859715 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:05:20.859675 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d976b58_6172_43d5_a1b9_f2df6c0f0a01.slice/crio-78020d06eb5ffcb2465bccc9e1da108f310228e979862c29392e53d28c30dab0 WatchSource:0}: Error finding container 78020d06eb5ffcb2465bccc9e1da108f310228e979862c29392e53d28c30dab0: Status 404 returned error can't find the container with id 78020d06eb5ffcb2465bccc9e1da108f310228e979862c29392e53d28c30dab0 Oct 31 01:05:20.872523 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.872485 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aec234d3-c4ae-46a2-8ee7-5f27b62be675-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xqkhz\" (UID: \"aec234d3-c4ae-46a2-8ee7-5f27b62be675\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.872701 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.872574 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aec234d3-c4ae-46a2-8ee7-5f27b62be675-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xqkhz\" (UID: \"aec234d3-c4ae-46a2-8ee7-5f27b62be675\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.872701 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.872647 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aec234d3-c4ae-46a2-8ee7-5f27b62be675-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xqkhz\" (UID: \"aec234d3-c4ae-46a2-8ee7-5f27b62be675\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.873025 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.873003 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aec234d3-c4ae-46a2-8ee7-5f27b62be675-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xqkhz\" (UID: \"aec234d3-c4ae-46a2-8ee7-5f27b62be675\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.873141 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.873042 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aec234d3-c4ae-46a2-8ee7-5f27b62be675-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xqkhz\" (UID: \"aec234d3-c4ae-46a2-8ee7-5f27b62be675\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.873141 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.873106 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfv5n\" (UniqueName: \"kubernetes.io/projected/aec234d3-c4ae-46a2-8ee7-5f27b62be675-kube-api-access-gfv5n\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xqkhz\" (UID: \"aec234d3-c4ae-46a2-8ee7-5f27b62be675\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.873250 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.873183 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aec234d3-c4ae-46a2-8ee7-5f27b62be675-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xqkhz\" (UID: \"aec234d3-c4ae-46a2-8ee7-5f27b62be675\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.874276 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.874239 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aec234d3-c4ae-46a2-8ee7-5f27b62be675-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xqkhz\" (UID: \"aec234d3-c4ae-46a2-8ee7-5f27b62be675\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.875507 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.875481 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aec234d3-c4ae-46a2-8ee7-5f27b62be675-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xqkhz\" (UID: \"aec234d3-c4ae-46a2-8ee7-5f27b62be675\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.875694 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.875677 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aec234d3-c4ae-46a2-8ee7-5f27b62be675-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xqkhz\" (UID: \"aec234d3-c4ae-46a2-8ee7-5f27b62be675\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.875982 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.875954 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aec234d3-c4ae-46a2-8ee7-5f27b62be675-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xqkhz\" (UID: \"aec234d3-c4ae-46a2-8ee7-5f27b62be675\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.876101 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.875958 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aec234d3-c4ae-46a2-8ee7-5f27b62be675-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xqkhz\" (UID: \"aec234d3-c4ae-46a2-8ee7-5f27b62be675\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.884278 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.884250 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aec234d3-c4ae-46a2-8ee7-5f27b62be675-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xqkhz\" (UID: \"aec234d3-c4ae-46a2-8ee7-5f27b62be675\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.884624 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.884598 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfv5n\" (UniqueName: \"kubernetes.io/projected/aec234d3-c4ae-46a2-8ee7-5f27b62be675-kube-api-access-gfv5n\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xqkhz\" (UID: \"aec234d3-c4ae-46a2-8ee7-5f27b62be675\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:20.917231 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:20.917195 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64"] Oct 31 01:05:20.922440 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:05:20.922404 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod62443a9a_64bf_4e1a_aa5a_8f0c598b79e8.slice/crio-d1b8983640b6abad7e9aee30c3789d85c60abfcfb06b46df22db92cbb8807cb9 WatchSource:0}: Error finding container d1b8983640b6abad7e9aee30c3789d85c60abfcfb06b46df22db92cbb8807cb9: Status 404 returned error can't find the container with id d1b8983640b6abad7e9aee30c3789d85c60abfcfb06b46df22db92cbb8807cb9 Oct 31 01:05:21.038842 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:21.038800 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:21.330657 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:21.330626 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz"] Oct 31 01:05:21.333127 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:05:21.333095 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaec234d3_c4ae_46a2_8ee7_5f27b62be675.slice/crio-97cddda417b07235fe724ccbb90bf2b1b9932d744522e66f6f5c7b9a0063bfae WatchSource:0}: Error finding container 97cddda417b07235fe724ccbb90bf2b1b9932d744522e66f6f5c7b9a0063bfae: Status 404 returned error can't find the container with id 97cddda417b07235fe724ccbb90bf2b1b9932d744522e66f6f5c7b9a0063bfae Oct 31 01:05:21.335498 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:21.335466 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:05:21.335615 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:21.335529 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:05:21.717123 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:21.717028 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-wssxm" event={"ID":"1d976b58-6172-43d5-a1b9-f2df6c0f0a01","Type":"ContainerStarted","Data":"78020d06eb5ffcb2465bccc9e1da108f310228e979862c29392e53d28c30dab0"} Oct 31 01:05:21.719032 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:21.718992 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64" event={"ID":"62443a9a-64bf-4e1a-aa5a-8f0c598b79e8","Type":"ContainerStarted","Data":"d1b8983640b6abad7e9aee30c3789d85c60abfcfb06b46df22db92cbb8807cb9"} Oct 31 01:05:21.721269 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:21.721240 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" event={"ID":"aec234d3-c4ae-46a2-8ee7-5f27b62be675","Type":"ContainerStarted","Data":"9daa3e2e95a0759a4080135c22f46569b41fefa272da961743eb1ec93ba5a5ac"} Oct 31 01:05:21.721393 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:21.721286 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" event={"ID":"aec234d3-c4ae-46a2-8ee7-5f27b62be675","Type":"ContainerStarted","Data":"97cddda417b07235fe724ccbb90bf2b1b9932d744522e66f6f5c7b9a0063bfae"} Oct 31 01:05:21.722152 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:21.722132 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:21.750444 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:21.750383 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" podStartSLOduration=1.7503638719999999 podStartE2EDuration="1.750363872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:05:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:05:21.747285005 +0000 UTC m=+538.326698914" watchObservedRunningTime="2026-10-31 01:05:21.750363872 +0000 UTC m=+538.329777778" Oct 31 01:05:22.729967 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:22.729933 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xqkhz" Oct 31 01:05:22.784137 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:22.783849 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt"] Oct 31 01:05:22.785129 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:22.784581 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" podUID="a77eeead-f91a-4ebe-817a-af29d676ee76" containerName="discovery" containerID="cri-o://d9d8eecd342f75edbaf2a20e65b4501f3158a2366962c93da1e497090b1975fc" gracePeriod=30 Oct 31 01:05:23.097338 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.097306 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:05:23.201840 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.200920 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-kubeconfig\") pod \"a77eeead-f91a-4ebe-817a-af29d676ee76\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " Oct 31 01:05:23.201840 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.201020 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a77eeead-f91a-4ebe-817a-af29d676ee76-kube-api-access-fhv2h\" (UniqueName: \"kubernetes.io/projected/a77eeead-f91a-4ebe-817a-af29d676ee76-kube-api-access-fhv2h\") pod \"a77eeead-f91a-4ebe-817a-af29d676ee76\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " Oct 31 01:05:23.201840 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.201061 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a77eeead-f91a-4ebe-817a-af29d676ee76-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a77eeead-f91a-4ebe-817a-af29d676ee76-local-certs\") pod \"a77eeead-f91a-4ebe-817a-af29d676ee76\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " Oct 31 01:05:23.201840 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.201100 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-csr-ca-configmap\") pod \"a77eeead-f91a-4ebe-817a-af29d676ee76\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " Oct 31 01:05:23.201840 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.201139 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-csr-dns-cert\") pod \"a77eeead-f91a-4ebe-817a-af29d676ee76\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " Oct 31 01:05:23.201840 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.201177 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a77eeead-f91a-4ebe-817a-af29d676ee76-cacerts\" (UniqueName: \"kubernetes.io/secret/a77eeead-f91a-4ebe-817a-af29d676ee76-cacerts\") pod \"a77eeead-f91a-4ebe-817a-af29d676ee76\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " Oct 31 01:05:23.201840 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.201206 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-token\" (UniqueName: \"kubernetes.io/projected/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-token\") pod \"a77eeead-f91a-4ebe-817a-af29d676ee76\" (UID: \"a77eeead-f91a-4ebe-817a-af29d676ee76\") " Oct 31 01:05:23.202424 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.202261 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-csr-ca-configmap" pod "a77eeead-f91a-4ebe-817a-af29d676ee76" (UID: "a77eeead-f91a-4ebe-817a-af29d676ee76"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:05:23.205700 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.205645 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a77eeead-f91a-4ebe-817a-af29d676ee76-cacerts" pod "a77eeead-f91a-4ebe-817a-af29d676ee76" (UID: "a77eeead-f91a-4ebe-817a-af29d676ee76"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:05:23.206329 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.206279 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-csr-dns-cert" pod "a77eeead-f91a-4ebe-817a-af29d676ee76" (UID: "a77eeead-f91a-4ebe-817a-af29d676ee76"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:05:23.206730 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.206705 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-token" pod "a77eeead-f91a-4ebe-817a-af29d676ee76" (UID: "a77eeead-f91a-4ebe-817a-af29d676ee76"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:05:23.214735 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.214702 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-kubeconfig" pod "a77eeead-f91a-4ebe-817a-af29d676ee76" (UID: "a77eeead-f91a-4ebe-817a-af29d676ee76"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:05:23.214846 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.214706 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a77eeead-f91a-4ebe-817a-af29d676ee76-kube-api-access-fhv2h" pod "a77eeead-f91a-4ebe-817a-af29d676ee76" (UID: "a77eeead-f91a-4ebe-817a-af29d676ee76"). InnerVolumeSpecName "kube-api-access-fhv2h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:05:23.214846 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.214701 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a77eeead-f91a-4ebe-817a-af29d676ee76-local-certs" pod "a77eeead-f91a-4ebe-817a-af29d676ee76" (UID: "a77eeead-f91a-4ebe-817a-af29d676ee76"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:05:23.303024 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.302932 5821 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-csr-ca-configmap\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:05:23.303024 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.302974 5821 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-csr-dns-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:05:23.303024 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.302991 5821 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a77eeead-f91a-4ebe-817a-af29d676ee76-cacerts\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:05:23.303024 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.303008 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:05:23.303024 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.303022 5821 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a77eeead-f91a-4ebe-817a-af29d676ee76-istio-kubeconfig\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:05:23.303396 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.303037 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhv2h\" (UniqueName: \"kubernetes.io/projected/a77eeead-f91a-4ebe-817a-af29d676ee76-kube-api-access-fhv2h\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:05:23.303396 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.303054 5821 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a77eeead-f91a-4ebe-817a-af29d676ee76-local-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:05:23.733919 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.733744 5821 generic.go:356] "Generic (PLEG): container finished" podID="a77eeead-f91a-4ebe-817a-af29d676ee76" containerID="d9d8eecd342f75edbaf2a20e65b4501f3158a2366962c93da1e497090b1975fc" exitCode=0 Oct 31 01:05:23.733919 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.733817 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" Oct 31 01:05:23.733919 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.733824 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" event={"ID":"a77eeead-f91a-4ebe-817a-af29d676ee76","Type":"ContainerDied","Data":"d9d8eecd342f75edbaf2a20e65b4501f3158a2366962c93da1e497090b1975fc"} Oct 31 01:05:23.733919 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.733882 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt" event={"ID":"a77eeead-f91a-4ebe-817a-af29d676ee76","Type":"ContainerDied","Data":"42a78ac4bc478da2afd0a99a51418a4f68a3513f9e211177dbfb65a3bf0f0b87"} Oct 31 01:05:23.733919 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.733911 5821 scope.go:122] "RemoveContainer" containerID="d9d8eecd342f75edbaf2a20e65b4501f3158a2366962c93da1e497090b1975fc" Oct 31 01:05:23.745981 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.745960 5821 scope.go:122] "RemoveContainer" containerID="d9d8eecd342f75edbaf2a20e65b4501f3158a2366962c93da1e497090b1975fc" Oct 31 01:05:23.746366 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:05:23.746339 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9d8eecd342f75edbaf2a20e65b4501f3158a2366962c93da1e497090b1975fc\": container with ID starting with d9d8eecd342f75edbaf2a20e65b4501f3158a2366962c93da1e497090b1975fc not found: ID does not exist" containerID="d9d8eecd342f75edbaf2a20e65b4501f3158a2366962c93da1e497090b1975fc" Oct 31 01:05:23.746440 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.746380 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9d8eecd342f75edbaf2a20e65b4501f3158a2366962c93da1e497090b1975fc"} err="failed to get container status \"d9d8eecd342f75edbaf2a20e65b4501f3158a2366962c93da1e497090b1975fc\": rpc error: code = NotFound desc = could not find container \"d9d8eecd342f75edbaf2a20e65b4501f3158a2366962c93da1e497090b1975fc\": container with ID starting with d9d8eecd342f75edbaf2a20e65b4501f3158a2366962c93da1e497090b1975fc not found: ID does not exist" Oct 31 01:05:23.754584 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.753294 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt"] Oct 31 01:05:23.757181 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:23.757156 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-jg7pt"] Oct 31 01:05:24.680739 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:24.680703 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-579cf7c6d-ndnw7" Oct 31 01:05:24.742540 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:24.742476 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-wssxm" event={"ID":"1d976b58-6172-43d5-a1b9-f2df6c0f0a01","Type":"ContainerStarted","Data":"eb5e408782213872ebaa258715f53c09adab5b47225a8914068bf48d91ac0cc2"} Oct 31 01:05:24.743363 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:24.743336 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-wssxm" Oct 31 01:05:24.746776 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:24.746747 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64" event={"ID":"62443a9a-64bf-4e1a-aa5a-8f0c598b79e8","Type":"ContainerStarted","Data":"83875bd08e81427d2c657b56ec7588224ef3c1d3a2782589be1e223cd62fa8a9"} Oct 31 01:05:24.747560 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:24.747527 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64" Oct 31 01:05:24.784837 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:24.784764 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-wssxm" podStartSLOduration=1.8373377739999999 podStartE2EDuration="4.784744886s" totalImagesPullingTime="2.947407112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:05:24.762206435 +0000 UTC m=+541.341620343" watchObservedRunningTime="2026-10-31 01:05:24.784744886 +0000 UTC m=+541.364158796" Oct 31 01:05:24.785039 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:24.784993 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64" podStartSLOduration=2.05822038 podStartE2EDuration="4.784988555s" totalImagesPullingTime="2.726768175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:05:24.783496245 +0000 UTC m=+541.362910155" watchObservedRunningTime="2026-10-31 01:05:24.784988555 +0000 UTC m=+541.364402467" Oct 31 01:05:25.566791 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:25.566751 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a77eeead-f91a-4ebe-817a-af29d676ee76" path="/var/lib/kubelet/pods/a77eeead-f91a-4ebe-817a-af29d676ee76/volumes" Oct 31 01:05:25.686148 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:25.686065 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" Oct 31 01:05:25.731887 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:25.731854 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-ndnw7"] Oct 31 01:05:25.732352 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:25.732100 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-579cf7c6d-ndnw7" podUID="7987ff40-53a3-4c3e-8ac2-9db0ce704da6" containerName="manager" containerID="cri-o://9a5968a82291c5fa14ea7ab201cac37a45d58fe254e00adaf9a7835481742361" gracePeriod=30 Oct 31 01:05:26.591490 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:26.591458 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-ndnw7" Oct 31 01:05:26.637543 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:26.637503 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7987ff40-53a3-4c3e-8ac2-9db0ce704da6-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7987ff40-53a3-4c3e-8ac2-9db0ce704da6-metrics-certs\") pod \"7987ff40-53a3-4c3e-8ac2-9db0ce704da6\" (UID: \"7987ff40-53a3-4c3e-8ac2-9db0ce704da6\") " Oct 31 01:05:26.637712 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:26.637638 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7987ff40-53a3-4c3e-8ac2-9db0ce704da6-kube-api-access-5hjnw\" (UniqueName: \"kubernetes.io/projected/7987ff40-53a3-4c3e-8ac2-9db0ce704da6-kube-api-access-5hjnw\") pod \"7987ff40-53a3-4c3e-8ac2-9db0ce704da6\" (UID: \"7987ff40-53a3-4c3e-8ac2-9db0ce704da6\") " Oct 31 01:05:26.637712 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:26.637689 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7987ff40-53a3-4c3e-8ac2-9db0ce704da6-webhook-cert\" (UniqueName: \"kubernetes.io/secret/7987ff40-53a3-4c3e-8ac2-9db0ce704da6-webhook-cert\") pod \"7987ff40-53a3-4c3e-8ac2-9db0ce704da6\" (UID: \"7987ff40-53a3-4c3e-8ac2-9db0ce704da6\") " Oct 31 01:05:26.640845 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:26.640810 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7987ff40-53a3-4c3e-8ac2-9db0ce704da6-metrics-certs" pod "7987ff40-53a3-4c3e-8ac2-9db0ce704da6" (UID: "7987ff40-53a3-4c3e-8ac2-9db0ce704da6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:05:26.640956 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:26.640840 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7987ff40-53a3-4c3e-8ac2-9db0ce704da6-kube-api-access-5hjnw" pod "7987ff40-53a3-4c3e-8ac2-9db0ce704da6" (UID: "7987ff40-53a3-4c3e-8ac2-9db0ce704da6"). InnerVolumeSpecName "kube-api-access-5hjnw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:05:26.640956 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:26.640877 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7987ff40-53a3-4c3e-8ac2-9db0ce704da6-webhook-cert" pod "7987ff40-53a3-4c3e-8ac2-9db0ce704da6" (UID: "7987ff40-53a3-4c3e-8ac2-9db0ce704da6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:05:26.738617 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:26.738532 5821 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7987ff40-53a3-4c3e-8ac2-9db0ce704da6-metrics-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:05:26.738617 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:26.738579 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hjnw\" (UniqueName: \"kubernetes.io/projected/7987ff40-53a3-4c3e-8ac2-9db0ce704da6-kube-api-access-5hjnw\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:05:26.738617 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:26.738590 5821 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7987ff40-53a3-4c3e-8ac2-9db0ce704da6-webhook-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:05:26.762011 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:26.761973 5821 generic.go:356] "Generic (PLEG): container finished" podID="7987ff40-53a3-4c3e-8ac2-9db0ce704da6" containerID="9a5968a82291c5fa14ea7ab201cac37a45d58fe254e00adaf9a7835481742361" exitCode=0 Oct 31 01:05:26.762227 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:26.762034 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-ndnw7" Oct 31 01:05:26.762305 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:26.762072 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-ndnw7" event={"ID":"7987ff40-53a3-4c3e-8ac2-9db0ce704da6","Type":"ContainerDied","Data":"9a5968a82291c5fa14ea7ab201cac37a45d58fe254e00adaf9a7835481742361"} Oct 31 01:05:26.762369 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:26.762311 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-ndnw7" event={"ID":"7987ff40-53a3-4c3e-8ac2-9db0ce704da6","Type":"ContainerDied","Data":"90f44918f151a11f2b1526b9dc4d57d24a7d7c015afcacbe8394317a9e7d3ac3"} Oct 31 01:05:26.762369 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:26.762363 5821 scope.go:122] "RemoveContainer" containerID="9a5968a82291c5fa14ea7ab201cac37a45d58fe254e00adaf9a7835481742361" Oct 31 01:05:26.775484 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:26.775461 5821 scope.go:122] "RemoveContainer" containerID="9a5968a82291c5fa14ea7ab201cac37a45d58fe254e00adaf9a7835481742361" Oct 31 01:05:26.775849 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:05:26.775820 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a5968a82291c5fa14ea7ab201cac37a45d58fe254e00adaf9a7835481742361\": container with ID starting with 9a5968a82291c5fa14ea7ab201cac37a45d58fe254e00adaf9a7835481742361 not found: ID does not exist" containerID="9a5968a82291c5fa14ea7ab201cac37a45d58fe254e00adaf9a7835481742361" Oct 31 01:05:26.775948 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:26.775861 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a5968a82291c5fa14ea7ab201cac37a45d58fe254e00adaf9a7835481742361"} err="failed to get container status \"9a5968a82291c5fa14ea7ab201cac37a45d58fe254e00adaf9a7835481742361\": rpc error: code = NotFound desc = could not find container \"9a5968a82291c5fa14ea7ab201cac37a45d58fe254e00adaf9a7835481742361\": container with ID starting with 9a5968a82291c5fa14ea7ab201cac37a45d58fe254e00adaf9a7835481742361 not found: ID does not exist" Oct 31 01:05:26.787439 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:26.787414 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-ndnw7"] Oct 31 01:05:26.792565 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:26.792522 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-ndnw7"] Oct 31 01:05:27.566575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:27.566516 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7987ff40-53a3-4c3e-8ac2-9db0ce704da6" path="/var/lib/kubelet/pods/7987ff40-53a3-4c3e-8ac2-9db0ce704da6/volumes" Oct 31 01:05:30.783727 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:30.783689 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7" event={"ID":"c2513372-48c8-4227-909d-aed579f5a7d3","Type":"ContainerStarted","Data":"5eb9e29dc05061da75a761376ec963acac7d9a1108a500589ff6dc4e3fb92013"} Oct 31 01:05:30.784140 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:30.783785 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7" Oct 31 01:05:30.801728 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:30.801672 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7" podStartSLOduration=2.940035887 podStartE2EDuration="16.801656161s" totalImagesPullingTime="13.861620274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:05:30.801038854 +0000 UTC m=+547.380452761" watchObservedRunningTime="2026-10-31 01:05:30.801656161 +0000 UTC m=+547.381070113" Oct 31 01:05:41.794765 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:41.794687 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-w7lk7" Oct 31 01:05:47.199350 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:05:47.199309 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:05:55.758902 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:55.758865 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64" Oct 31 01:05:56.767319 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:56.767288 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-wssxm" Oct 31 01:05:57.899689 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:57.899631 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp"] Oct 31 01:05:57.900197 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:57.900178 5821 cpu_manager.go:414] "containerMap: removing container" podUID="7987ff40-53a3-4c3e-8ac2-9db0ce704da6" containerName="manager" Oct 31 01:05:57.900240 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:57.900201 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7987ff40-53a3-4c3e-8ac2-9db0ce704da6" containerName="manager" Oct 31 01:05:57.900240 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:57.900228 5821 cpu_manager.go:414] "containerMap: removing container" podUID="a77eeead-f91a-4ebe-817a-af29d676ee76" containerName="discovery" Oct 31 01:05:57.900240 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:57.900236 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a77eeead-f91a-4ebe-817a-af29d676ee76" containerName="discovery" Oct 31 01:05:57.900344 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:57.900333 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="a77eeead-f91a-4ebe-817a-af29d676ee76" containerName="discovery" Oct 31 01:05:57.900379 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:57.900354 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="7987ff40-53a3-4c3e-8ac2-9db0ce704da6" containerName="manager" Oct 31 01:05:58.136263 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.136232 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp"] Oct 31 01:05:58.136263 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.136274 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67977999d7-2krzd"] Oct 31 01:05:58.136531 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.136371 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" Oct 31 01:05:58.141576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.141529 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Oct 31 01:05:58.141576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.141573 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-n5p2t\"" Oct 31 01:05:58.141732 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.141628 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Oct 31 01:05:58.154720 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.154667 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67977999d7-2krzd"] Oct 31 01:05:58.154817 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.154748 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67977999d7-2krzd" Oct 31 01:05:58.161973 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.161950 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Oct 31 01:05:58.162073 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.162058 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Oct 31 01:05:58.241483 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.241444 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Oct 31 01:05:58.241483 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.241483 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9t9bz\"" Oct 31 01:05:58.311717 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.311668 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03b53883-1556-4d78-808d-c06211f42faa-openshift-service-ca\") pod \"maas-api-74dcff9898-bcrbp\" (UID: \"03b53883-1556-4d78-808d-c06211f42faa\") " pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" Oct 31 01:05:58.311888 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.311739 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbgqp\" (UniqueName: \"kubernetes.io/projected/03b53883-1556-4d78-808d-c06211f42faa-kube-api-access-mbgqp\") pod \"maas-api-74dcff9898-bcrbp\" (UID: \"03b53883-1556-4d78-808d-c06211f42faa\") " pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" Oct 31 01:05:58.311888 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.311831 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5t27\" (UniqueName: \"kubernetes.io/projected/bd7b16d9-0fa8-4de9-bab1-489d003090f4-kube-api-access-c5t27\") pod \"authorino-67977999d7-2krzd\" (UID: \"bd7b16d9-0fa8-4de9-bab1-489d003090f4\") " pod="kuadrant-system/authorino-67977999d7-2krzd" Oct 31 01:05:58.311888 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.311850 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd7b16d9-0fa8-4de9-bab1-489d003090f4-tls-cert\") pod \"authorino-67977999d7-2krzd\" (UID: \"bd7b16d9-0fa8-4de9-bab1-489d003090f4\") " pod="kuadrant-system/authorino-67977999d7-2krzd" Oct 31 01:05:58.311888 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.311884 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03b53883-1556-4d78-808d-c06211f42faa-metrics-certs\") pod \"maas-api-74dcff9898-bcrbp\" (UID: \"03b53883-1556-4d78-808d-c06211f42faa\") " pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" Oct 31 01:05:58.312076 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.311909 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03b53883-1556-4d78-808d-c06211f42faa-maas-api-tls\") pod \"maas-api-74dcff9898-bcrbp\" (UID: \"03b53883-1556-4d78-808d-c06211f42faa\") " pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" Oct 31 01:05:58.413319 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.413241 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbgqp\" (UniqueName: \"kubernetes.io/projected/03b53883-1556-4d78-808d-c06211f42faa-kube-api-access-mbgqp\") pod \"maas-api-74dcff9898-bcrbp\" (UID: \"03b53883-1556-4d78-808d-c06211f42faa\") " pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" Oct 31 01:05:58.413319 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.413307 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5t27\" (UniqueName: \"kubernetes.io/projected/bd7b16d9-0fa8-4de9-bab1-489d003090f4-kube-api-access-c5t27\") pod \"authorino-67977999d7-2krzd\" (UID: \"bd7b16d9-0fa8-4de9-bab1-489d003090f4\") " pod="kuadrant-system/authorino-67977999d7-2krzd" Oct 31 01:05:58.413548 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.413333 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd7b16d9-0fa8-4de9-bab1-489d003090f4-tls-cert\") pod \"authorino-67977999d7-2krzd\" (UID: \"bd7b16d9-0fa8-4de9-bab1-489d003090f4\") " pod="kuadrant-system/authorino-67977999d7-2krzd" Oct 31 01:05:58.413548 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.413366 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03b53883-1556-4d78-808d-c06211f42faa-metrics-certs\") pod \"maas-api-74dcff9898-bcrbp\" (UID: \"03b53883-1556-4d78-808d-c06211f42faa\") " pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" Oct 31 01:05:58.413548 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.413395 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03b53883-1556-4d78-808d-c06211f42faa-maas-api-tls\") pod \"maas-api-74dcff9898-bcrbp\" (UID: \"03b53883-1556-4d78-808d-c06211f42faa\") " pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" Oct 31 01:05:58.413548 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.413428 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03b53883-1556-4d78-808d-c06211f42faa-openshift-service-ca\") pod \"maas-api-74dcff9898-bcrbp\" (UID: \"03b53883-1556-4d78-808d-c06211f42faa\") " pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" Oct 31 01:05:58.414200 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.414175 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03b53883-1556-4d78-808d-c06211f42faa-openshift-service-ca\") pod \"maas-api-74dcff9898-bcrbp\" (UID: \"03b53883-1556-4d78-808d-c06211f42faa\") " pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" Oct 31 01:05:58.415962 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.415931 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03b53883-1556-4d78-808d-c06211f42faa-metrics-certs\") pod \"maas-api-74dcff9898-bcrbp\" (UID: \"03b53883-1556-4d78-808d-c06211f42faa\") " pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" Oct 31 01:05:58.416043 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.416006 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd7b16d9-0fa8-4de9-bab1-489d003090f4-tls-cert\") pod \"authorino-67977999d7-2krzd\" (UID: \"bd7b16d9-0fa8-4de9-bab1-489d003090f4\") " pod="kuadrant-system/authorino-67977999d7-2krzd" Oct 31 01:05:58.416082 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.416044 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03b53883-1556-4d78-808d-c06211f42faa-maas-api-tls\") pod \"maas-api-74dcff9898-bcrbp\" (UID: \"03b53883-1556-4d78-808d-c06211f42faa\") " pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" Oct 31 01:05:58.421440 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.421418 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbgqp\" (UniqueName: \"kubernetes.io/projected/03b53883-1556-4d78-808d-c06211f42faa-kube-api-access-mbgqp\") pod \"maas-api-74dcff9898-bcrbp\" (UID: \"03b53883-1556-4d78-808d-c06211f42faa\") " pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" Oct 31 01:05:58.421584 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.421546 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5t27\" (UniqueName: \"kubernetes.io/projected/bd7b16d9-0fa8-4de9-bab1-489d003090f4-kube-api-access-c5t27\") pod \"authorino-67977999d7-2krzd\" (UID: \"bd7b16d9-0fa8-4de9-bab1-489d003090f4\") " pod="kuadrant-system/authorino-67977999d7-2krzd" Oct 31 01:05:58.461935 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.461909 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" Oct 31 01:05:58.489661 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.489630 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67977999d7-2krzd" Oct 31 01:05:58.770759 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.770683 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp"] Oct 31 01:05:58.773850 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:05:58.773818 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03b53883_1556_4d78_808d_c06211f42faa.slice/crio-e181f11bff38904157f7c34c51a2273c53323dd15eb7235266e49c6509721165 WatchSource:0}: Error finding container e181f11bff38904157f7c34c51a2273c53323dd15eb7235266e49c6509721165: Status 404 returned error can't find the container with id e181f11bff38904157f7c34c51a2273c53323dd15eb7235266e49c6509721165 Oct 31 01:05:58.798563 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.798520 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67977999d7-2krzd"] Oct 31 01:05:58.801235 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:05:58.801210 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd7b16d9_0fa8_4de9_bab1_489d003090f4.slice/crio-e4708216b07e103cf734d1458c46ff58e571288509a8a37f186fbb97a2a9c83c WatchSource:0}: Error finding container e4708216b07e103cf734d1458c46ff58e571288509a8a37f186fbb97a2a9c83c: Status 404 returned error can't find the container with id e4708216b07e103cf734d1458c46ff58e571288509a8a37f186fbb97a2a9c83c Oct 31 01:05:58.908023 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.907980 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67977999d7-2krzd" event={"ID":"bd7b16d9-0fa8-4de9-bab1-489d003090f4","Type":"ContainerStarted","Data":"e4708216b07e103cf734d1458c46ff58e571288509a8a37f186fbb97a2a9c83c"} Oct 31 01:05:58.909215 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:05:58.909188 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" event={"ID":"03b53883-1556-4d78-808d-c06211f42faa","Type":"ContainerStarted","Data":"e181f11bff38904157f7c34c51a2273c53323dd15eb7235266e49c6509721165"} Oct 31 01:06:00.919924 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:00.919887 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67977999d7-2krzd" event={"ID":"bd7b16d9-0fa8-4de9-bab1-489d003090f4","Type":"ContainerStarted","Data":"b5502ec29dcb6358a96a0b1826eacb530e4c1801a06de0de4995142975a6fcd5"} Oct 31 01:06:00.936617 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:00.936545 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-67977999d7-2krzd" podStartSLOduration=1.849983867 podStartE2EDuration="2.936530179s" totalImagesPullingTime="1.086546312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:05:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:06:00.936010222 +0000 UTC m=+577.515424132" watchObservedRunningTime="2026-10-31 01:06:00.936530179 +0000 UTC m=+577.515944087" Oct 31 01:06:01.925775 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:01.925731 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" event={"ID":"03b53883-1556-4d78-808d-c06211f42faa","Type":"ContainerStarted","Data":"e79cde48fbde459978ec636ee1426fc61f68ec4bc2c9dc558e295330ae70fa66"} Oct 31 01:06:01.926229 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:01.925803 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" Oct 31 01:06:01.944888 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:01.944826 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" podStartSLOduration=2.786543875 podStartE2EDuration="4.944807904s" totalImagesPullingTime="2.158264029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:05:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:06:01.94422919 +0000 UTC m=+578.523643097" watchObservedRunningTime="2026-10-31 01:06:01.944807904 +0000 UTC m=+578.524221811" Oct 31 01:06:07.936793 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:07.936757 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" Oct 31 01:06:17.198900 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:06:17.198862 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:06:22.038830 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:22.038792 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-kwpvb"] Oct 31 01:06:22.042505 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:22.042481 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-kwpvb" Oct 31 01:06:22.052290 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:22.052261 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-kwpvb"] Oct 31 01:06:22.117889 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:22.117845 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpg8t\" (UniqueName: \"kubernetes.io/projected/76963baa-c132-4c79-97b9-5402f25d80af-kube-api-access-jpg8t\") pod \"llmisvc-controller-manager-6466c554d8-kwpvb\" (UID: \"76963baa-c132-4c79-97b9-5402f25d80af\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-kwpvb" Oct 31 01:06:22.118107 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:22.117909 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76963baa-c132-4c79-97b9-5402f25d80af-cert\") pod \"llmisvc-controller-manager-6466c554d8-kwpvb\" (UID: \"76963baa-c132-4c79-97b9-5402f25d80af\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-kwpvb" Oct 31 01:06:22.218918 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:22.218884 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpg8t\" (UniqueName: \"kubernetes.io/projected/76963baa-c132-4c79-97b9-5402f25d80af-kube-api-access-jpg8t\") pod \"llmisvc-controller-manager-6466c554d8-kwpvb\" (UID: \"76963baa-c132-4c79-97b9-5402f25d80af\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-kwpvb" Oct 31 01:06:22.219084 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:22.218937 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76963baa-c132-4c79-97b9-5402f25d80af-cert\") pod \"llmisvc-controller-manager-6466c554d8-kwpvb\" (UID: \"76963baa-c132-4c79-97b9-5402f25d80af\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-kwpvb" Oct 31 01:06:22.221266 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:22.221246 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76963baa-c132-4c79-97b9-5402f25d80af-cert\") pod \"llmisvc-controller-manager-6466c554d8-kwpvb\" (UID: \"76963baa-c132-4c79-97b9-5402f25d80af\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-kwpvb" Oct 31 01:06:22.228140 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:22.228115 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpg8t\" (UniqueName: \"kubernetes.io/projected/76963baa-c132-4c79-97b9-5402f25d80af-kube-api-access-jpg8t\") pod \"llmisvc-controller-manager-6466c554d8-kwpvb\" (UID: \"76963baa-c132-4c79-97b9-5402f25d80af\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-kwpvb" Oct 31 01:06:22.356883 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:22.356784 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-kwpvb" Oct 31 01:06:22.629390 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:22.629365 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-kwpvb"] Oct 31 01:06:22.632082 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:06:22.632052 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76963baa_c132_4c79_97b9_5402f25d80af.slice/crio-94ee6dbb7e99591bcf057ab489efa7b4b69803a8b6fb80ba1a8d12e87d362053 WatchSource:0}: Error finding container 94ee6dbb7e99591bcf057ab489efa7b4b69803a8b6fb80ba1a8d12e87d362053: Status 404 returned error can't find the container with id 94ee6dbb7e99591bcf057ab489efa7b4b69803a8b6fb80ba1a8d12e87d362053 Oct 31 01:06:23.020622 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:23.020531 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-kwpvb" event={"ID":"76963baa-c132-4c79-97b9-5402f25d80af","Type":"ContainerStarted","Data":"94ee6dbb7e99591bcf057ab489efa7b4b69803a8b6fb80ba1a8d12e87d362053"} Oct 31 01:06:23.624271 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:23.624243 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/1.log" Oct 31 01:06:23.627512 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:23.627490 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/1.log" Oct 31 01:06:24.027062 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:24.026969 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-kwpvb" event={"ID":"76963baa-c132-4c79-97b9-5402f25d80af","Type":"ContainerStarted","Data":"c170a50e502e1e6f698fae065ab6096477d324dbebfff319aa0bbb5c02409b09"} Oct 31 01:06:24.027212 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:24.027110 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-kwpvb" Oct 31 01:06:24.050301 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:24.050246 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-kwpvb" podStartSLOduration=1.660068434 podStartE2EDuration="2.050231802s" totalImagesPullingTime="390.163368ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:06:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:06:24.04787257 +0000 UTC m=+600.627286478" watchObservedRunningTime="2026-10-31 01:06:24.050231802 +0000 UTC m=+600.629645709" Oct 31 01:06:47.199531 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:06:47.199483 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:06:55.034469 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:55.034431 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-kwpvb" Oct 31 01:06:55.084451 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:55.084417 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64"] Oct 31 01:06:55.084733 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:55.084689 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64" podUID="62443a9a-64bf-4e1a-aa5a-8f0c598b79e8" containerName="manager" containerID="cri-o://83875bd08e81427d2c657b56ec7588224ef3c1d3a2782589be1e223cd62fa8a9" gracePeriod=30 Oct 31 01:06:55.333465 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:55.333434 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64" Oct 31 01:06:55.419479 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:55.419433 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/62443a9a-64bf-4e1a-aa5a-8f0c598b79e8-cert\" (UniqueName: \"kubernetes.io/secret/62443a9a-64bf-4e1a-aa5a-8f0c598b79e8-cert\") pod \"62443a9a-64bf-4e1a-aa5a-8f0c598b79e8\" (UID: \"62443a9a-64bf-4e1a-aa5a-8f0c598b79e8\") " Oct 31 01:06:55.419479 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:55.419486 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/62443a9a-64bf-4e1a-aa5a-8f0c598b79e8-kube-api-access-29fqf\" (UniqueName: \"kubernetes.io/projected/62443a9a-64bf-4e1a-aa5a-8f0c598b79e8-kube-api-access-29fqf\") pod \"62443a9a-64bf-4e1a-aa5a-8f0c598b79e8\" (UID: \"62443a9a-64bf-4e1a-aa5a-8f0c598b79e8\") " Oct 31 01:06:55.421607 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:55.421579 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62443a9a-64bf-4e1a-aa5a-8f0c598b79e8-cert" pod "62443a9a-64bf-4e1a-aa5a-8f0c598b79e8" (UID: "62443a9a-64bf-4e1a-aa5a-8f0c598b79e8"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:06:55.421800 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:55.421777 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62443a9a-64bf-4e1a-aa5a-8f0c598b79e8-kube-api-access-29fqf" pod "62443a9a-64bf-4e1a-aa5a-8f0c598b79e8" (UID: "62443a9a-64bf-4e1a-aa5a-8f0c598b79e8"). InnerVolumeSpecName "kube-api-access-29fqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:06:55.520409 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:55.520375 5821 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62443a9a-64bf-4e1a-aa5a-8f0c598b79e8-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:06:55.520409 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:55.520406 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29fqf\" (UniqueName: \"kubernetes.io/projected/62443a9a-64bf-4e1a-aa5a-8f0c598b79e8-kube-api-access-29fqf\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:06:56.169017 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:56.168975 5821 generic.go:356] "Generic (PLEG): container finished" podID="62443a9a-64bf-4e1a-aa5a-8f0c598b79e8" containerID="83875bd08e81427d2c657b56ec7588224ef3c1d3a2782589be1e223cd62fa8a9" exitCode=0 Oct 31 01:06:56.169522 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:56.169051 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64" Oct 31 01:06:56.169522 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:56.169062 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64" event={"ID":"62443a9a-64bf-4e1a-aa5a-8f0c598b79e8","Type":"ContainerDied","Data":"83875bd08e81427d2c657b56ec7588224ef3c1d3a2782589be1e223cd62fa8a9"} Oct 31 01:06:56.169522 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:56.169166 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64" event={"ID":"62443a9a-64bf-4e1a-aa5a-8f0c598b79e8","Type":"ContainerDied","Data":"d1b8983640b6abad7e9aee30c3789d85c60abfcfb06b46df22db92cbb8807cb9"} Oct 31 01:06:56.169522 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:56.169205 5821 scope.go:122] "RemoveContainer" containerID="83875bd08e81427d2c657b56ec7588224ef3c1d3a2782589be1e223cd62fa8a9" Oct 31 01:06:56.177919 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:56.177896 5821 scope.go:122] "RemoveContainer" containerID="83875bd08e81427d2c657b56ec7588224ef3c1d3a2782589be1e223cd62fa8a9" Oct 31 01:06:56.178217 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:06:56.178191 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83875bd08e81427d2c657b56ec7588224ef3c1d3a2782589be1e223cd62fa8a9\": container with ID starting with 83875bd08e81427d2c657b56ec7588224ef3c1d3a2782589be1e223cd62fa8a9 not found: ID does not exist" containerID="83875bd08e81427d2c657b56ec7588224ef3c1d3a2782589be1e223cd62fa8a9" Oct 31 01:06:56.178269 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:56.178221 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83875bd08e81427d2c657b56ec7588224ef3c1d3a2782589be1e223cd62fa8a9"} err="failed to get container status \"83875bd08e81427d2c657b56ec7588224ef3c1d3a2782589be1e223cd62fa8a9\": rpc error: code = NotFound desc = could not find container \"83875bd08e81427d2c657b56ec7588224ef3c1d3a2782589be1e223cd62fa8a9\": container with ID starting with 83875bd08e81427d2c657b56ec7588224ef3c1d3a2782589be1e223cd62fa8a9 not found: ID does not exist" Oct 31 01:06:56.189698 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:56.189671 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64"] Oct 31 01:06:56.194858 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:56.194836 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-6mw64"] Oct 31 01:06:57.565568 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:06:57.565520 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="62443a9a-64bf-4e1a-aa5a-8f0c598b79e8" path="/var/lib/kubelet/pods/62443a9a-64bf-4e1a-aa5a-8f0c598b79e8/volumes" Oct 31 01:07:17.210774 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:07:17.210680 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:07:36.560538 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.560500 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh"] Oct 31 01:07:36.560983 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.560859 5821 cpu_manager.go:414] "containerMap: removing container" podUID="62443a9a-64bf-4e1a-aa5a-8f0c598b79e8" containerName="manager" Oct 31 01:07:36.560983 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.560870 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="62443a9a-64bf-4e1a-aa5a-8f0c598b79e8" containerName="manager" Oct 31 01:07:36.560983 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.560965 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="62443a9a-64bf-4e1a-aa5a-8f0c598b79e8" containerName="manager" Oct 31 01:07:36.562979 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.562956 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.576951 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.576923 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh"] Oct 31 01:07:36.656175 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.656137 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-nj7zm\"" Oct 31 01:07:36.702493 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.702455 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-istio-token\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.702734 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.702710 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-credential-socket\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.702785 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.702753 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.702867 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.702851 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-workload-socket\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.702972 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.702941 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-istio-data\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.703014 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.702996 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-workload-certs\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.703066 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.703046 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.703104 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.703096 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-istio-envoy\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.703185 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.703173 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7vwd\" (UniqueName: \"kubernetes.io/projected/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-kube-api-access-r7vwd\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.803811 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.803774 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-workload-socket\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.803811 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.803812 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-istio-data\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.804056 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.803833 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-workload-certs\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.804056 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.803857 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.804056 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.803885 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-istio-envoy\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.804056 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.803950 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7vwd\" (UniqueName: \"kubernetes.io/projected/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-kube-api-access-r7vwd\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.804056 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.803992 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-istio-token\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.804056 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.804033 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-credential-socket\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.804056 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.804058 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.804395 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.804217 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-istio-data\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.804395 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.804261 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-workload-socket\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.804494 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.804434 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-workload-certs\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.804591 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.804520 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-credential-socket\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.804724 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.804696 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.806434 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.806412 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-istio-envoy\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.806589 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.806570 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.812117 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.812061 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7vwd\" (UniqueName: \"kubernetes.io/projected/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-kube-api-access-r7vwd\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.812117 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.812100 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60eebb39-7f6b-49cc-ba62-d7e82db53ec7-istio-token\") pod \"maas-default-gateway-openshift-default-855f9574cf-xrzzh\" (UID: \"60eebb39-7f6b-49cc-ba62-d7e82db53ec7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:36.874610 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:36.874537 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:37.152742 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:37.152718 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh"] Oct 31 01:07:37.155666 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:07:37.155628 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60eebb39_7f6b_49cc_ba62_d7e82db53ec7.slice/crio-07951427caf3a3a1874d9719ca2643fa08e9d1450dd6480488fe67ce1ecc3e5d WatchSource:0}: Error finding container 07951427caf3a3a1874d9719ca2643fa08e9d1450dd6480488fe67ce1ecc3e5d: Status 404 returned error can't find the container with id 07951427caf3a3a1874d9719ca2643fa08e9d1450dd6480488fe67ce1ecc3e5d Oct 31 01:07:37.357433 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:37.357398 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" event={"ID":"60eebb39-7f6b-49cc-ba62-d7e82db53ec7","Type":"ContainerStarted","Data":"07951427caf3a3a1874d9719ca2643fa08e9d1450dd6480488fe67ce1ecc3e5d"} Oct 31 01:07:40.905497 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:40.905464 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:07:40.905841 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:40.905533 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:07:40.905841 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:40.905637 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:07:41.378527 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:41.378491 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" event={"ID":"60eebb39-7f6b-49cc-ba62-d7e82db53ec7","Type":"ContainerStarted","Data":"06014877c229236ece46070b54ad117699bf6ce02dd1dad5b56319ef8353766d"} Oct 31 01:07:41.401470 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:41.401413 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" podStartSLOduration=1.654427418 podStartE2EDuration="5.401399568s" totalImagesPullingTime="3.74697215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:07:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:07:41.399896482 +0000 UTC m=+677.979310400" watchObservedRunningTime="2026-10-31 01:07:41.401399568 +0000 UTC m=+677.980813476" Oct 31 01:07:41.874993 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:41.874952 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:41.876581 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:41.876532 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-xrzzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Oct 31 01:07:41.876717 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:41.876596 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" podUID="60eebb39-7f6b-49cc-ba62-d7e82db53ec7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Oct 31 01:07:42.875778 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:42.875734 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-xrzzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Oct 31 01:07:42.876180 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:42.875795 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" podUID="60eebb39-7f6b-49cc-ba62-d7e82db53ec7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Oct 31 01:07:43.875238 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:43.875192 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-xrzzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Oct 31 01:07:43.875429 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:43.875260 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" podUID="60eebb39-7f6b-49cc-ba62-d7e82db53ec7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Oct 31 01:07:44.393607 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:44.393542 5821 generic.go:356] "Generic (PLEG): container finished" podID="c1e051a8-bd2b-424e-8e0b-7819391b4673" containerID="f973df21685b5ff56ab05dcaa2d83a338269e75dd15e655bad0c4fa8a75c9601" exitCode=1 Oct 31 01:07:44.393607 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:44.393608 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" event={"ID":"c1e051a8-bd2b-424e-8e0b-7819391b4673","Type":"ContainerDied","Data":"f973df21685b5ff56ab05dcaa2d83a338269e75dd15e655bad0c4fa8a75c9601"} Oct 31 01:07:44.394049 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:44.393954 5821 scope.go:122] "RemoveContainer" containerID="f973df21685b5ff56ab05dcaa2d83a338269e75dd15e655bad0c4fa8a75c9601" Oct 31 01:07:44.875076 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:44.875040 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-xrzzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Oct 31 01:07:44.875268 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:44.875101 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" podUID="60eebb39-7f6b-49cc-ba62-d7e82db53ec7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Oct 31 01:07:45.400350 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:45.400314 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" event={"ID":"c1e051a8-bd2b-424e-8e0b-7819391b4673","Type":"ContainerStarted","Data":"ef3649904c2756f5145209aa9806c72757ef64992c7758c96bbca2338baa0031"} Oct 31 01:07:45.400799 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:45.400672 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" Oct 31 01:07:45.875132 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:45.875092 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-xrzzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Oct 31 01:07:45.875319 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:45.875151 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" podUID="60eebb39-7f6b-49cc-ba62-d7e82db53ec7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Oct 31 01:07:46.875773 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:46.875729 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-xrzzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Oct 31 01:07:46.876197 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:46.875803 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" podUID="60eebb39-7f6b-49cc-ba62-d7e82db53ec7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Oct 31 01:07:47.199702 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:07:47.199620 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:07:47.875299 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:47.875258 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-xrzzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Oct 31 01:07:47.875480 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:47.875321 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" podUID="60eebb39-7f6b-49cc-ba62-d7e82db53ec7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Oct 31 01:07:49.209743 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:49.209693 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:49.210238 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:49.210025 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:49.210945 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:49.210928 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" Oct 31 01:07:51.581205 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.581158 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd"] Oct 31 01:07:51.585052 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.585023 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.596883 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.596852 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd"] Oct 31 01:07:51.640675 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.640639 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd60c366-7aad-4b22-8e91-55da66289297-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.640855 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.640684 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd60c366-7aad-4b22-8e91-55da66289297-istio-podinfo\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.640855 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.640703 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd60c366-7aad-4b22-8e91-55da66289297-credential-socket\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.640855 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.640811 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd60c366-7aad-4b22-8e91-55da66289297-workload-socket\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.640855 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.640842 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpr4g\" (UniqueName: \"kubernetes.io/projected/dd60c366-7aad-4b22-8e91-55da66289297-kube-api-access-bpr4g\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.641073 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.640867 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd60c366-7aad-4b22-8e91-55da66289297-istio-data\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.641073 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.640884 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd60c366-7aad-4b22-8e91-55da66289297-istio-envoy\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.641073 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.640939 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd60c366-7aad-4b22-8e91-55da66289297-istio-token\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.641073 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.640999 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd60c366-7aad-4b22-8e91-55da66289297-workload-certs\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.742004 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.741959 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd60c366-7aad-4b22-8e91-55da66289297-workload-socket\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.742004 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.742006 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpr4g\" (UniqueName: \"kubernetes.io/projected/dd60c366-7aad-4b22-8e91-55da66289297-kube-api-access-bpr4g\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.742244 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.742121 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd60c366-7aad-4b22-8e91-55da66289297-istio-data\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.742244 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.742159 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd60c366-7aad-4b22-8e91-55da66289297-istio-envoy\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.742244 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.742178 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd60c366-7aad-4b22-8e91-55da66289297-istio-token\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.742244 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.742211 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd60c366-7aad-4b22-8e91-55da66289297-workload-certs\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.742464 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.742297 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd60c366-7aad-4b22-8e91-55da66289297-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.742464 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.742348 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd60c366-7aad-4b22-8e91-55da66289297-istio-podinfo\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.742464 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.742382 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd60c366-7aad-4b22-8e91-55da66289297-credential-socket\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.742464 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.742431 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd60c366-7aad-4b22-8e91-55da66289297-workload-socket\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.742710 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.742495 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd60c366-7aad-4b22-8e91-55da66289297-istio-data\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.742710 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.742652 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd60c366-7aad-4b22-8e91-55da66289297-workload-certs\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.742803 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.742731 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd60c366-7aad-4b22-8e91-55da66289297-credential-socket\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.742964 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.742944 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd60c366-7aad-4b22-8e91-55da66289297-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.744616 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.744592 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd60c366-7aad-4b22-8e91-55da66289297-istio-envoy\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.744736 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.744721 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd60c366-7aad-4b22-8e91-55da66289297-istio-podinfo\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.750644 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.750619 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd60c366-7aad-4b22-8e91-55da66289297-istio-token\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.750799 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.750780 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpr4g\" (UniqueName: \"kubernetes.io/projected/dd60c366-7aad-4b22-8e91-55da66289297-kube-api-access-bpr4g\") pod \"maas-default-gateway-openshift-default-855f9574cf-bvpfd\" (UID: \"dd60c366-7aad-4b22-8e91-55da66289297\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:51.898232 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:51.898182 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:52.176008 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:52.175974 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd"] Oct 31 01:07:52.178843 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:07:52.178817 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd60c366_7aad_4b22_8e91_55da66289297.slice/crio-ba37405b029abed7134b9b7f99b723d94e9aceb75c2185668f4b10c51bb6c5fe WatchSource:0}: Error finding container ba37405b029abed7134b9b7f99b723d94e9aceb75c2185668f4b10c51bb6c5fe: Status 404 returned error can't find the container with id ba37405b029abed7134b9b7f99b723d94e9aceb75c2185668f4b10c51bb6c5fe Oct 31 01:07:52.182858 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:52.182823 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:07:52.182963 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:52.182893 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:07:52.182963 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:52.182920 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:07:52.434759 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:52.434669 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" event={"ID":"dd60c366-7aad-4b22-8e91-55da66289297","Type":"ContainerStarted","Data":"590ee22ce0e71d8724c833e6b7aae579bbc409a0724f0eab8e04159d77e8be54"} Oct 31 01:07:52.434759 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:52.434739 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" event={"ID":"dd60c366-7aad-4b22-8e91-55da66289297","Type":"ContainerStarted","Data":"ba37405b029abed7134b9b7f99b723d94e9aceb75c2185668f4b10c51bb6c5fe"} Oct 31 01:07:52.453740 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:52.453691 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" podStartSLOduration=1.453677854 podStartE2EDuration="1.453677854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:07:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:07:52.452871213 +0000 UTC m=+689.032285121" watchObservedRunningTime="2026-10-31 01:07:52.453677854 +0000 UTC m=+689.033091739" Oct 31 01:07:52.898823 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:52.898779 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:07:53.899740 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:53.899707 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-bvpfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Oct 31 01:07:53.900131 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:53.899763 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" podUID="dd60c366-7aad-4b22-8e91-55da66289297" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Oct 31 01:07:54.899060 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:54.899023 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-bvpfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Oct 31 01:07:54.899326 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:54.899077 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" podUID="dd60c366-7aad-4b22-8e91-55da66289297" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Oct 31 01:07:55.899122 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:55.899083 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-bvpfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Oct 31 01:07:55.899537 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:55.899137 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" podUID="dd60c366-7aad-4b22-8e91-55da66289297" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Oct 31 01:07:56.408118 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:56.408086 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" Oct 31 01:07:56.899152 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:56.899110 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-bvpfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Oct 31 01:07:56.899607 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:56.899170 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" podUID="dd60c366-7aad-4b22-8e91-55da66289297" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Oct 31 01:07:57.898727 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:57.898689 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-bvpfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Oct 31 01:07:57.898911 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:57.898749 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" podUID="dd60c366-7aad-4b22-8e91-55da66289297" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Oct 31 01:07:58.898571 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:58.898525 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-bvpfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Oct 31 01:07:58.899058 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:07:58.898613 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" podUID="dd60c366-7aad-4b22-8e91-55da66289297" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Oct 31 01:08:00.438057 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:00.438014 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:08:00.438520 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:00.438413 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:08:00.439378 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:00.439356 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-bvpfd" Oct 31 01:08:06.141510 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.141462 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67977999d7-2krzd"] Oct 31 01:08:06.142022 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.141710 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-67977999d7-2krzd" podUID="bd7b16d9-0fa8-4de9-bab1-489d003090f4" containerName="authorino" containerID="cri-o://b5502ec29dcb6358a96a0b1826eacb530e4c1801a06de0de4995142975a6fcd5" gracePeriod=30 Oct 31 01:08:06.440617 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.440523 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67977999d7-2krzd" Oct 31 01:08:06.532358 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.532318 5821 generic.go:356] "Generic (PLEG): container finished" podID="bd7b16d9-0fa8-4de9-bab1-489d003090f4" containerID="b5502ec29dcb6358a96a0b1826eacb530e4c1801a06de0de4995142975a6fcd5" exitCode=0 Oct 31 01:08:06.532521 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.532369 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67977999d7-2krzd" Oct 31 01:08:06.532521 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.532401 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67977999d7-2krzd" event={"ID":"bd7b16d9-0fa8-4de9-bab1-489d003090f4","Type":"ContainerDied","Data":"b5502ec29dcb6358a96a0b1826eacb530e4c1801a06de0de4995142975a6fcd5"} Oct 31 01:08:06.532521 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.532444 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67977999d7-2krzd" event={"ID":"bd7b16d9-0fa8-4de9-bab1-489d003090f4","Type":"ContainerDied","Data":"e4708216b07e103cf734d1458c46ff58e571288509a8a37f186fbb97a2a9c83c"} Oct 31 01:08:06.532521 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.532463 5821 scope.go:122] "RemoveContainer" containerID="b5502ec29dcb6358a96a0b1826eacb530e4c1801a06de0de4995142975a6fcd5" Oct 31 01:08:06.542263 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.542234 5821 scope.go:122] "RemoveContainer" containerID="b5502ec29dcb6358a96a0b1826eacb530e4c1801a06de0de4995142975a6fcd5" Oct 31 01:08:06.542705 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:08:06.542678 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5502ec29dcb6358a96a0b1826eacb530e4c1801a06de0de4995142975a6fcd5\": container with ID starting with b5502ec29dcb6358a96a0b1826eacb530e4c1801a06de0de4995142975a6fcd5 not found: ID does not exist" containerID="b5502ec29dcb6358a96a0b1826eacb530e4c1801a06de0de4995142975a6fcd5" Oct 31 01:08:06.542820 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.542723 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5502ec29dcb6358a96a0b1826eacb530e4c1801a06de0de4995142975a6fcd5"} err="failed to get container status \"b5502ec29dcb6358a96a0b1826eacb530e4c1801a06de0de4995142975a6fcd5\": rpc error: code = NotFound desc = could not find container \"b5502ec29dcb6358a96a0b1826eacb530e4c1801a06de0de4995142975a6fcd5\": container with ID starting with b5502ec29dcb6358a96a0b1826eacb530e4c1801a06de0de4995142975a6fcd5 not found: ID does not exist" Oct 31 01:08:06.595753 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.595722 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bd7b16d9-0fa8-4de9-bab1-489d003090f4-kube-api-access-c5t27\" (UniqueName: \"kubernetes.io/projected/bd7b16d9-0fa8-4de9-bab1-489d003090f4-kube-api-access-c5t27\") pod \"bd7b16d9-0fa8-4de9-bab1-489d003090f4\" (UID: \"bd7b16d9-0fa8-4de9-bab1-489d003090f4\") " Oct 31 01:08:06.595987 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.595779 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bd7b16d9-0fa8-4de9-bab1-489d003090f4-tls-cert\" (UniqueName: \"kubernetes.io/secret/bd7b16d9-0fa8-4de9-bab1-489d003090f4-tls-cert\") pod \"bd7b16d9-0fa8-4de9-bab1-489d003090f4\" (UID: \"bd7b16d9-0fa8-4de9-bab1-489d003090f4\") " Oct 31 01:08:06.610258 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.610204 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd7b16d9-0fa8-4de9-bab1-489d003090f4-kube-api-access-c5t27" pod "bd7b16d9-0fa8-4de9-bab1-489d003090f4" (UID: "bd7b16d9-0fa8-4de9-bab1-489d003090f4"). InnerVolumeSpecName "kube-api-access-c5t27". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:08:06.611440 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.611411 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk"] Oct 31 01:08:06.611986 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.611965 5821 cpu_manager.go:414] "containerMap: removing container" podUID="bd7b16d9-0fa8-4de9-bab1-489d003090f4" containerName="authorino" Oct 31 01:08:06.612057 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.611986 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd7b16d9-0fa8-4de9-bab1-489d003090f4" containerName="authorino" Oct 31 01:08:06.612136 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.612124 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd7b16d9-0fa8-4de9-bab1-489d003090f4" containerName="authorino" Oct 31 01:08:06.615747 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.615716 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd7b16d9-0fa8-4de9-bab1-489d003090f4-tls-cert" pod "bd7b16d9-0fa8-4de9-bab1-489d003090f4" (UID: "bd7b16d9-0fa8-4de9-bab1-489d003090f4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:08:06.616990 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.616972 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.621969 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.621941 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk"] Oct 31 01:08:06.701645 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.698827 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5t27\" (UniqueName: \"kubernetes.io/projected/bd7b16d9-0fa8-4de9-bab1-489d003090f4-kube-api-access-c5t27\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:08:06.701645 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.698858 5821 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd7b16d9-0fa8-4de9-bab1-489d003090f4-tls-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:08:06.799587 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.799443 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-istio-envoy\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.799587 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.799499 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-workload-certs\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.799587 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.799541 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-istio-data\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.799917 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.799868 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7t62\" (UniqueName: \"kubernetes.io/projected/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-kube-api-access-w7t62\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.800025 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.800001 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-istio-token\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.800112 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.800057 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-workload-socket\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.800199 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.800119 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.800199 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.800156 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.800199 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.800186 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-credential-socket\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.858200 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.858167 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67977999d7-2krzd"] Oct 31 01:08:06.866815 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.866778 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-67977999d7-2krzd"] Oct 31 01:08:06.901008 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.900973 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-istio-data\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.901008 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.901013 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7t62\" (UniqueName: \"kubernetes.io/projected/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-kube-api-access-w7t62\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.901322 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.901088 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-istio-token\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.901322 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.901134 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-workload-socket\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.901322 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.901182 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.901322 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.901217 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.901322 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.901241 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-credential-socket\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.901322 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.901281 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-istio-envoy\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.901322 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.901317 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-workload-certs\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.901818 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.901778 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-workload-certs\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.902379 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.902051 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-istio-data\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.902379 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.902158 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-credential-socket\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.903708 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.902865 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.903708 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.903659 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-workload-socket\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.905132 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.905088 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-istio-envoy\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.906450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.906429 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.911685 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.911665 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7t62\" (UniqueName: \"kubernetes.io/projected/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-kube-api-access-w7t62\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.911767 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.911682 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ea534a5-bd49-4cbd-b0ec-5b60c645546b-istio-token\") pod \"maas-default-gateway-openshift-default-855f9574cf-jl2rk\" (UID: \"4ea534a5-bd49-4cbd-b0ec-5b60c645546b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:06.933685 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:06.933666 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:07.227033 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:07.227001 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk"] Oct 31 01:08:07.229895 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:08:07.229869 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea534a5_bd49_4cbd_b0ec_5b60c645546b.slice/crio-160af7c607a0dd0fbc2bc1e2adb586fb83d98f0d7fded4f2e808243c5ebcea19 WatchSource:0}: Error finding container 160af7c607a0dd0fbc2bc1e2adb586fb83d98f0d7fded4f2e808243c5ebcea19: Status 404 returned error can't find the container with id 160af7c607a0dd0fbc2bc1e2adb586fb83d98f0d7fded4f2e808243c5ebcea19 Oct 31 01:08:07.232588 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:07.232533 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:08:07.232663 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:07.232641 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:08:07.232720 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:07.232703 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:08:07.539495 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:07.539410 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" event={"ID":"4ea534a5-bd49-4cbd-b0ec-5b60c645546b","Type":"ContainerStarted","Data":"c01b96a24886071db1ea02d52df4831d59e2386f1cac3dd11cba2b0a7cb02950"} Oct 31 01:08:07.539495 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:07.539471 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" event={"ID":"4ea534a5-bd49-4cbd-b0ec-5b60c645546b","Type":"ContainerStarted","Data":"160af7c607a0dd0fbc2bc1e2adb586fb83d98f0d7fded4f2e808243c5ebcea19"} Oct 31 01:08:07.563157 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:07.563094 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" podStartSLOduration=1.5630800919999999 podStartE2EDuration="1.563080092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:08:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:08:07.561526017 +0000 UTC m=+704.140939928" watchObservedRunningTime="2026-10-31 01:08:07.563080092 +0000 UTC m=+704.142493999" Oct 31 01:08:07.567214 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:07.567169 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bd7b16d9-0fa8-4de9-bab1-489d003090f4" path="/var/lib/kubelet/pods/bd7b16d9-0fa8-4de9-bab1-489d003090f4/volumes" Oct 31 01:08:07.934315 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:07.934284 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:08.936270 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:08.936234 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-jl2rk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Oct 31 01:08:08.936706 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:08.936303 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" podUID="4ea534a5-bd49-4cbd-b0ec-5b60c645546b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Oct 31 01:08:09.934909 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:09.934873 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-jl2rk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Oct 31 01:08:09.935076 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:09.934935 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" podUID="4ea534a5-bd49-4cbd-b0ec-5b60c645546b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Oct 31 01:08:10.934600 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:10.934569 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-jl2rk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Oct 31 01:08:10.935157 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:10.934643 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" podUID="4ea534a5-bd49-4cbd-b0ec-5b60c645546b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Oct 31 01:08:11.934381 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:11.934339 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-jl2rk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Oct 31 01:08:11.934605 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:11.934414 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" podUID="4ea534a5-bd49-4cbd-b0ec-5b60c645546b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Oct 31 01:08:12.934963 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:12.934929 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-jl2rk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Oct 31 01:08:12.935461 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:12.934989 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" podUID="4ea534a5-bd49-4cbd-b0ec-5b60c645546b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Oct 31 01:08:13.934895 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:13.934853 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-jl2rk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Oct 31 01:08:13.935108 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:13.934919 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" podUID="4ea534a5-bd49-4cbd-b0ec-5b60c645546b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Oct 31 01:08:14.934803 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:14.934764 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-jl2rk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Oct 31 01:08:14.934974 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:14.934849 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" podUID="4ea534a5-bd49-4cbd-b0ec-5b60c645546b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Oct 31 01:08:16.976971 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:16.976929 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-jl2rk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:08:16.977618 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:16.977577 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" podUID="4ea534a5-bd49-4cbd-b0ec-5b60c645546b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:08:17.205548 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:08:17.205499 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:08:17.857830 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:17.857794 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:17.858147 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:17.858086 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:17.859115 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:08:17.859091 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" Oct 31 01:08:47.198799 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:08:47.198710 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:09:14.002055 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:14.002011 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd"] Oct 31 01:09:14.005605 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:14.005581 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" Oct 31 01:09:14.010258 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:14.010221 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-487a6c-serving-cert\"" Oct 31 01:09:14.017404 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:14.017378 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd"] Oct 31 01:09:14.036680 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:14.036639 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25d5f84e-a306-477b-9de3-3c049e941ad4-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd\" (UID: \"25d5f84e-a306-477b-9de3-3c049e941ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" Oct 31 01:09:14.036846 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:14.036800 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25d5f84e-a306-477b-9de3-3c049e941ad4-metrics-certs\") pod \"maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd\" (UID: \"25d5f84e-a306-477b-9de3-3c049e941ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" Oct 31 01:09:14.036912 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:14.036857 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pb85\" (UniqueName: \"kubernetes.io/projected/25d5f84e-a306-477b-9de3-3c049e941ad4-kube-api-access-5pb85\") pod \"maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd\" (UID: \"25d5f84e-a306-477b-9de3-3c049e941ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" Oct 31 01:09:14.037058 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:14.037035 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25d5f84e-a306-477b-9de3-3c049e941ad4-maas-api-tls\") pod \"maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd\" (UID: \"25d5f84e-a306-477b-9de3-3c049e941ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" Oct 31 01:09:14.137919 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:14.137885 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pb85\" (UniqueName: \"kubernetes.io/projected/25d5f84e-a306-477b-9de3-3c049e941ad4-kube-api-access-5pb85\") pod \"maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd\" (UID: \"25d5f84e-a306-477b-9de3-3c049e941ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" Oct 31 01:09:14.138115 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:14.137936 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25d5f84e-a306-477b-9de3-3c049e941ad4-maas-api-tls\") pod \"maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd\" (UID: \"25d5f84e-a306-477b-9de3-3c049e941ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" Oct 31 01:09:14.138223 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:14.138200 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25d5f84e-a306-477b-9de3-3c049e941ad4-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd\" (UID: \"25d5f84e-a306-477b-9de3-3c049e941ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" Oct 31 01:09:14.138364 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:14.138347 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25d5f84e-a306-477b-9de3-3c049e941ad4-metrics-certs\") pod \"maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd\" (UID: \"25d5f84e-a306-477b-9de3-3c049e941ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" Oct 31 01:09:14.138931 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:14.138909 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25d5f84e-a306-477b-9de3-3c049e941ad4-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd\" (UID: \"25d5f84e-a306-477b-9de3-3c049e941ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" Oct 31 01:09:14.140574 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:14.140527 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25d5f84e-a306-477b-9de3-3c049e941ad4-maas-api-tls\") pod \"maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd\" (UID: \"25d5f84e-a306-477b-9de3-3c049e941ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" Oct 31 01:09:14.140709 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:14.140688 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25d5f84e-a306-477b-9de3-3c049e941ad4-metrics-certs\") pod \"maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd\" (UID: \"25d5f84e-a306-477b-9de3-3c049e941ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" Oct 31 01:09:14.149967 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:14.149943 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pb85\" (UniqueName: \"kubernetes.io/projected/25d5f84e-a306-477b-9de3-3c049e941ad4-kube-api-access-5pb85\") pod \"maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd\" (UID: \"25d5f84e-a306-477b-9de3-3c049e941ad4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" Oct 31 01:09:14.324684 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:14.324593 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" Oct 31 01:09:14.606113 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:14.606034 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd"] Oct 31 01:09:14.609201 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:09:14.609169 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d5f84e_a306_477b_9de3_3c049e941ad4.slice/crio-68574b8dad670a2ffeb2892a1cd4df187ecb08c9ec18874f1d8c2a20f88200cf WatchSource:0}: Error finding container 68574b8dad670a2ffeb2892a1cd4df187ecb08c9ec18874f1d8c2a20f88200cf: Status 404 returned error can't find the container with id 68574b8dad670a2ffeb2892a1cd4df187ecb08c9ec18874f1d8c2a20f88200cf Oct 31 01:09:14.610598 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:14.610581 5821 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 31 01:09:14.868782 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:14.868744 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" event={"ID":"25d5f84e-a306-477b-9de3-3c049e941ad4","Type":"ContainerStarted","Data":"68574b8dad670a2ffeb2892a1cd4df187ecb08c9ec18874f1d8c2a20f88200cf"} Oct 31 01:09:15.874662 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:15.874628 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" event={"ID":"25d5f84e-a306-477b-9de3-3c049e941ad4","Type":"ContainerStarted","Data":"069450ff1153860eb84ff5e313a3b17b693f5fbe20bc1bb2f24a06abe36e04e8"} Oct 31 01:09:15.875117 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:15.874759 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" Oct 31 01:09:15.894354 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:15.894301 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" podStartSLOduration=2.369246167 podStartE2EDuration="2.89428639s" totalImagesPullingTime="525.040223ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:09:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:09:15.893710707 +0000 UTC m=+772.473124615" watchObservedRunningTime="2026-10-31 01:09:15.89428639 +0000 UTC m=+772.473700354" Oct 31 01:09:15.898773 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:15.898741 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm"] Oct 31 01:09:15.903325 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:15.903301 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" Oct 31 01:09:15.910078 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:15.910049 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-0a6cca-serving-cert\"" Oct 31 01:09:15.915888 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:15.915855 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm"] Oct 31 01:09:15.972634 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:15.972594 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l6xl\" (UniqueName: \"kubernetes.io/projected/ca001694-4577-4273-84de-8ae4bd47c12e-kube-api-access-5l6xl\") pod \"maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm\" (UID: \"ca001694-4577-4273-84de-8ae4bd47c12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" Oct 31 01:09:15.972822 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:15.972765 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca001694-4577-4273-84de-8ae4bd47c12e-maas-api-tls\") pod \"maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm\" (UID: \"ca001694-4577-4273-84de-8ae4bd47c12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" Oct 31 01:09:15.972822 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:15.972807 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca001694-4577-4273-84de-8ae4bd47c12e-metrics-certs\") pod \"maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm\" (UID: \"ca001694-4577-4273-84de-8ae4bd47c12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" Oct 31 01:09:15.972967 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:15.972842 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca001694-4577-4273-84de-8ae4bd47c12e-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm\" (UID: \"ca001694-4577-4273-84de-8ae4bd47c12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" Oct 31 01:09:16.074439 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:16.074406 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca001694-4577-4273-84de-8ae4bd47c12e-maas-api-tls\") pod \"maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm\" (UID: \"ca001694-4577-4273-84de-8ae4bd47c12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" Oct 31 01:09:16.074439 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:16.074443 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca001694-4577-4273-84de-8ae4bd47c12e-metrics-certs\") pod \"maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm\" (UID: \"ca001694-4577-4273-84de-8ae4bd47c12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" Oct 31 01:09:16.074669 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:16.074463 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca001694-4577-4273-84de-8ae4bd47c12e-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm\" (UID: \"ca001694-4577-4273-84de-8ae4bd47c12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" Oct 31 01:09:16.074669 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:16.074540 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l6xl\" (UniqueName: \"kubernetes.io/projected/ca001694-4577-4273-84de-8ae4bd47c12e-kube-api-access-5l6xl\") pod \"maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm\" (UID: \"ca001694-4577-4273-84de-8ae4bd47c12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" Oct 31 01:09:16.074669 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:09:16.074581 5821 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-serving-cert: secret "maas-api-e2e-worker-w2-0a6cca-serving-cert" not found Oct 31 01:09:16.074669 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:09:16.074653 5821 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca001694-4577-4273-84de-8ae4bd47c12e-maas-api-tls podName:ca001694-4577-4273-84de-8ae4bd47c12e nodeName:}" failed. No retries permitted until 2026-10-31 01:09:16.574632063 +0000 UTC m=+773.154045964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ca001694-4577-4273-84de-8ae4bd47c12e-maas-api-tls") pod "maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" (UID: "ca001694-4577-4273-84de-8ae4bd47c12e") : secret "maas-api-e2e-worker-w2-0a6cca-serving-cert" not found Oct 31 01:09:16.075192 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:16.075167 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca001694-4577-4273-84de-8ae4bd47c12e-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm\" (UID: \"ca001694-4577-4273-84de-8ae4bd47c12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" Oct 31 01:09:16.076922 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:16.076895 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca001694-4577-4273-84de-8ae4bd47c12e-metrics-certs\") pod \"maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm\" (UID: \"ca001694-4577-4273-84de-8ae4bd47c12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" Oct 31 01:09:16.083675 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:16.083649 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l6xl\" (UniqueName: \"kubernetes.io/projected/ca001694-4577-4273-84de-8ae4bd47c12e-kube-api-access-5l6xl\") pod \"maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm\" (UID: \"ca001694-4577-4273-84de-8ae4bd47c12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" Oct 31 01:09:16.579770 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:16.579717 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca001694-4577-4273-84de-8ae4bd47c12e-maas-api-tls\") pod \"maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm\" (UID: \"ca001694-4577-4273-84de-8ae4bd47c12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" Oct 31 01:09:16.598526 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:16.598487 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca001694-4577-4273-84de-8ae4bd47c12e-maas-api-tls\") pod \"maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm\" (UID: \"ca001694-4577-4273-84de-8ae4bd47c12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" Oct 31 01:09:16.819544 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:16.819503 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" Oct 31 01:09:17.115802 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:17.115714 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm"] Oct 31 01:09:17.118708 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:09:17.118678 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca001694_4577_4273_84de_8ae4bd47c12e.slice/crio-e6bdfab08f2ff38e6e34eabb2fb36a26f42076cdb985d6cd1c8c7d372b2186f7 WatchSource:0}: Error finding container e6bdfab08f2ff38e6e34eabb2fb36a26f42076cdb985d6cd1c8c7d372b2186f7: Status 404 returned error can't find the container with id e6bdfab08f2ff38e6e34eabb2fb36a26f42076cdb985d6cd1c8c7d372b2186f7 Oct 31 01:09:17.199530 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:09:17.199491 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:09:17.888905 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:17.888693 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" event={"ID":"ca001694-4577-4273-84de-8ae4bd47c12e","Type":"ContainerStarted","Data":"a516d1cc579d8f6886847b9905ba0164774c8c6896abf98d8d601986d0a4cb3e"} Oct 31 01:09:17.888905 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:17.888797 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" event={"ID":"ca001694-4577-4273-84de-8ae4bd47c12e","Type":"ContainerStarted","Data":"e6bdfab08f2ff38e6e34eabb2fb36a26f42076cdb985d6cd1c8c7d372b2186f7"} Oct 31 01:09:17.889150 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:17.888939 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" Oct 31 01:09:17.910877 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:17.910826 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" podStartSLOduration=2.417396767 podStartE2EDuration="2.910813143s" totalImagesPullingTime="493.416376ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:09:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:09:17.909939057 +0000 UTC m=+774.489352964" watchObservedRunningTime="2026-10-31 01:09:17.910813143 +0000 UTC m=+774.490227051" Oct 31 01:09:18.217469 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:18.217383 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q"] Oct 31 01:09:18.221752 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:18.221733 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" Oct 31 01:09:18.233388 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:18.233360 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q"] Oct 31 01:09:18.234516 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:18.234482 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-28ff08-serving-cert\"" Oct 31 01:09:18.297968 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:18.297933 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6149144-2988-41aa-99d2-01a7205486c0-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q\" (UID: \"d6149144-2988-41aa-99d2-01a7205486c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" Oct 31 01:09:18.298123 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:18.297983 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6149144-2988-41aa-99d2-01a7205486c0-metrics-certs\") pod \"maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q\" (UID: \"d6149144-2988-41aa-99d2-01a7205486c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" Oct 31 01:09:18.298183 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:18.298140 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6149144-2988-41aa-99d2-01a7205486c0-maas-api-tls\") pod \"maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q\" (UID: \"d6149144-2988-41aa-99d2-01a7205486c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" Oct 31 01:09:18.298183 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:18.298171 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbt2j\" (UniqueName: \"kubernetes.io/projected/d6149144-2988-41aa-99d2-01a7205486c0-kube-api-access-dbt2j\") pod \"maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q\" (UID: \"d6149144-2988-41aa-99d2-01a7205486c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" Oct 31 01:09:18.398960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:18.398922 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6149144-2988-41aa-99d2-01a7205486c0-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q\" (UID: \"d6149144-2988-41aa-99d2-01a7205486c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" Oct 31 01:09:18.399162 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:18.398970 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6149144-2988-41aa-99d2-01a7205486c0-metrics-certs\") pod \"maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q\" (UID: \"d6149144-2988-41aa-99d2-01a7205486c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" Oct 31 01:09:18.399162 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:18.399045 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6149144-2988-41aa-99d2-01a7205486c0-maas-api-tls\") pod \"maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q\" (UID: \"d6149144-2988-41aa-99d2-01a7205486c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" Oct 31 01:09:18.399162 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:18.399107 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbt2j\" (UniqueName: \"kubernetes.io/projected/d6149144-2988-41aa-99d2-01a7205486c0-kube-api-access-dbt2j\") pod \"maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q\" (UID: \"d6149144-2988-41aa-99d2-01a7205486c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" Oct 31 01:09:18.399162 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:09:18.399136 5821 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-serving-cert: secret "maas-api-e2e-worker-w5-28ff08-serving-cert" not found Oct 31 01:09:18.399407 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:09:18.399188 5821 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6149144-2988-41aa-99d2-01a7205486c0-maas-api-tls podName:d6149144-2988-41aa-99d2-01a7205486c0 nodeName:}" failed. No retries permitted until 2026-10-31 01:09:18.899171482 +0000 UTC m=+775.478585399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d6149144-2988-41aa-99d2-01a7205486c0-maas-api-tls") pod "maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" (UID: "d6149144-2988-41aa-99d2-01a7205486c0") : secret "maas-api-e2e-worker-w5-28ff08-serving-cert" not found Oct 31 01:09:18.399724 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:18.399699 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6149144-2988-41aa-99d2-01a7205486c0-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q\" (UID: \"d6149144-2988-41aa-99d2-01a7205486c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" Oct 31 01:09:18.401541 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:18.401522 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6149144-2988-41aa-99d2-01a7205486c0-metrics-certs\") pod \"maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q\" (UID: \"d6149144-2988-41aa-99d2-01a7205486c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" Oct 31 01:09:18.410722 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:18.410696 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbt2j\" (UniqueName: \"kubernetes.io/projected/d6149144-2988-41aa-99d2-01a7205486c0-kube-api-access-dbt2j\") pod \"maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q\" (UID: \"d6149144-2988-41aa-99d2-01a7205486c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" Oct 31 01:09:18.904011 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:18.903935 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6149144-2988-41aa-99d2-01a7205486c0-maas-api-tls\") pod \"maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q\" (UID: \"d6149144-2988-41aa-99d2-01a7205486c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" Oct 31 01:09:18.914232 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:18.914112 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6149144-2988-41aa-99d2-01a7205486c0-maas-api-tls\") pod \"maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q\" (UID: \"d6149144-2988-41aa-99d2-01a7205486c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" Oct 31 01:09:19.141624 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:19.141507 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" Oct 31 01:09:19.424726 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:19.424698 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q"] Oct 31 01:09:19.427512 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:09:19.427477 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6149144_2988_41aa_99d2_01a7205486c0.slice/crio-5713a7b62935d4a66ebdd5fdda6c0c055fca5e6991b08ef19504a5df6343ac25 WatchSource:0}: Error finding container 5713a7b62935d4a66ebdd5fdda6c0c055fca5e6991b08ef19504a5df6343ac25: Status 404 returned error can't find the container with id 5713a7b62935d4a66ebdd5fdda6c0c055fca5e6991b08ef19504a5df6343ac25 Oct 31 01:09:19.899511 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:19.899487 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" event={"ID":"d6149144-2988-41aa-99d2-01a7205486c0","Type":"ContainerStarted","Data":"5713a7b62935d4a66ebdd5fdda6c0c055fca5e6991b08ef19504a5df6343ac25"} Oct 31 01:09:20.906340 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:20.906306 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" event={"ID":"d6149144-2988-41aa-99d2-01a7205486c0","Type":"ContainerStarted","Data":"7d69a86a4313be68e2165caa996b7a11836dbb1b03949c23b2d5fb3428f9848d"} Oct 31 01:09:20.906809 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:20.906376 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" Oct 31 01:09:20.931335 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:20.931263 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" podStartSLOduration=2.464715816 podStartE2EDuration="2.93124387s" totalImagesPullingTime="466.528054ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:09:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:09:20.93053005 +0000 UTC m=+777.509943959" watchObservedRunningTime="2026-10-31 01:09:20.93124387 +0000 UTC m=+777.510657779" Oct 31 01:09:21.887387 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:21.887357 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" Oct 31 01:09:23.898575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:23.898530 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" Oct 31 01:09:26.507995 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.507938 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz"] Oct 31 01:09:26.512794 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.512769 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:26.522434 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.522408 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-1b8d05\"/\"kube-root-ca.crt\"" Oct 31 01:09:26.522598 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.522518 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-1b8d05\"/\"openshift-service-ca.crt\"" Oct 31 01:09:26.524134 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.524112 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz"] Oct 31 01:09:26.534646 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.534617 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-1b8d05\"/\"default-dockercfg-r9qh5\"" Oct 31 01:09:26.534768 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.534719 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-1b8d05\"/\"simulator-w6-1b8d05-kserve-self-signed-certs\"" Oct 31 01:09:26.599959 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.599924 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-tmp-dir\") pod \"simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:26.599959 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.599961 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-tls-certs\") pod \"simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:26.600223 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.599987 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-home\") pod \"simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:26.600223 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.600069 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-model-cache\") pod \"simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:26.600223 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.600195 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n452q\" (UniqueName: \"kubernetes.io/projected/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-kube-api-access-n452q\") pod \"simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:26.600397 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.600249 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-dshm\") pod \"simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:26.700967 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.700929 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-tmp-dir\") pod \"simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:26.700967 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.700966 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-tls-certs\") pod \"simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:26.701204 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.700996 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-home\") pod \"simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:26.701204 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.701028 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-model-cache\") pod \"simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:26.701204 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.701092 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n452q\" (UniqueName: \"kubernetes.io/projected/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-kube-api-access-n452q\") pod \"simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:26.701204 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.701140 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-dshm\") pod \"simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:26.701471 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.701444 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-home\") pod \"simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:26.701890 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.701694 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-model-cache\") pod \"simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:26.701890 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.701741 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-tmp-dir\") pod \"simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:26.703737 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.703713 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-dshm\") pod \"simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:26.703892 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.703873 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-tls-certs\") pod \"simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:26.709377 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.709349 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n452q\" (UniqueName: \"kubernetes.io/projected/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-kube-api-access-n452q\") pod \"simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:26.835791 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.835349 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:26.929592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:26.928121 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" Oct 31 01:09:27.142731 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:27.142519 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz"] Oct 31 01:09:27.145926 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:09:27.145897 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dd9865a_0dd7_46da_997d_3ed1ea8f99bf.slice/crio-ba3f70df8f624fd275f3ce24bdb250a57c2464d96a1be60f271660f60da07493 WatchSource:0}: Error finding container ba3f70df8f624fd275f3ce24bdb250a57c2464d96a1be60f271660f60da07493: Status 404 returned error can't find the container with id ba3f70df8f624fd275f3ce24bdb250a57c2464d96a1be60f271660f60da07493 Oct 31 01:09:27.955751 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:27.955693 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" event={"ID":"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf","Type":"ContainerStarted","Data":"ba3f70df8f624fd275f3ce24bdb250a57c2464d96a1be60f271660f60da07493"} Oct 31 01:09:28.962123 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:28.962084 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" event={"ID":"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf","Type":"ContainerStarted","Data":"8b3a9c727bb5172015f817487e48780ca2eb68287f3f621bea472fa31a698565"} Oct 31 01:09:29.836466 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:29.836422 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:36.662849 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.662723 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podStartSLOduration=9.293934581 podStartE2EDuration="10.662701727s" totalImagesPullingTime="1.368767146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:09:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:09:28.981381875 +0000 UTC m=+785.560795785" watchObservedRunningTime="2026-10-31 01:09:36.662701727 +0000 UTC m=+793.242115635" Oct 31 01:09:36.663748 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.662947 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj"] Oct 31 01:09:36.667028 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.667003 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:36.675542 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.675514 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj"] Oct 31 01:09:36.678022 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.677767 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-acdaed\"/\"kube-root-ca.crt\"" Oct 31 01:09:36.678022 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.677948 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-acdaed\"/\"default-dockercfg-dhhtn\"" Oct 31 01:09:36.678022 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.677995 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-acdaed\"/\"openshift-service-ca.crt\"" Oct 31 01:09:36.678333 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.678312 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-acdaed\"/\"simulator-w0-acdaed-kserve-self-signed-certs\"" Oct 31 01:09:36.700379 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.700340 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-home\") pod \"simulator-w0-acdaed-kserve-dbb64c577-lk7zj\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:36.700511 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.700395 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02c8c54d-f688-4166-a0fb-9144876ceba8-tls-certs\") pod \"simulator-w0-acdaed-kserve-dbb64c577-lk7zj\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:36.700599 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.700536 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-tmp-dir\") pod \"simulator-w0-acdaed-kserve-dbb64c577-lk7zj\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:36.700599 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.700581 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jvbq\" (UniqueName: \"kubernetes.io/projected/02c8c54d-f688-4166-a0fb-9144876ceba8-kube-api-access-8jvbq\") pod \"simulator-w0-acdaed-kserve-dbb64c577-lk7zj\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:36.700701 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.700683 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-model-cache\") pod \"simulator-w0-acdaed-kserve-dbb64c577-lk7zj\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:36.700741 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.700705 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-dshm\") pod \"simulator-w0-acdaed-kserve-dbb64c577-lk7zj\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:36.801243 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.801202 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-home\") pod \"simulator-w0-acdaed-kserve-dbb64c577-lk7zj\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:36.801449 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.801263 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02c8c54d-f688-4166-a0fb-9144876ceba8-tls-certs\") pod \"simulator-w0-acdaed-kserve-dbb64c577-lk7zj\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:36.801449 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.801357 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-tmp-dir\") pod \"simulator-w0-acdaed-kserve-dbb64c577-lk7zj\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:36.801449 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.801387 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jvbq\" (UniqueName: \"kubernetes.io/projected/02c8c54d-f688-4166-a0fb-9144876ceba8-kube-api-access-8jvbq\") pod \"simulator-w0-acdaed-kserve-dbb64c577-lk7zj\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:36.801449 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.801436 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-model-cache\") pod \"simulator-w0-acdaed-kserve-dbb64c577-lk7zj\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:36.801713 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.801463 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-dshm\") pod \"simulator-w0-acdaed-kserve-dbb64c577-lk7zj\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:36.801769 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.801744 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-home\") pod \"simulator-w0-acdaed-kserve-dbb64c577-lk7zj\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:36.802090 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.802055 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-model-cache\") pod \"simulator-w0-acdaed-kserve-dbb64c577-lk7zj\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:36.802226 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.802166 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-tmp-dir\") pod \"simulator-w0-acdaed-kserve-dbb64c577-lk7zj\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:36.803819 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.803789 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-dshm\") pod \"simulator-w0-acdaed-kserve-dbb64c577-lk7zj\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:36.804038 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.803977 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02c8c54d-f688-4166-a0fb-9144876ceba8-tls-certs\") pod \"simulator-w0-acdaed-kserve-dbb64c577-lk7zj\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:36.834601 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.824269 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jvbq\" (UniqueName: \"kubernetes.io/projected/02c8c54d-f688-4166-a0fb-9144876ceba8-kube-api-access-8jvbq\") pod \"simulator-w0-acdaed-kserve-dbb64c577-lk7zj\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:36.837821 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.837789 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:36.856768 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.855999 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:36.981262 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:36.981179 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:37.021819 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:37.021780 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:09:37.298633 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:37.298509 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj"] Oct 31 01:09:37.302413 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:09:37.302378 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02c8c54d_f688_4166_a0fb_9144876ceba8.slice/crio-582bd08f47773a4622893213a941c6c77e014e7a75781f706145b4027749a450 WatchSource:0}: Error finding container 582bd08f47773a4622893213a941c6c77e014e7a75781f706145b4027749a450: Status 404 returned error can't find the container with id 582bd08f47773a4622893213a941c6c77e014e7a75781f706145b4027749a450 Oct 31 01:09:38.012846 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:38.012801 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" event={"ID":"02c8c54d-f688-4166-a0fb-9144876ceba8","Type":"ContainerStarted","Data":"7a75fd0b689e27aec66b2a92390c07510d452e1d550622d8a6ba8d9561dc3d6c"} Oct 31 01:09:38.013350 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:38.012854 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" event={"ID":"02c8c54d-f688-4166-a0fb-9144876ceba8","Type":"ContainerStarted","Data":"582bd08f47773a4622893213a941c6c77e014e7a75781f706145b4027749a450"} Oct 31 01:09:38.031376 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:38.031325 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podStartSLOduration=2.031311977 podStartE2EDuration="2.031311977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:09:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:09:38.029877864 +0000 UTC m=+794.609291777" watchObservedRunningTime="2026-10-31 01:09:38.031311977 +0000 UTC m=+794.610725920" Oct 31 01:09:38.982131 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:38.982094 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:46.027868 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.027829 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx"] Oct 31 01:09:46.031739 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.031712 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:46.045670 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.045564 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-28ff08\"/\"openshift-service-ca.crt\"" Oct 31 01:09:46.045670 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.045658 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-28ff08\"/\"kube-root-ca.crt\"" Oct 31 01:09:46.048808 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.047144 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-28ff08\"/\"simulator-w5-28ff08-kserve-self-signed-certs\"" Oct 31 01:09:46.048808 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.047156 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-28ff08\"/\"default-dockercfg-6kts9\"" Oct 31 01:09:46.049904 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.049876 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx"] Oct 31 01:09:46.097135 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.097099 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-tls-certs\") pod \"simulator-w5-28ff08-kserve-7dffbf5554-n7mqx\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:46.097135 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.097136 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwxsg\" (UniqueName: \"kubernetes.io/projected/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-kube-api-access-vwxsg\") pod \"simulator-w5-28ff08-kserve-7dffbf5554-n7mqx\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:46.097357 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.097164 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-tmp-dir\") pod \"simulator-w5-28ff08-kserve-7dffbf5554-n7mqx\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:46.097357 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.097291 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-dshm\") pod \"simulator-w5-28ff08-kserve-7dffbf5554-n7mqx\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:46.097357 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.097320 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-model-cache\") pod \"simulator-w5-28ff08-kserve-7dffbf5554-n7mqx\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:46.097478 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.097402 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-home\") pod \"simulator-w5-28ff08-kserve-7dffbf5554-n7mqx\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:46.198166 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.198127 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-tls-certs\") pod \"simulator-w5-28ff08-kserve-7dffbf5554-n7mqx\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:46.198166 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.198173 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwxsg\" (UniqueName: \"kubernetes.io/projected/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-kube-api-access-vwxsg\") pod \"simulator-w5-28ff08-kserve-7dffbf5554-n7mqx\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:46.198430 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.198215 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-tmp-dir\") pod \"simulator-w5-28ff08-kserve-7dffbf5554-n7mqx\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:46.198430 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.198282 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-dshm\") pod \"simulator-w5-28ff08-kserve-7dffbf5554-n7mqx\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:46.198430 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.198324 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-model-cache\") pod \"simulator-w5-28ff08-kserve-7dffbf5554-n7mqx\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:46.198430 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.198349 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-home\") pod \"simulator-w5-28ff08-kserve-7dffbf5554-n7mqx\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:46.198760 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.198739 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-home\") pod \"simulator-w5-28ff08-kserve-7dffbf5554-n7mqx\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:46.199172 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.198995 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-tmp-dir\") pod \"simulator-w5-28ff08-kserve-7dffbf5554-n7mqx\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:46.199172 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.199110 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-model-cache\") pod \"simulator-w5-28ff08-kserve-7dffbf5554-n7mqx\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:46.201216 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.201183 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-dshm\") pod \"simulator-w5-28ff08-kserve-7dffbf5554-n7mqx\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:46.201216 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.201206 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-tls-certs\") pod \"simulator-w5-28ff08-kserve-7dffbf5554-n7mqx\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:46.206502 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.206474 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwxsg\" (UniqueName: \"kubernetes.io/projected/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-kube-api-access-vwxsg\") pod \"simulator-w5-28ff08-kserve-7dffbf5554-n7mqx\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:46.352455 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.352368 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:46.627986 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.627959 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx"] Oct 31 01:09:46.630500 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:09:46.630464 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f7caf26_a0d2_4b14_8d6e_a03e759df90a.slice/crio-07f877ac664e97e6703c21807d05fec2a4e6728b2e866a27a29c412c5ffb0441 WatchSource:0}: Error finding container 07f877ac664e97e6703c21807d05fec2a4e6728b2e866a27a29c412c5ffb0441: Status 404 returned error can't find the container with id 07f877ac664e97e6703c21807d05fec2a4e6728b2e866a27a29c412c5ffb0441 Oct 31 01:09:46.981760 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.981672 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:46.994565 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:46.994525 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:47.065964 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:47.065918 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" event={"ID":"0f7caf26-a0d2-4b14-8d6e-a03e759df90a","Type":"ContainerStarted","Data":"b8bfbed3ed2a1d10834dda2f5922332c02c7f106be83a4fd8646074c7edd347a"} Oct 31 01:09:47.066389 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:47.065973 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" event={"ID":"0f7caf26-a0d2-4b14-8d6e-a03e759df90a","Type":"ContainerStarted","Data":"07f877ac664e97e6703c21807d05fec2a4e6728b2e866a27a29c412c5ffb0441"} Oct 31 01:09:47.078020 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:47.077988 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:09:47.087325 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:47.087276 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podStartSLOduration=1.087259402 podStartE2EDuration="1.087259402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:09:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:09:47.086585043 +0000 UTC m=+803.665998949" watchObservedRunningTime="2026-10-31 01:09:47.087259402 +0000 UTC m=+803.666673310" Oct 31 01:09:47.200502 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:09:47.200464 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:09:47.360652 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:47.357658 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:56.352508 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:56.352469 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:56.365205 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:56.365180 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:09:57.129877 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:09:57.129846 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:10:01.519568 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.519517 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8"] Oct 31 01:10:01.525510 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.525482 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:01.534993 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.534962 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-487a6c\"/\"kube-root-ca.crt\"" Oct 31 01:10:01.540849 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.540822 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-487a6c\"/\"openshift-service-ca.crt\"" Oct 31 01:10:01.541059 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.540821 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-487a6c\"/\"premium-w3-487a6c-kserve-self-signed-certs\"" Oct 31 01:10:01.541059 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.540892 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-487a6c\"/\"default-dockercfg-9hlbr\"" Oct 31 01:10:01.543692 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.543397 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8"] Oct 31 01:10:01.560427 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.560391 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-home\") pod \"premium-w3-487a6c-kserve-5fd57db894-df7n8\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:01.560722 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.560460 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-model-cache\") pod \"premium-w3-487a6c-kserve-5fd57db894-df7n8\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:01.560722 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.560497 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-tmp-dir\") pod \"premium-w3-487a6c-kserve-5fd57db894-df7n8\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:01.560722 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.560627 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/985b0b16-7abe-4c8b-b3c1-44616902cef7-tls-certs\") pod \"premium-w3-487a6c-kserve-5fd57db894-df7n8\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:01.560722 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.560668 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-dshm\") pod \"premium-w3-487a6c-kserve-5fd57db894-df7n8\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:01.560722 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.560702 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz6gz\" (UniqueName: \"kubernetes.io/projected/985b0b16-7abe-4c8b-b3c1-44616902cef7-kube-api-access-fz6gz\") pod \"premium-w3-487a6c-kserve-5fd57db894-df7n8\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:01.662893 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.662043 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-dshm\") pod \"premium-w3-487a6c-kserve-5fd57db894-df7n8\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:01.662893 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.662108 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz6gz\" (UniqueName: \"kubernetes.io/projected/985b0b16-7abe-4c8b-b3c1-44616902cef7-kube-api-access-fz6gz\") pod \"premium-w3-487a6c-kserve-5fd57db894-df7n8\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:01.662893 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.662177 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-home\") pod \"premium-w3-487a6c-kserve-5fd57db894-df7n8\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:01.662893 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.662227 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-model-cache\") pod \"premium-w3-487a6c-kserve-5fd57db894-df7n8\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:01.662893 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.662263 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-tmp-dir\") pod \"premium-w3-487a6c-kserve-5fd57db894-df7n8\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:01.662893 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.662392 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/985b0b16-7abe-4c8b-b3c1-44616902cef7-tls-certs\") pod \"premium-w3-487a6c-kserve-5fd57db894-df7n8\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:01.663417 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.662952 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-model-cache\") pod \"premium-w3-487a6c-kserve-5fd57db894-df7n8\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:01.663981 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.663492 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-home\") pod \"premium-w3-487a6c-kserve-5fd57db894-df7n8\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:01.664406 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.664365 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-tmp-dir\") pod \"premium-w3-487a6c-kserve-5fd57db894-df7n8\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:01.666463 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.666436 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/985b0b16-7abe-4c8b-b3c1-44616902cef7-tls-certs\") pod \"premium-w3-487a6c-kserve-5fd57db894-df7n8\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:01.670655 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.670627 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-dshm\") pod \"premium-w3-487a6c-kserve-5fd57db894-df7n8\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:01.686969 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.686902 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz6gz\" (UniqueName: \"kubernetes.io/projected/985b0b16-7abe-4c8b-b3c1-44616902cef7-kube-api-access-fz6gz\") pod \"premium-w3-487a6c-kserve-5fd57db894-df7n8\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:01.868894 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:01.868855 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:02.175920 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:02.175837 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8"] Oct 31 01:10:02.180140 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:10:02.180107 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod985b0b16_7abe_4c8b_b3c1_44616902cef7.slice/crio-b3c251a23b2a0e876a0ace92b750e2c958eef8b6c221a7a7bdf2c1a05760989e WatchSource:0}: Error finding container b3c251a23b2a0e876a0ace92b750e2c958eef8b6c221a7a7bdf2c1a05760989e: Status 404 returned error can't find the container with id b3c251a23b2a0e876a0ace92b750e2c958eef8b6c221a7a7bdf2c1a05760989e Oct 31 01:10:03.154978 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:03.154939 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" event={"ID":"985b0b16-7abe-4c8b-b3c1-44616902cef7","Type":"ContainerStarted","Data":"81c0a674bc3f450478620be89f0a7ff02c657939651e0471b8070f41aa7fde22"} Oct 31 01:10:03.154978 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:03.154983 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" event={"ID":"985b0b16-7abe-4c8b-b3c1-44616902cef7","Type":"ContainerStarted","Data":"b3c251a23b2a0e876a0ace92b750e2c958eef8b6c221a7a7bdf2c1a05760989e"} Oct 31 01:10:03.869019 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:03.868994 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:11.405411 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.405340 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podStartSLOduration=10.405319269 podStartE2EDuration="10.405319269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:10:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:10:03.197694508 +0000 UTC m=+819.777108399" watchObservedRunningTime="2026-10-31 01:10:11.405319269 +0000 UTC m=+827.984733179" Oct 31 01:10:11.407008 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.406979 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f"] Oct 31 01:10:11.411610 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.411586 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:11.416498 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.416472 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-0a6cca\"/\"default-dockercfg-2ncjr\"" Oct 31 01:10:11.420927 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.420899 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f"] Oct 31 01:10:11.421672 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.421649 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-0a6cca\"/\"openshift-service-ca.crt\"" Oct 31 01:10:11.421799 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.421728 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-0a6cca\"/\"kube-root-ca.crt\"" Oct 31 01:10:11.465931 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.465895 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/115b8c20-dcea-4cbd-aeee-c3f93f159685-tls-certs\") pod \"premium-w2-0a6cca-kserve-6b4667f64d-8np7f\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:11.465931 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.465935 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv8gr\" (UniqueName: \"kubernetes.io/projected/115b8c20-dcea-4cbd-aeee-c3f93f159685-kube-api-access-gv8gr\") pod \"premium-w2-0a6cca-kserve-6b4667f64d-8np7f\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:11.466140 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.465961 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-home\") pod \"premium-w2-0a6cca-kserve-6b4667f64d-8np7f\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:11.466174 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.466141 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-dshm\") pod \"premium-w2-0a6cca-kserve-6b4667f64d-8np7f\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:11.466216 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.466174 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-model-cache\") pod \"premium-w2-0a6cca-kserve-6b4667f64d-8np7f\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:11.466216 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.466191 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-tmp-dir\") pod \"premium-w2-0a6cca-kserve-6b4667f64d-8np7f\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:11.516008 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.515963 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-0a6cca\"/\"premium-w2-0a6cca-kserve-self-signed-certs\"" Oct 31 01:10:11.568213 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.568174 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/115b8c20-dcea-4cbd-aeee-c3f93f159685-tls-certs\") pod \"premium-w2-0a6cca-kserve-6b4667f64d-8np7f\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:11.568419 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.568223 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv8gr\" (UniqueName: \"kubernetes.io/projected/115b8c20-dcea-4cbd-aeee-c3f93f159685-kube-api-access-gv8gr\") pod \"premium-w2-0a6cca-kserve-6b4667f64d-8np7f\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:11.568419 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.568260 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-home\") pod \"premium-w2-0a6cca-kserve-6b4667f64d-8np7f\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:11.568419 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.568352 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-dshm\") pod \"premium-w2-0a6cca-kserve-6b4667f64d-8np7f\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:11.568419 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.568390 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-model-cache\") pod \"premium-w2-0a6cca-kserve-6b4667f64d-8np7f\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:11.568419 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.568416 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-tmp-dir\") pod \"premium-w2-0a6cca-kserve-6b4667f64d-8np7f\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:11.568958 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.568896 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-tmp-dir\") pod \"premium-w2-0a6cca-kserve-6b4667f64d-8np7f\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:11.569063 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.568955 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-home\") pod \"premium-w2-0a6cca-kserve-6b4667f64d-8np7f\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:11.569228 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.569206 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-model-cache\") pod \"premium-w2-0a6cca-kserve-6b4667f64d-8np7f\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:11.584957 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.584888 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv8gr\" (UniqueName: \"kubernetes.io/projected/115b8c20-dcea-4cbd-aeee-c3f93f159685-kube-api-access-gv8gr\") pod \"premium-w2-0a6cca-kserve-6b4667f64d-8np7f\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:11.599971 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.599899 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-dshm\") pod \"premium-w2-0a6cca-kserve-6b4667f64d-8np7f\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:11.601504 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.601471 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/115b8c20-dcea-4cbd-aeee-c3f93f159685-tls-certs\") pod \"premium-w2-0a6cca-kserve-6b4667f64d-8np7f\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:11.726127 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.726035 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:11.869161 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.869122 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:11.881722 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:11.881680 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:12.032994 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:12.026750 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f"] Oct 31 01:10:12.032994 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:10:12.030675 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod115b8c20_dcea_4cbd_aeee_c3f93f159685.slice/crio-a97a9d1b3be7082b63c5e7324eec562332b15f86a263059cab15e3ec95603677 WatchSource:0}: Error finding container a97a9d1b3be7082b63c5e7324eec562332b15f86a263059cab15e3ec95603677: Status 404 returned error can't find the container with id a97a9d1b3be7082b63c5e7324eec562332b15f86a263059cab15e3ec95603677 Oct 31 01:10:12.199444 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:12.199405 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" event={"ID":"115b8c20-dcea-4cbd-aeee-c3f93f159685","Type":"ContainerStarted","Data":"128bf8ab6df8fe8404131d2310450ea82b9355c439aee71c74b84992ed5db3f4"} Oct 31 01:10:12.199660 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:12.199452 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" event={"ID":"115b8c20-dcea-4cbd-aeee-c3f93f159685","Type":"ContainerStarted","Data":"a97a9d1b3be7082b63c5e7324eec562332b15f86a263059cab15e3ec95603677"} Oct 31 01:10:12.210876 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:12.210845 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:10:12.216730 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:12.216679 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podStartSLOduration=1.216662306 podStartE2EDuration="1.216662306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:10:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:10:12.215500704 +0000 UTC m=+828.794914616" watchObservedRunningTime="2026-10-31 01:10:12.216662306 +0000 UTC m=+828.796076217" Oct 31 01:10:12.732137 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:12.727830 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:14.819899 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:14.819863 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz"] Oct 31 01:10:14.823263 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:14.823240 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:14.833308 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:14.833283 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-7f6d1e\"/\"default-dockercfg-mqk8h\"" Oct 31 01:10:14.833506 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:14.833488 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-7f6d1e\"/\"openshift-service-ca.crt\"" Oct 31 01:10:14.833695 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:14.833626 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-7f6d1e\"/\"premium-w1-7f6d1e-kserve-self-signed-certs\"" Oct 31 01:10:14.834073 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:14.833949 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-7f6d1e\"/\"kube-root-ca.crt\"" Oct 31 01:10:14.837505 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:14.837483 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz"] Oct 31 01:10:14.900802 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:14.900762 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-home\") pod \"premium-w1-7f6d1e-kserve-85b8d7c94-48bmz\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:14.901002 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:14.900890 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rtnw\" (UniqueName: \"kubernetes.io/projected/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-kube-api-access-4rtnw\") pod \"premium-w1-7f6d1e-kserve-85b8d7c94-48bmz\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:14.901002 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:14.900947 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-tls-certs\") pod \"premium-w1-7f6d1e-kserve-85b8d7c94-48bmz\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:14.901002 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:14.900981 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-model-cache\") pod \"premium-w1-7f6d1e-kserve-85b8d7c94-48bmz\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:14.901177 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:14.901053 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-tmp-dir\") pod \"premium-w1-7f6d1e-kserve-85b8d7c94-48bmz\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:14.901177 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:14.901138 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-dshm\") pod \"premium-w1-7f6d1e-kserve-85b8d7c94-48bmz\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:15.001960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:15.001919 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rtnw\" (UniqueName: \"kubernetes.io/projected/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-kube-api-access-4rtnw\") pod \"premium-w1-7f6d1e-kserve-85b8d7c94-48bmz\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:15.001960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:15.001976 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-tls-certs\") pod \"premium-w1-7f6d1e-kserve-85b8d7c94-48bmz\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:15.002234 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:15.002086 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-model-cache\") pod \"premium-w1-7f6d1e-kserve-85b8d7c94-48bmz\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:15.002234 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:15.002131 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-tmp-dir\") pod \"premium-w1-7f6d1e-kserve-85b8d7c94-48bmz\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:15.002234 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:15.002174 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-dshm\") pod \"premium-w1-7f6d1e-kserve-85b8d7c94-48bmz\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:15.002234 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:15.002218 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-home\") pod \"premium-w1-7f6d1e-kserve-85b8d7c94-48bmz\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:15.002614 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:15.002585 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-home\") pod \"premium-w1-7f6d1e-kserve-85b8d7c94-48bmz\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:15.002912 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:15.002887 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-model-cache\") pod \"premium-w1-7f6d1e-kserve-85b8d7c94-48bmz\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:15.003253 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:15.003234 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-tmp-dir\") pod \"premium-w1-7f6d1e-kserve-85b8d7c94-48bmz\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:15.005033 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:15.005006 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-dshm\") pod \"premium-w1-7f6d1e-kserve-85b8d7c94-48bmz\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:15.005255 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:15.005234 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-tls-certs\") pod \"premium-w1-7f6d1e-kserve-85b8d7c94-48bmz\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:15.013815 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:15.013779 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rtnw\" (UniqueName: \"kubernetes.io/projected/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-kube-api-access-4rtnw\") pod \"premium-w1-7f6d1e-kserve-85b8d7c94-48bmz\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:15.140780 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:15.140743 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:15.420262 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:15.420237 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz"] Oct 31 01:10:15.421966 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:10:15.421933 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6e4116b_9c40_4bf8_96f8_21f0bbcbbc3c.slice/crio-3df02c6da4369b50b6cc6d5d97887689dec5335e1d842e86fb68d237d7dbed82 WatchSource:0}: Error finding container 3df02c6da4369b50b6cc6d5d97887689dec5335e1d842e86fb68d237d7dbed82: Status 404 returned error can't find the container with id 3df02c6da4369b50b6cc6d5d97887689dec5335e1d842e86fb68d237d7dbed82 Oct 31 01:10:16.222626 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:16.222585 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" event={"ID":"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c","Type":"ContainerStarted","Data":"fb42a4903cfd3494b0a8c840bc08b3928fc0ab8a93e87491824e987ccc9ad6bc"} Oct 31 01:10:16.223083 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:16.222635 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" event={"ID":"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c","Type":"ContainerStarted","Data":"3df02c6da4369b50b6cc6d5d97887689dec5335e1d842e86fb68d237d7dbed82"} Oct 31 01:10:16.241487 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:16.241440 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podStartSLOduration=2.241425364 podStartE2EDuration="2.241425364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:10:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:10:16.239219749 +0000 UTC m=+832.818633659" watchObservedRunningTime="2026-10-31 01:10:16.241425364 +0000 UTC m=+832.820839329" Oct 31 01:10:17.141509 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:17.141476 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:17.201808 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:10:17.201686 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:10:18.273026 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.272991 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4"] Oct 31 01:10:18.277499 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.277475 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:18.286738 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.286000 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-8499c8\"/\"openshift-service-ca.crt\"" Oct 31 01:10:18.287106 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.287082 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-8499c8\"/\"kube-root-ca.crt\"" Oct 31 01:10:18.287469 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.287448 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-8499c8\"/\"default-dockercfg-qcw2m\"" Oct 31 01:10:18.287469 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.287449 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-8499c8\"/\"premium-w4-8499c8-kserve-self-signed-certs\"" Oct 31 01:10:18.292876 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.292852 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4"] Oct 31 01:10:18.345372 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.345335 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-model-cache\") pod \"premium-w4-8499c8-kserve-5dc785dd69-mj2t4\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:18.345702 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.345677 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-tmp-dir\") pod \"premium-w4-8499c8-kserve-5dc785dd69-mj2t4\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:18.345838 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.345815 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hszr\" (UniqueName: \"kubernetes.io/projected/c8595d89-40e5-4246-925f-cfa9b42e2a11-kube-api-access-7hszr\") pod \"premium-w4-8499c8-kserve-5dc785dd69-mj2t4\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:18.345960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.345853 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-home\") pod \"premium-w4-8499c8-kserve-5dc785dd69-mj2t4\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:18.345960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.345882 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-dshm\") pod \"premium-w4-8499c8-kserve-5dc785dd69-mj2t4\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:18.346089 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.346007 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8595d89-40e5-4246-925f-cfa9b42e2a11-tls-certs\") pod \"premium-w4-8499c8-kserve-5dc785dd69-mj2t4\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:18.450457 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.449625 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-model-cache\") pod \"premium-w4-8499c8-kserve-5dc785dd69-mj2t4\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:18.450457 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.449709 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-tmp-dir\") pod \"premium-w4-8499c8-kserve-5dc785dd69-mj2t4\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:18.450457 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.449739 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hszr\" (UniqueName: \"kubernetes.io/projected/c8595d89-40e5-4246-925f-cfa9b42e2a11-kube-api-access-7hszr\") pod \"premium-w4-8499c8-kserve-5dc785dd69-mj2t4\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:18.450457 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.449788 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-home\") pod \"premium-w4-8499c8-kserve-5dc785dd69-mj2t4\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:18.450457 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.449823 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-dshm\") pod \"premium-w4-8499c8-kserve-5dc785dd69-mj2t4\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:18.450457 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.449851 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8595d89-40e5-4246-925f-cfa9b42e2a11-tls-certs\") pod \"premium-w4-8499c8-kserve-5dc785dd69-mj2t4\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:18.450980 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.450951 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-model-cache\") pod \"premium-w4-8499c8-kserve-5dc785dd69-mj2t4\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:18.452616 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.451248 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-tmp-dir\") pod \"premium-w4-8499c8-kserve-5dc785dd69-mj2t4\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:18.452616 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.451475 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-home\") pod \"premium-w4-8499c8-kserve-5dc785dd69-mj2t4\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:18.455521 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.455326 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8595d89-40e5-4246-925f-cfa9b42e2a11-tls-certs\") pod \"premium-w4-8499c8-kserve-5dc785dd69-mj2t4\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:18.459836 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.459803 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-dshm\") pod \"premium-w4-8499c8-kserve-5dc785dd69-mj2t4\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:18.462887 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.461459 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hszr\" (UniqueName: \"kubernetes.io/projected/c8595d89-40e5-4246-925f-cfa9b42e2a11-kube-api-access-7hszr\") pod \"premium-w4-8499c8-kserve-5dc785dd69-mj2t4\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:18.591832 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.591739 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:18.874617 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:18.874589 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4"] Oct 31 01:10:18.877096 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:10:18.877054 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8595d89_40e5_4246_925f_cfa9b42e2a11.slice/crio-b92312bb514bcae8ba7a21d12428e731c8aa2c830afe1330d487db06c9f1245f WatchSource:0}: Error finding container b92312bb514bcae8ba7a21d12428e731c8aa2c830afe1330d487db06c9f1245f: Status 404 returned error can't find the container with id b92312bb514bcae8ba7a21d12428e731c8aa2c830afe1330d487db06c9f1245f Oct 31 01:10:19.249317 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:19.249239 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" event={"ID":"c8595d89-40e5-4246-925f-cfa9b42e2a11","Type":"ContainerStarted","Data":"ffe48edf7e21b6c7efaed1d7f71bf5e39740f599b8e32f9bb0a716c2d3b263b0"} Oct 31 01:10:19.249317 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:19.249278 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" event={"ID":"c8595d89-40e5-4246-925f-cfa9b42e2a11","Type":"ContainerStarted","Data":"b92312bb514bcae8ba7a21d12428e731c8aa2c830afe1330d487db06c9f1245f"} Oct 31 01:10:19.269123 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:19.269043 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podStartSLOduration=1.269022747 podStartE2EDuration="1.269022747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:10:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:10:19.26642658 +0000 UTC m=+835.845840490" watchObservedRunningTime="2026-10-31 01:10:19.269022747 +0000 UTC m=+835.848436657" Oct 31 01:10:19.592264 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:19.592177 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:21.726384 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:21.726344 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:21.739269 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:21.739237 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:22.275322 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:22.275285 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:10:25.141622 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:25.141583 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:25.155385 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:25.155353 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:25.292743 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:25.292713 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:10:28.592924 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:28.592883 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:28.605768 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:28.605739 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:29.328420 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:29.328376 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:10:47.199211 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:10:47.199166 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:10:51.845108 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:51.845063 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh"] Oct 31 01:10:51.849195 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:51.849169 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:51.852803 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:51.852774 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-0a6cca-openshift-default-dockercfg-jn6mf\"" Oct 31 01:10:51.858207 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:51.858169 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh"] Oct 31 01:10:51.932566 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:51.932529 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9"] Oct 31 01:10:51.936168 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:51.936133 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:51.955775 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:51.955742 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-acdaed-openshift-default-dockercfg-swmgr\"" Oct 31 01:10:51.955976 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:51.955948 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9"] Oct 31 01:10:51.962422 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:51.962384 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pxbq\" (UniqueName: \"kubernetes.io/projected/2e88678f-d491-46fa-839c-913ffe8a0a6d-kube-api-access-5pxbq\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:51.962577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:51.962453 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-workload-certs\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:51.962644 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:51.962535 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-token\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:51.962700 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:51.962661 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-data\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:51.962761 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:51.962736 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-envoy\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:51.962812 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:51.962770 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-podinfo\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:51.962864 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:51.962839 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e88678f-d491-46fa-839c-913ffe8a0a6d-istiod-ca-cert\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:51.962911 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:51.962880 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-credential-socket\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:51.962979 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:51.962964 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-workload-socket\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:52.064282 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.064247 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-workload-certs\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:52.064282 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.064288 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-envoy\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.064515 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.064305 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-token\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:52.064515 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.064391 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v65dg\" (UniqueName: \"kubernetes.io/projected/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-kube-api-access-v65dg\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.064515 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.064474 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-workload-certs\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.064699 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.064541 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-data\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:52.064699 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.064611 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istiod-ca-cert\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.064699 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.064631 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-data\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.064699 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.064652 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-envoy\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:52.064699 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.064669 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-podinfo\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:52.064932 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.064720 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-workload-certs\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:52.064932 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.064738 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-token\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.064932 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.064827 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e88678f-d491-46fa-839c-913ffe8a0a6d-istiod-ca-cert\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:52.064932 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.064854 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-data\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:52.064932 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.064865 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-workload-socket\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.064932 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.064916 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-credential-socket\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:52.065241 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.065002 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-workload-socket\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:52.065241 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.065070 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-credential-socket\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.065241 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.065100 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-podinfo\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.065241 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.065211 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-credential-socket\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:52.065241 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.065226 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pxbq\" (UniqueName: \"kubernetes.io/projected/2e88678f-d491-46fa-839c-913ffe8a0a6d-kube-api-access-5pxbq\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:52.065478 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.065269 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-workload-socket\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:52.065478 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.065472 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e88678f-d491-46fa-839c-913ffe8a0a6d-istiod-ca-cert\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:52.066898 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.066875 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-envoy\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:52.067301 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.067279 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-podinfo\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:52.075758 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.075736 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-token\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:52.076335 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.076315 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pxbq\" (UniqueName: \"kubernetes.io/projected/2e88678f-d491-46fa-839c-913ffe8a0a6d-kube-api-access-5pxbq\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:52.163012 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.162981 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:52.166407 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.166371 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-credential-socket\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.166407 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.166416 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-podinfo\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.166675 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.166486 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-envoy\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.166675 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.166513 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v65dg\" (UniqueName: \"kubernetes.io/projected/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-kube-api-access-v65dg\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.166675 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.166569 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-workload-certs\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.166675 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.166648 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istiod-ca-cert\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.166675 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.166673 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-data\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.166958 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.166756 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-token\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.166958 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.166785 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-workload-socket\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.167349 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.167319 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-credential-socket\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.167476 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.167418 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-workload-socket\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.167540 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.167477 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-data\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.167603 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.167575 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-workload-certs\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.167840 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.167815 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istiod-ca-cert\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.169532 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.169509 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-envoy\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.170693 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.170671 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-podinfo\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.175718 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.175691 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v65dg\" (UniqueName: \"kubernetes.io/projected/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-kube-api-access-v65dg\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.175835 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.175819 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-token\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.250330 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.250290 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:52.446919 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.446894 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh"] Oct 31 01:10:52.449388 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:10:52.449354 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e88678f_d491_46fa_839c_913ffe8a0a6d.slice/crio-620658a406fbf2a3c322dbfded71905cc8f8e9cb1aa2b05ca5133d52fbc17644 WatchSource:0}: Error finding container 620658a406fbf2a3c322dbfded71905cc8f8e9cb1aa2b05ca5133d52fbc17644: Status 404 returned error can't find the container with id 620658a406fbf2a3c322dbfded71905cc8f8e9cb1aa2b05ca5133d52fbc17644 Oct 31 01:10:52.451729 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.451695 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:10:52.451812 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.451763 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:10:52.451812 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.451790 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:10:52.459960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.459935 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" event={"ID":"2e88678f-d491-46fa-839c-913ffe8a0a6d","Type":"ContainerStarted","Data":"620658a406fbf2a3c322dbfded71905cc8f8e9cb1aa2b05ca5133d52fbc17644"} Oct 31 01:10:52.538587 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.538535 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9"] Oct 31 01:10:52.548275 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:10:52.547382 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e0539d_33d9_4c6c_afb8_0e67e95e18d5.slice/crio-d01ed1588a3c88b48d868969d30e875a31c5580ee62c2d1d64494169c07a9716 WatchSource:0}: Error finding container d01ed1588a3c88b48d868969d30e875a31c5580ee62c2d1d64494169c07a9716: Status 404 returned error can't find the container with id d01ed1588a3c88b48d868969d30e875a31c5580ee62c2d1d64494169c07a9716 Oct 31 01:10:52.549738 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.549700 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:10:52.549840 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.549773 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:10:52.549840 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:52.549803 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:10:53.493335 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:53.486077 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" event={"ID":"2e88678f-d491-46fa-839c-913ffe8a0a6d","Type":"ContainerStarted","Data":"3137a57a74576365d5f840e94c4b775e8fe097054ee0bfc1989de1edbe68dc6a"} Oct 31 01:10:53.496499 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:53.496465 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" event={"ID":"53e0539d-33d9-4c6c-afb8-0e67e95e18d5","Type":"ContainerStarted","Data":"32244b9756e687f2d6d0541d1bfa95ef4c11ab1dfb4c9d29225bdd7f33778231"} Oct 31 01:10:53.496646 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:53.496531 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" event={"ID":"53e0539d-33d9-4c6c-afb8-0e67e95e18d5","Type":"ContainerStarted","Data":"d01ed1588a3c88b48d868969d30e875a31c5580ee62c2d1d64494169c07a9716"} Oct 31 01:10:53.548578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:53.544273 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" podStartSLOduration=2.544240964 podStartE2EDuration="2.544240964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:10:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:10:53.54342712 +0000 UTC m=+870.122841034" watchObservedRunningTime="2026-10-31 01:10:53.544240964 +0000 UTC m=+870.123654873" Oct 31 01:10:53.548578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:53.544676 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" podStartSLOduration=2.544665442 podStartE2EDuration="2.544665442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:10:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:10:53.521401526 +0000 UTC m=+870.100815467" watchObservedRunningTime="2026-10-31 01:10:53.544665442 +0000 UTC m=+870.124079350" Oct 31 01:10:54.166575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:54.165732 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:10:54.166575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:54.165898 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Oct 31 01:10:54.166575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:54.165944 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" podUID="2e88678f-d491-46fa-839c-913ffe8a0a6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Oct 31 01:10:54.267577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:54.262070 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:10:54.285575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:54.273683 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Oct 31 01:10:54.285575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:54.273753 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" podUID="53e0539d-33d9-4c6c-afb8-0e67e95e18d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Oct 31 01:10:55.166577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:55.166148 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Oct 31 01:10:55.166577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:55.166228 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" podUID="2e88678f-d491-46fa-839c-913ffe8a0a6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Oct 31 01:10:55.251583 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:55.251135 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Oct 31 01:10:55.251583 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:55.251221 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" podUID="53e0539d-33d9-4c6c-afb8-0e67e95e18d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Oct 31 01:10:56.172608 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:56.165997 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Oct 31 01:10:56.172608 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:56.166087 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" podUID="2e88678f-d491-46fa-839c-913ffe8a0a6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Oct 31 01:10:56.252587 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:56.252442 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Oct 31 01:10:56.252587 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:56.252506 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" podUID="53e0539d-33d9-4c6c-afb8-0e67e95e18d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Oct 31 01:10:57.164156 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:57.164118 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Oct 31 01:10:57.164507 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:57.164476 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" podUID="2e88678f-d491-46fa-839c-913ffe8a0a6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Oct 31 01:10:57.259577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:57.253978 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Oct 31 01:10:57.259577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:57.254058 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" podUID="53e0539d-33d9-4c6c-afb8-0e67e95e18d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Oct 31 01:10:58.167577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:58.166951 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Oct 31 01:10:58.167577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:58.167035 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" podUID="2e88678f-d491-46fa-839c-913ffe8a0a6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Oct 31 01:10:58.251098 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:58.251060 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Oct 31 01:10:58.251435 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:58.251386 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" podUID="53e0539d-33d9-4c6c-afb8-0e67e95e18d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Oct 31 01:10:59.164260 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:59.164223 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Oct 31 01:10:59.164877 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:59.164831 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" podUID="2e88678f-d491-46fa-839c-913ffe8a0a6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Oct 31 01:10:59.251370 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:59.251319 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Oct 31 01:10:59.251525 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:10:59.251397 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" podUID="53e0539d-33d9-4c6c-afb8-0e67e95e18d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Oct 31 01:11:00.168475 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:00.168443 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:11:00.168895 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:00.168747 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:11:00.169511 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:00.169491 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:11:00.256633 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:00.256600 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:11:00.256916 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:00.256875 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:11:00.257727 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:00.257700 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:11:17.220064 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:11:17.220023 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:11:21.812810 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:21.812771 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7"] Oct 31 01:11:21.816723 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:21.816704 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:21.824036 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:21.824009 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-487a6c-openshift-default-dockercfg-fl6qs\"" Oct 31 01:11:21.834804 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:21.834779 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7"] Oct 31 01:11:21.920287 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:21.920242 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-token\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:21.920287 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:21.920285 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-workload-socket\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:21.920609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:21.920314 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istiod-ca-cert\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:21.920609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:21.920419 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-credential-socket\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:21.920609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:21.920451 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-podinfo\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:21.920609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:21.920478 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-envoy\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:21.920817 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:21.920622 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-workload-certs\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:21.920817 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:21.920662 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-data\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:21.920817 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:21.920685 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r99l\" (UniqueName: \"kubernetes.io/projected/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-kube-api-access-4r99l\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:22.022249 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.022212 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istiod-ca-cert\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:22.022249 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.022255 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-credential-socket\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:22.022496 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.022276 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-podinfo\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:22.022496 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.022388 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-envoy\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:22.022646 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.022498 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-workload-certs\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:22.022646 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.022540 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-data\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:22.022646 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.022590 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r99l\" (UniqueName: \"kubernetes.io/projected/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-kube-api-access-4r99l\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:22.022799 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.022696 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-token\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:22.022799 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.022747 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-workload-socket\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:22.023450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.022753 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-credential-socket\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:22.023450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.022873 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-workload-certs\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:22.023450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.023128 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istiod-ca-cert\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:22.023450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.023170 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-data\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:22.023450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.023222 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-workload-socket\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:22.025228 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.025205 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-envoy\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:22.025429 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.025413 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-podinfo\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:22.031008 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.030978 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r99l\" (UniqueName: \"kubernetes.io/projected/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-kube-api-access-4r99l\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:22.031102 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.031006 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-token\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:22.131092 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.131064 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:22.413884 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.413854 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7"] Oct 31 01:11:22.416540 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:11:22.416507 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc40b2f0_2ac7_4ed3_9d00_7e116ad2b40b.slice/crio-fe5881f4a07c88df2d2495c4ac22c6cf7bf18965dc7ed5c564a16a8b5df4ae51 WatchSource:0}: Error finding container fe5881f4a07c88df2d2495c4ac22c6cf7bf18965dc7ed5c564a16a8b5df4ae51: Status 404 returned error can't find the container with id fe5881f4a07c88df2d2495c4ac22c6cf7bf18965dc7ed5c564a16a8b5df4ae51 Oct 31 01:11:22.419337 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.419305 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:11:22.419436 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.419368 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:11:22.419436 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.419398 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:11:22.651945 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.651905 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" event={"ID":"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b","Type":"ContainerStarted","Data":"af3991e2d05fa1ff2fa5e4e62b19eea9c81aed56334fef2a13fee7fe6578bd7c"} Oct 31 01:11:22.652150 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.651965 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" event={"ID":"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b","Type":"ContainerStarted","Data":"fe5881f4a07c88df2d2495c4ac22c6cf7bf18965dc7ed5c564a16a8b5df4ae51"} Oct 31 01:11:22.676322 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:22.676208 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" podStartSLOduration=1.6761918740000001 podStartE2EDuration="1.676191874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:11:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:11:22.673843633 +0000 UTC m=+899.253257557" watchObservedRunningTime="2026-10-31 01:11:22.676191874 +0000 UTC m=+899.255605782" Oct 31 01:11:23.131672 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:23.131638 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:23.134153 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:23.134124 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Oct 31 01:11:23.134291 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:23.134175 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" podUID="dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Oct 31 01:11:23.701107 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:23.701076 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/1.log" Oct 31 01:11:23.708539 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:23.708509 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/1.log" Oct 31 01:11:24.131943 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:24.131906 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Oct 31 01:11:24.132352 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:24.131970 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" podUID="dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Oct 31 01:11:25.154587 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:25.154307 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Oct 31 01:11:25.154587 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:25.154374 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" podUID="dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Oct 31 01:11:26.132279 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:26.132247 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Oct 31 01:11:26.132452 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:26.132300 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" podUID="dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Oct 31 01:11:27.132245 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:27.132211 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Oct 31 01:11:27.132748 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:27.132269 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" podUID="dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Oct 31 01:11:28.132097 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:28.132063 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Oct 31 01:11:28.132259 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:28.132126 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" podUID="dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Oct 31 01:11:29.168644 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:29.168606 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:29.169506 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:29.169464 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:29.170769 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:29.170741 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:11:36.734075 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.733972 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb"] Oct 31 01:11:36.745964 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.745929 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.746940 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.746731 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb"] Oct 31 01:11:36.751354 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.751328 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-7f6d1e-openshift-default-dockercfg-fjfcz\"" Oct 31 01:11:36.763602 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.763565 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-envoy\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.763757 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.763683 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-workload-socket\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.763757 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.763721 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-token\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.763886 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.763808 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpgrm\" (UniqueName: \"kubernetes.io/projected/8900532b-edb2-4cf6-bc7c-d6f60473221c-kube-api-access-fpgrm\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.763886 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.763865 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-workload-certs\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.763981 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.763893 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8900532b-edb2-4cf6-bc7c-d6f60473221c-istiod-ca-cert\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.763981 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.763963 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-credential-socket\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.764074 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.763992 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-podinfo\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.764074 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.764038 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-data\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.864781 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.864748 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-credential-socket\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.864781 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.864785 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-podinfo\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.865071 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.864830 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-data\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.865071 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.864873 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-envoy\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.865071 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.864950 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-workload-socket\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.865071 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.864973 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-token\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.865071 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.865026 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpgrm\" (UniqueName: \"kubernetes.io/projected/8900532b-edb2-4cf6-bc7c-d6f60473221c-kube-api-access-fpgrm\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.865332 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.865096 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-workload-certs\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.865332 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.865125 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8900532b-edb2-4cf6-bc7c-d6f60473221c-istiod-ca-cert\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.865332 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.865199 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-credential-socket\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.865332 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.865261 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-data\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.865854 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.865808 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-workload-socket\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.865983 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.865851 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-workload-certs\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.865983 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.865850 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8900532b-edb2-4cf6-bc7c-d6f60473221c-istiod-ca-cert\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.867938 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.867910 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-podinfo\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.868056 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.867958 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-envoy\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.881455 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.881429 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-token\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:36.881833 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:36.881809 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpgrm\" (UniqueName: \"kubernetes.io/projected/8900532b-edb2-4cf6-bc7c-d6f60473221c-kube-api-access-fpgrm\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:37.050927 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.050848 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm"] Oct 31 01:11:37.055745 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.055720 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.065269 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.065242 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:37.066350 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.066318 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-workload-certs\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.066476 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.066391 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-credential-socket\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.066476 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.066457 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-token\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.066637 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.066493 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7ht9\" (UniqueName: \"kubernetes.io/projected/74944bd5-3fcb-48a6-a208-6f17f70df82b-kube-api-access-l7ht9\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.066637 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.066613 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-podinfo\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.066743 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.066668 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-8499c8-openshift-default-dockercfg-h4hkj\"" Oct 31 01:11:37.066743 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.066668 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-envoy\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.066894 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.066785 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74944bd5-3fcb-48a6-a208-6f17f70df82b-istiod-ca-cert\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.066894 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.066819 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-workload-socket\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.066894 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.066838 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-data\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.073542 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.073516 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm"] Oct 31 01:11:37.167726 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.167690 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74944bd5-3fcb-48a6-a208-6f17f70df82b-istiod-ca-cert\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.167902 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.167744 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-workload-socket\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.167902 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.167768 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-data\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.167902 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.167802 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-workload-certs\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.167902 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.167824 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-credential-socket\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.167902 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.167854 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-token\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.167902 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.167879 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7ht9\" (UniqueName: \"kubernetes.io/projected/74944bd5-3fcb-48a6-a208-6f17f70df82b-kube-api-access-l7ht9\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.167902 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.167898 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-podinfo\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.168220 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.167915 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-envoy\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.168656 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.168566 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-workload-certs\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.169184 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.169165 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74944bd5-3fcb-48a6-a208-6f17f70df82b-istiod-ca-cert\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.170414 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.169360 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-workload-socket\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.170414 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.169573 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-data\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.170414 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.170086 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-credential-socket\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.173801 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.173422 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-podinfo\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.174385 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.174363 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-envoy\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.190796 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.190768 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7ht9\" (UniqueName: \"kubernetes.io/projected/74944bd5-3fcb-48a6-a208-6f17f70df82b-kube-api-access-l7ht9\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.191140 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.191122 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-token\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.215860 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.215825 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l"] Oct 31 01:11:37.221069 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.221043 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.235723 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.235696 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-28ff08-openshift-default-dockercfg-gpfzz\"" Oct 31 01:11:37.235854 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.235755 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l"] Oct 31 01:11:37.268933 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.268895 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-credential-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.269192 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.269166 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-workload-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.269318 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.269245 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-token\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.269318 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.269305 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwbdw\" (UniqueName: \"kubernetes.io/projected/34724cef-6f8d-4da1-9312-7b85f4814d52-kube-api-access-kwbdw\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.269444 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.269393 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-workload-certs\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.269500 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.269466 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-podinfo\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.269570 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.269518 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-envoy\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.269570 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.269548 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34724cef-6f8d-4da1-9312-7b85f4814d52-istiod-ca-cert\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.269684 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.269604 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-data\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.370009 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.369969 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:37.370373 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.370352 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-credential-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.370416 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.370392 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-workload-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.370452 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.370439 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-token\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.370491 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.370456 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwbdw\" (UniqueName: \"kubernetes.io/projected/34724cef-6f8d-4da1-9312-7b85f4814d52-kube-api-access-kwbdw\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.370539 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.370498 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-workload-certs\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.370620 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.370539 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-podinfo\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.370620 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.370596 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-envoy\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.370729 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.370625 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34724cef-6f8d-4da1-9312-7b85f4814d52-istiod-ca-cert\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.370729 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.370668 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-data\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.370833 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.370806 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-credential-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.370891 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.370830 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-workload-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.371016 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.370994 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-workload-certs\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.371062 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.371017 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-data\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.371364 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.371346 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34724cef-6f8d-4da1-9312-7b85f4814d52-istiod-ca-cert\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.372980 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.372956 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-envoy\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.373070 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.373057 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-podinfo\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.392853 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.392825 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-token\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.392957 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.392902 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwbdw\" (UniqueName: \"kubernetes.io/projected/34724cef-6f8d-4da1-9312-7b85f4814d52-kube-api-access-kwbdw\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.399273 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.399249 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb"] Oct 31 01:11:37.399829 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:11:37.399807 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8900532b_edb2_4cf6_bc7c_d6f60473221c.slice/crio-d89244582d40d72812402f4ca5f161b4d778aaaf4e77064fb28a2990b68692ac WatchSource:0}: Error finding container d89244582d40d72812402f4ca5f161b4d778aaaf4e77064fb28a2990b68692ac: Status 404 returned error can't find the container with id d89244582d40d72812402f4ca5f161b4d778aaaf4e77064fb28a2990b68692ac Oct 31 01:11:37.402479 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.402449 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:11:37.402595 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.402527 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:11:37.402667 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.402588 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:11:37.536045 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.536008 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:37.677353 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.677326 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm"] Oct 31 01:11:37.680867 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:11:37.680837 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74944bd5_3fcb_48a6_a208_6f17f70df82b.slice/crio-c1a93453d41cc3b85d8439976db630023ff86cd269391ef8c5c3373b7dcdf34a WatchSource:0}: Error finding container c1a93453d41cc3b85d8439976db630023ff86cd269391ef8c5c3373b7dcdf34a: Status 404 returned error can't find the container with id c1a93453d41cc3b85d8439976db630023ff86cd269391ef8c5c3373b7dcdf34a Oct 31 01:11:37.683385 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.683352 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:11:37.683470 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.683419 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:11:37.683470 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.683450 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:11:37.836698 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.835600 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" event={"ID":"74944bd5-3fcb-48a6-a208-6f17f70df82b","Type":"ContainerStarted","Data":"79f68ff55e414e36780906332c113742d73e683517a00adab8f8dab63378a750"} Oct 31 01:11:37.836698 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.835670 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" event={"ID":"74944bd5-3fcb-48a6-a208-6f17f70df82b","Type":"ContainerStarted","Data":"c1a93453d41cc3b85d8439976db630023ff86cd269391ef8c5c3373b7dcdf34a"} Oct 31 01:11:37.840323 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.839703 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" event={"ID":"8900532b-edb2-4cf6-bc7c-d6f60473221c","Type":"ContainerStarted","Data":"27e9305822b5a40b110b196f034c861d4c9dce5fd290440c043f12a50165c05c"} Oct 31 01:11:37.840323 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.839764 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" event={"ID":"8900532b-edb2-4cf6-bc7c-d6f60473221c","Type":"ContainerStarted","Data":"d89244582d40d72812402f4ca5f161b4d778aaaf4e77064fb28a2990b68692ac"} Oct 31 01:11:37.844884 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.844853 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l"] Oct 31 01:11:37.893004 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:11:37.890896 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34724cef_6f8d_4da1_9312_7b85f4814d52.slice/crio-c417ed7712c382b7f5d26d0653e79d6c3a1d7c7479b6464138a04a3eb4353495 WatchSource:0}: Error finding container c417ed7712c382b7f5d26d0653e79d6c3a1d7c7479b6464138a04a3eb4353495: Status 404 returned error can't find the container with id c417ed7712c382b7f5d26d0653e79d6c3a1d7c7479b6464138a04a3eb4353495 Oct 31 01:11:37.895235 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.895193 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:11:37.895511 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.895479 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:11:37.895746 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.895722 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:11:37.920878 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.918373 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" podStartSLOduration=0.918350816 podStartE2EDuration="918.350816ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:11:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:11:37.881501204 +0000 UTC m=+914.460915113" watchObservedRunningTime="2026-10-31 01:11:37.918350816 +0000 UTC m=+914.497764728" Oct 31 01:11:37.924073 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:37.924006 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" podStartSLOduration=1.9239885270000001 podStartE2EDuration="1.923988527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:11:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:11:37.908733801 +0000 UTC m=+914.488147727" watchObservedRunningTime="2026-10-31 01:11:37.923988527 +0000 UTC m=+914.503402430" Oct 31 01:11:38.071615 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:38.067195 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:38.071615 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:38.068082 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Oct 31 01:11:38.071615 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:38.068132 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" podUID="8900532b-edb2-4cf6-bc7c-d6f60473221c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Oct 31 01:11:38.374576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:38.373546 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:38.378576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:38.376418 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Oct 31 01:11:38.378576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:38.376483 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" podUID="74944bd5-3fcb-48a6-a208-6f17f70df82b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Oct 31 01:11:38.891654 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:38.891613 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" event={"ID":"34724cef-6f8d-4da1-9312-7b85f4814d52","Type":"ContainerStarted","Data":"4e18bdafaf8d8b2fee4107bbbaa926f5bf8f266f77ada4473979f98fb05f1978"} Oct 31 01:11:38.892256 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:38.892230 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" event={"ID":"34724cef-6f8d-4da1-9312-7b85f4814d52","Type":"ContainerStarted","Data":"c417ed7712c382b7f5d26d0653e79d6c3a1d7c7479b6464138a04a3eb4353495"} Oct 31 01:11:38.940621 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:38.938078 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" podStartSLOduration=1.9380538409999999 podStartE2EDuration="1.938053841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:11:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:11:38.929431406 +0000 UTC m=+915.508845316" watchObservedRunningTime="2026-10-31 01:11:38.938053841 +0000 UTC m=+915.517467750" Oct 31 01:11:39.073712 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:39.073672 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Oct 31 01:11:39.074007 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:39.073974 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" podUID="8900532b-edb2-4cf6-bc7c-d6f60473221c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Oct 31 01:11:39.448885 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:39.448397 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Oct 31 01:11:39.448885 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:39.448459 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" podUID="74944bd5-3fcb-48a6-a208-6f17f70df82b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Oct 31 01:11:39.537053 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:39.537010 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:39.538771 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:39.538736 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Oct 31 01:11:39.538924 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:39.538790 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" podUID="34724cef-6f8d-4da1-9312-7b85f4814d52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Oct 31 01:11:40.084680 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:40.084628 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Oct 31 01:11:40.085436 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:40.085389 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" podUID="8900532b-edb2-4cf6-bc7c-d6f60473221c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Oct 31 01:11:40.373577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:40.371377 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Oct 31 01:11:40.373577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:40.371441 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" podUID="74944bd5-3fcb-48a6-a208-6f17f70df82b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Oct 31 01:11:40.545645 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:40.541048 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Oct 31 01:11:40.545645 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:40.541123 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" podUID="34724cef-6f8d-4da1-9312-7b85f4814d52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Oct 31 01:11:41.067578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:41.067230 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Oct 31 01:11:41.067578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:41.067291 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" podUID="8900532b-edb2-4cf6-bc7c-d6f60473221c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Oct 31 01:11:41.381581 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:41.377997 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Oct 31 01:11:41.381581 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:41.378074 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" podUID="74944bd5-3fcb-48a6-a208-6f17f70df82b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Oct 31 01:11:41.537128 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:41.537081 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Oct 31 01:11:41.537320 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:41.537148 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" podUID="34724cef-6f8d-4da1-9312-7b85f4814d52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Oct 31 01:11:42.068579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:42.068294 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Oct 31 01:11:42.068579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:42.068359 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" podUID="8900532b-edb2-4cf6-bc7c-d6f60473221c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Oct 31 01:11:42.371575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:42.370931 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Oct 31 01:11:42.371575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:42.370990 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" podUID="74944bd5-3fcb-48a6-a208-6f17f70df82b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Oct 31 01:11:42.537314 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:42.537272 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Oct 31 01:11:42.537840 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:42.537346 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" podUID="34724cef-6f8d-4da1-9312-7b85f4814d52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Oct 31 01:11:43.073250 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:43.073212 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Oct 31 01:11:43.074345 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:43.074311 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" podUID="8900532b-edb2-4cf6-bc7c-d6f60473221c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Oct 31 01:11:43.370992 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:43.370950 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Oct 31 01:11:43.371267 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:43.371239 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" podUID="74944bd5-3fcb-48a6-a208-6f17f70df82b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Oct 31 01:11:43.536416 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:43.536378 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Oct 31 01:11:43.536676 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:43.536442 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" podUID="34724cef-6f8d-4da1-9312-7b85f4814d52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Oct 31 01:11:44.075581 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:44.069645 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Oct 31 01:11:44.075581 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:44.069713 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" podUID="8900532b-edb2-4cf6-bc7c-d6f60473221c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Oct 31 01:11:44.374041 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:44.373999 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Oct 31 01:11:44.374592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:44.374514 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" podUID="74944bd5-3fcb-48a6-a208-6f17f70df82b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Oct 31 01:11:44.537273 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:44.537233 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Oct 31 01:11:44.537454 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:44.537289 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" podUID="34724cef-6f8d-4da1-9312-7b85f4814d52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Oct 31 01:11:45.082910 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:45.082873 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:45.084082 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:45.084055 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:45.086421 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:45.086398 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:11:45.417780 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:45.417743 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:45.418692 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:45.418670 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:45.419650 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:45.419631 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:11:45.662231 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:45.662175 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:45.664373 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:45.664342 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:45.666090 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:45.666067 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:11:47.504289 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:11:47.504244 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:11:51.584262 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.584228 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569"] Oct 31 01:11:51.588234 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.588217 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.592193 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.592171 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-1b8d05-openshift-default-dockercfg-q8z4w\"" Oct 31 01:11:51.599132 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.599105 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569"] Oct 31 01:11:51.659397 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.659362 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-envoy\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.659397 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.659400 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-token\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.659588 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.659437 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxvdh\" (UniqueName: \"kubernetes.io/projected/8f24afcc-82f0-4d26-bf4d-4969762ede4d-kube-api-access-rxvdh\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.659668 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.659644 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-data\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.659717 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.659698 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-workload-socket\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.659902 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.659881 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-workload-certs\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.659935 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.659917 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istiod-ca-cert\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.660037 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.660021 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-credential-socket\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.660085 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.660070 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-podinfo\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.761690 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.761660 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-podinfo\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.761873 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.761709 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-envoy\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.761873 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.761731 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-token\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.761873 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.761760 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxvdh\" (UniqueName: \"kubernetes.io/projected/8f24afcc-82f0-4d26-bf4d-4969762ede4d-kube-api-access-rxvdh\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.761873 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.761780 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-data\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.761873 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.761803 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-workload-socket\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.762196 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.761906 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-workload-certs\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.762196 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.761926 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istiod-ca-cert\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.762196 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.761989 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-credential-socket\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.762196 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.762184 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-data\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.762417 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.762271 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-workload-socket\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.762417 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.762303 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-credential-socket\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.762525 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.762454 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-workload-certs\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.762979 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.762950 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istiod-ca-cert\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.764204 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.764183 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-envoy\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.764536 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.764514 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-podinfo\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.783827 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.783798 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-token\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.783950 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.783915 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxvdh\" (UniqueName: \"kubernetes.io/projected/8f24afcc-82f0-4d26-bf4d-4969762ede4d-kube-api-access-rxvdh\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:51.903415 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:51.903376 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:52.190366 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:52.188901 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569"] Oct 31 01:11:52.192393 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:11:52.192364 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f24afcc_82f0_4d26_bf4d_4969762ede4d.slice/crio-f475340118c498c0ec25a34afe599ab4325fa869a028561a57432c46603d4b6c WatchSource:0}: Error finding container f475340118c498c0ec25a34afe599ab4325fa869a028561a57432c46603d4b6c: Status 404 returned error can't find the container with id f475340118c498c0ec25a34afe599ab4325fa869a028561a57432c46603d4b6c Oct 31 01:11:52.194976 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:52.194941 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:11:52.195054 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:52.195009 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:11:52.195054 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:52.195039 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:11:53.078590 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:53.078417 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" event={"ID":"8f24afcc-82f0-4d26-bf4d-4969762ede4d","Type":"ContainerStarted","Data":"270cc31e6605e939672bb5fd1e25c4185242ee84b253f60e0b1fcfa79e0481c5"} Oct 31 01:11:53.078590 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:53.078547 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" event={"ID":"8f24afcc-82f0-4d26-bf4d-4969762ede4d","Type":"ContainerStarted","Data":"f475340118c498c0ec25a34afe599ab4325fa869a028561a57432c46603d4b6c"} Oct 31 01:11:53.113063 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:53.112993 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" podStartSLOduration=2.112972453 podStartE2EDuration="2.112972453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:11:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:11:53.10398195 +0000 UTC m=+929.683395872" watchObservedRunningTime="2026-10-31 01:11:53.112972453 +0000 UTC m=+929.692386363" Oct 31 01:11:53.903762 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:53.903674 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:53.904737 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:53.904714 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Oct 31 01:11:53.904801 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:53.904763 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" podUID="8f24afcc-82f0-4d26-bf4d-4969762ede4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Oct 31 01:11:54.903951 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:54.903912 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Oct 31 01:11:54.904458 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:54.903984 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" podUID="8f24afcc-82f0-4d26-bf4d-4969762ede4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Oct 31 01:11:55.906763 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:55.905938 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Oct 31 01:11:55.906763 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:55.906002 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" podUID="8f24afcc-82f0-4d26-bf4d-4969762ede4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Oct 31 01:11:56.903957 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:56.903926 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Oct 31 01:11:56.904190 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:56.904164 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" podUID="8f24afcc-82f0-4d26-bf4d-4969762ede4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Oct 31 01:11:57.904366 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:57.904323 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Oct 31 01:11:57.904894 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:57.904423 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" podUID="8f24afcc-82f0-4d26-bf4d-4969762ede4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Oct 31 01:11:58.904546 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:58.904507 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Oct 31 01:11:58.904987 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:58.904591 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" podUID="8f24afcc-82f0-4d26-bf4d-4969762ede4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Oct 31 01:11:59.912782 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:59.912744 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:59.914665 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:59.914642 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:11:59.917124 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:11:59.917106 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:12:06.923831 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:06.923800 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w"] Oct 31 01:12:06.927499 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:06.927475 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:06.940903 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:06.939287 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w"] Oct 31 01:12:06.982117 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:06.982083 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-envoy\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:06.982290 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:06.982141 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istiod-ca-cert\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:06.982358 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:06.982288 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zxks\" (UniqueName: \"kubernetes.io/projected/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-kube-api-access-6zxks\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:06.982358 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:06.982333 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-podinfo\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:06.982441 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:06.982411 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-workload-certs\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:06.982544 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:06.982526 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-token\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:06.982624 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:06.982574 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-credential-socket\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:06.982624 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:06.982602 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-data\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:06.982701 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:06.982639 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-workload-socket\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:07.009190 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.009161 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b"] Oct 31 01:12:07.013519 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.013494 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.028190 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.028161 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b"] Oct 31 01:12:07.051178 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.051151 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds"] Oct 31 01:12:07.055751 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.055720 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.084093 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.084059 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-token\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.084232 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.084110 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-credential-socket\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.084232 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.084181 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-envoy\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.084232 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.084217 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvtgg\" (UniqueName: \"kubernetes.io/projected/d34c9445-cbcd-4f23-b685-f0edc29d2301-kube-api-access-nvtgg\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.084405 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.084330 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-data\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.084405 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.084375 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-envoy\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:07.084510 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.084491 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-workload-certs\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.084584 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.084528 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istiod-ca-cert\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:07.084668 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.084649 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d34c9445-cbcd-4f23-b685-f0edc29d2301-istiod-ca-cert\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.084724 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.084689 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zxks\" (UniqueName: \"kubernetes.io/projected/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-kube-api-access-6zxks\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:07.084724 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.084717 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-podinfo\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:07.084826 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.084774 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-workload-certs\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:07.084873 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.084861 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-podinfo\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.084935 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.084920 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-token\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:07.084971 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.084957 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-credential-socket\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:07.085018 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.084982 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-data\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:07.085055 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.085038 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-workload-socket\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:07.085092 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.085082 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-workload-socket\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.085237 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.085218 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-credential-socket\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:07.085328 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.085300 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istiod-ca-cert\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:07.085504 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.085488 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-data\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:07.085603 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.085546 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-workload-socket\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:07.085859 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.085820 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-workload-certs\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:07.089537 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.088485 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds"] Oct 31 01:12:07.089537 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.088232 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-envoy\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:07.089850 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.089829 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-podinfo\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:07.094613 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.094588 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zxks\" (UniqueName: \"kubernetes.io/projected/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-kube-api-access-6zxks\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:07.097209 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.097190 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-token\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:07.186239 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.186157 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-credential-socket\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.186239 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.186192 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-envoy\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.186239 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.186217 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvtgg\" (UniqueName: \"kubernetes.io/projected/d34c9445-cbcd-4f23-b685-f0edc29d2301-kube-api-access-nvtgg\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.186497 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.186252 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgldr\" (UniqueName: \"kubernetes.io/projected/97628062-0839-49a3-ac40-e0b13d862da6-kube-api-access-fgldr\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.186497 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.186389 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-data\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.186497 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.186446 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-workload-certs\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.186497 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.186485 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97628062-0839-49a3-ac40-e0b13d862da6-istio-podinfo\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.186743 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.186524 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-workload-certs\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.186743 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.186582 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-istio-data\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.186743 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.186631 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-credential-socket\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.186743 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.186655 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-credential-socket\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.186743 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.186689 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d34c9445-cbcd-4f23-b685-f0edc29d2301-istiod-ca-cert\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.186947 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.186767 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-data\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.186947 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.186783 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97628062-0839-49a3-ac40-e0b13d862da6-istio-token\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.186947 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.186827 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-workload-certs\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.186947 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.186901 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97628062-0839-49a3-ac40-e0b13d862da6-istiod-ca-cert\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.186947 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.186934 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-istio-envoy\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.187149 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.187011 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-podinfo\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.187149 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.187112 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-workload-socket\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.187149 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.187145 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-workload-socket\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.187279 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.187201 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-token\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.187394 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.187370 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d34c9445-cbcd-4f23-b685-f0edc29d2301-istiod-ca-cert\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.187510 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.187483 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-workload-socket\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.188797 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.188779 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-envoy\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.189813 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.189793 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-podinfo\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.197535 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.197508 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-token\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.197989 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.197971 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvtgg\" (UniqueName: \"kubernetes.io/projected/d34c9445-cbcd-4f23-b685-f0edc29d2301-kube-api-access-nvtgg\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.248070 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.248031 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:07.290575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.288820 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgldr\" (UniqueName: \"kubernetes.io/projected/97628062-0839-49a3-ac40-e0b13d862da6-kube-api-access-fgldr\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.290575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.288908 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97628062-0839-49a3-ac40-e0b13d862da6-istio-podinfo\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.290575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.288933 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-workload-certs\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.290575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.288950 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-istio-data\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.290575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.288989 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-credential-socket\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.290575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.289102 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97628062-0839-49a3-ac40-e0b13d862da6-istio-token\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.290575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.289160 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97628062-0839-49a3-ac40-e0b13d862da6-istiod-ca-cert\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.290575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.289203 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-istio-envoy\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.290575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.289296 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-workload-socket\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.290575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.289422 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-workload-certs\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.290575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.289670 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-workload-socket\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.290575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.289692 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-credential-socket\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.290575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.289958 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-istio-data\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.290575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.290120 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97628062-0839-49a3-ac40-e0b13d862da6-istiod-ca-cert\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.323580 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.322880 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97628062-0839-49a3-ac40-e0b13d862da6-istio-podinfo\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.323580 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.323281 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-istio-envoy\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.350577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.334737 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:07.370695 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.370580 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgldr\" (UniqueName: \"kubernetes.io/projected/97628062-0839-49a3-ac40-e0b13d862da6-kube-api-access-fgldr\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.388664 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.385978 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97628062-0839-49a3-ac40-e0b13d862da6-istio-token\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.626341 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.626311 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w"] Oct 31 01:12:07.627864 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:12:07.627838 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd2d2b1_7a55_44b9_b8a0_171e9af4587d.slice/crio-e4879cac1010b25c83462832e06e05cd1769d37590dddb5825ba82a59ab39de0 WatchSource:0}: Error finding container e4879cac1010b25c83462832e06e05cd1769d37590dddb5825ba82a59ab39de0: Status 404 returned error can't find the container with id e4879cac1010b25c83462832e06e05cd1769d37590dddb5825ba82a59ab39de0 Oct 31 01:12:07.630778 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.630742 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:07.630863 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.630810 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:07.630863 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.630840 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:07.664229 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.664201 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b"] Oct 31 01:12:07.671741 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:12:07.671703 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd34c9445_cbcd_4f23_b685_f0edc29d2301.slice/crio-f77dbaaefb606b9b344b51c525e335eb03220d4b4f4b2c893f0d430633457bfe WatchSource:0}: Error finding container f77dbaaefb606b9b344b51c525e335eb03220d4b4f4b2c893f0d430633457bfe: Status 404 returned error can't find the container with id f77dbaaefb606b9b344b51c525e335eb03220d4b4f4b2c893f0d430633457bfe Oct 31 01:12:07.674348 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.674317 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:07.674447 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.674382 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:07.674447 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.674409 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:07.683977 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.683957 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:07.991075 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:07.990143 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds"] Oct 31 01:12:07.998419 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:12:07.998389 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97628062_0839_49a3_ac40_e0b13d862da6.slice/crio-5ef43f65df71d11f7103807401e78bdc960362107e1a61309d089dd3c22f0081 WatchSource:0}: Error finding container 5ef43f65df71d11f7103807401e78bdc960362107e1a61309d089dd3c22f0081: Status 404 returned error can't find the container with id 5ef43f65df71d11f7103807401e78bdc960362107e1a61309d089dd3c22f0081 Oct 31 01:12:08.001701 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:08.001667 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:08.001869 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:08.001735 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:08.001869 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:08.001766 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:08.245626 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:08.245367 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" event={"ID":"97628062-0839-49a3-ac40-e0b13d862da6","Type":"ContainerStarted","Data":"8e463b77ea6b26bdf2371fe95f6a3bcbfa792ae686167eadc203cd3fad6a43c7"} Oct 31 01:12:08.245626 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:08.245436 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" event={"ID":"97628062-0839-49a3-ac40-e0b13d862da6","Type":"ContainerStarted","Data":"5ef43f65df71d11f7103807401e78bdc960362107e1a61309d089dd3c22f0081"} Oct 31 01:12:08.251587 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:08.248754 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" event={"ID":"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d","Type":"ContainerStarted","Data":"12917baeb3ff77da93ff1021286823823584650a68c1f711a23daeb32210bed8"} Oct 31 01:12:08.251587 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:08.248808 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" event={"ID":"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d","Type":"ContainerStarted","Data":"e4879cac1010b25c83462832e06e05cd1769d37590dddb5825ba82a59ab39de0"} Oct 31 01:12:08.251587 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:08.250947 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:08.252172 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:08.252132 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Oct 31 01:12:08.252288 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:08.252197 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" podUID="6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Oct 31 01:12:08.254808 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:08.254779 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" event={"ID":"d34c9445-cbcd-4f23-b685-f0edc29d2301","Type":"ContainerStarted","Data":"3c1f245c281cc5c06cf7dba7ebd128d7bfcdd4990056e5c5f686bc016adcbca0"} Oct 31 01:12:08.255052 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:08.255030 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" event={"ID":"d34c9445-cbcd-4f23-b685-f0edc29d2301","Type":"ContainerStarted","Data":"f77dbaaefb606b9b344b51c525e335eb03220d4b4f4b2c893f0d430633457bfe"} Oct 31 01:12:08.296262 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:08.296213 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" podStartSLOduration=1.296200422 podStartE2EDuration="1.296200422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:12:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:12:08.272873038 +0000 UTC m=+944.852286947" watchObservedRunningTime="2026-10-31 01:12:08.296200422 +0000 UTC m=+944.875614330" Oct 31 01:12:08.297841 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:08.297799 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" podStartSLOduration=2.297785165 podStartE2EDuration="2.297785165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:12:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:12:08.294355419 +0000 UTC m=+944.873769329" watchObservedRunningTime="2026-10-31 01:12:08.297785165 +0000 UTC m=+944.877199145" Oct 31 01:12:08.313664 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:08.313476 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" podStartSLOduration=2.313458414 podStartE2EDuration="2.313458414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:12:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:12:08.31329115 +0000 UTC m=+944.892705059" watchObservedRunningTime="2026-10-31 01:12:08.313458414 +0000 UTC m=+944.892872323" Oct 31 01:12:08.336201 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:08.336159 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:08.337815 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:08.337791 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Oct 31 01:12:08.337905 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:08.337840 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" podUID="d34c9445-cbcd-4f23-b685-f0edc29d2301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Oct 31 01:12:08.684756 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:08.684719 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:09.249952 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:09.249914 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Oct 31 01:12:09.250696 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:09.250662 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" podUID="6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Oct 31 01:12:09.336570 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:09.336522 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Oct 31 01:12:09.336739 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:09.336602 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" podUID="d34c9445-cbcd-4f23-b685-f0edc29d2301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Oct 31 01:12:09.689579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:09.689503 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 31 01:12:09.689794 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:09.689598 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" podUID="97628062-0839-49a3-ac40-e0b13d862da6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 31 01:12:10.253580 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:10.253129 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Oct 31 01:12:10.253580 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:10.253204 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" podUID="6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Oct 31 01:12:10.340573 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:10.339896 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Oct 31 01:12:10.340573 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:10.339953 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" podUID="d34c9445-cbcd-4f23-b685-f0edc29d2301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Oct 31 01:12:10.685986 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:10.685944 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 31 01:12:10.686312 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:10.686285 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" podUID="97628062-0839-49a3-ac40-e0b13d862da6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 31 01:12:11.251575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:11.249065 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Oct 31 01:12:11.251575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:11.249144 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" podUID="6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Oct 31 01:12:11.347576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:11.341965 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Oct 31 01:12:11.347576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:11.342029 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" podUID="d34c9445-cbcd-4f23-b685-f0edc29d2301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Oct 31 01:12:11.698575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:11.687989 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 31 01:12:11.698575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:11.688063 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" podUID="97628062-0839-49a3-ac40-e0b13d862da6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 31 01:12:12.250334 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:12.250299 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Oct 31 01:12:12.275608 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:12.250604 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" podUID="6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Oct 31 01:12:12.345229 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:12.345194 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Oct 31 01:12:12.345519 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:12.345482 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" podUID="d34c9445-cbcd-4f23-b685-f0edc29d2301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Oct 31 01:12:12.685877 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:12.685840 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 31 01:12:12.686486 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:12.686456 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" podUID="97628062-0839-49a3-ac40-e0b13d862da6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 31 01:12:13.249006 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:13.248949 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Oct 31 01:12:13.249297 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:13.249266 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" podUID="6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Oct 31 01:12:13.337930 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:13.336706 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Oct 31 01:12:13.337930 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:13.336764 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" podUID="d34c9445-cbcd-4f23-b685-f0edc29d2301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Oct 31 01:12:13.685577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:13.684927 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 31 01:12:13.685577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:13.685002 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" podUID="97628062-0839-49a3-ac40-e0b13d862da6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 31 01:12:14.252914 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.252878 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Oct 31 01:12:14.253475 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.253449 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" podUID="6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Oct 31 01:12:14.337487 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.337452 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Oct 31 01:12:14.337804 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.337775 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" podUID="d34c9445-cbcd-4f23-b685-f0edc29d2301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Oct 31 01:12:14.590383 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.590291 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg"] Oct 31 01:12:14.678533 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.678490 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg"] Oct 31 01:12:14.701578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.678869 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:14.702495 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.684962 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 31 01:12:14.702722 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.702693 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" podUID="97628062-0839-49a3-ac40-e0b13d862da6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 31 01:12:14.714578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.704941 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-model-cache\") pod \"distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:14.714578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.705013 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a0744c2-7736-4e75-8ed6-62b0099604f4-tls-certs\") pod \"distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:14.714578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.705044 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-home\") pod \"distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:14.714578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.705089 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-tmp-dir\") pod \"distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:14.714578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.705227 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbdnk\" (UniqueName: \"kubernetes.io/projected/2a0744c2-7736-4e75-8ed6-62b0099604f4-kube-api-access-hbdnk\") pod \"distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:14.714578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.705259 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-dshm\") pod \"distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:14.733577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.718759 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-487a6c\"/\"distinct-2-w3-487a6c-kserve-self-signed-certs\"" Oct 31 01:12:14.875606 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.875084 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbdnk\" (UniqueName: \"kubernetes.io/projected/2a0744c2-7736-4e75-8ed6-62b0099604f4-kube-api-access-hbdnk\") pod \"distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:14.919508 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.885885 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-dshm\") pod \"distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:14.920514 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.920489 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-model-cache\") pod \"distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:14.929085 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.928964 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-model-cache\") pod \"distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:14.936742 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.936716 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a0744c2-7736-4e75-8ed6-62b0099604f4-tls-certs\") pod \"distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:14.937047 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.937028 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-home\") pod \"distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:14.937285 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.937268 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-tmp-dir\") pod \"distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:14.944399 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.937522 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-home\") pod \"distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:14.955097 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:14.955061 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-tmp-dir\") pod \"distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:15.018000 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:15.017962 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-dshm\") pod \"distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:15.071578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:15.065291 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbdnk\" (UniqueName: \"kubernetes.io/projected/2a0744c2-7736-4e75-8ed6-62b0099604f4-kube-api-access-hbdnk\") pod \"distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:15.117232 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:15.117198 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a0744c2-7736-4e75-8ed6-62b0099604f4-tls-certs\") pod \"distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:15.249285 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:15.249198 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Oct 31 01:12:15.249449 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:15.249270 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" podUID="6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Oct 31 01:12:15.339797 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:15.339758 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Oct 31 01:12:15.340391 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:15.340358 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" podUID="d34c9445-cbcd-4f23-b685-f0edc29d2301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Oct 31 01:12:15.347857 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:15.347826 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:15.724619 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:15.724586 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 31 01:12:15.725017 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:15.724950 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" podUID="97628062-0839-49a3-ac40-e0b13d862da6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 31 01:12:15.796107 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:15.793718 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg"] Oct 31 01:12:16.389864 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:16.389832 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:16.390479 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:16.390458 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:16.391256 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:16.391238 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:12:16.430880 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:16.430848 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:16.431400 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:16.431328 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:16.432381 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:16.432357 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:12:16.537841 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:16.537800 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" event={"ID":"2a0744c2-7736-4e75-8ed6-62b0099604f4","Type":"ContainerStarted","Data":"e7aa2ca74339c8d1d60895725b9f2f7b952ff4ad9f4b4840aba145cd56804b51"} Oct 31 01:12:16.538007 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:16.537853 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" event={"ID":"2a0744c2-7736-4e75-8ed6-62b0099604f4","Type":"ContainerStarted","Data":"62af009013e4a7e8d31dd37700438b7cc0da450331612b9110aa11871618bf14"} Oct 31 01:12:16.562157 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:16.562099 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podStartSLOduration=2.562079786 podStartE2EDuration="2.562079786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:12:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:12:16.560190743 +0000 UTC m=+953.139604652" watchObservedRunningTime="2026-10-31 01:12:16.562079786 +0000 UTC m=+953.141493696" Oct 31 01:12:16.690854 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:16.690760 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:16.692444 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:16.691968 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:16.693040 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:16.692992 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:12:17.279580 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:12:17.271732 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:12:17.349271 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:17.349226 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:22.142579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.142376 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9"] Oct 31 01:12:22.151745 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.148648 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9"] Oct 31 01:12:22.151745 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.148775 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.217609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.211851 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-istio-data\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.217609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.211913 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/876007f4-ecc5-469f-addd-8e76a84257e5-istio-podinfo\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.217609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.211955 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-istio-envoy\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.217609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.212023 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/876007f4-ecc5-469f-addd-8e76a84257e5-istio-token\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.217609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.212074 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-workload-certs\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.217609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.212105 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-credential-socket\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.217609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.212189 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf64q\" (UniqueName: \"kubernetes.io/projected/876007f4-ecc5-469f-addd-8e76a84257e5-kube-api-access-zf64q\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.217609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.212235 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-workload-socket\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.217609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.212264 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/876007f4-ecc5-469f-addd-8e76a84257e5-istiod-ca-cert\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.302660 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.302626 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz"] Oct 31 01:12:22.306182 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.306156 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.313169 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.313142 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf64q\" (UniqueName: \"kubernetes.io/projected/876007f4-ecc5-469f-addd-8e76a84257e5-kube-api-access-zf64q\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.313301 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.313188 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-workload-socket\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.313301 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.313208 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/876007f4-ecc5-469f-addd-8e76a84257e5-istiod-ca-cert\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.313416 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.313347 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-istio-data\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.313416 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.313380 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/876007f4-ecc5-469f-addd-8e76a84257e5-istio-podinfo\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.313535 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.313422 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-istio-envoy\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.313535 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.313494 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/876007f4-ecc5-469f-addd-8e76a84257e5-istio-token\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.313664 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.313546 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-workload-certs\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.313664 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.313589 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-credential-socket\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.320537 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.315697 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-workload-socket\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.320537 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.315859 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-istio-data\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.320537 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.315918 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-credential-socket\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.320537 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.317612 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-workload-certs\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.320537 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.317848 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-istio-envoy\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.320537 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.319965 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz"] Oct 31 01:12:22.323405 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.323374 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/876007f4-ecc5-469f-addd-8e76a84257e5-istiod-ca-cert\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.325634 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.325615 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/876007f4-ecc5-469f-addd-8e76a84257e5-istio-podinfo\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.331210 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.331182 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf64q\" (UniqueName: \"kubernetes.io/projected/876007f4-ecc5-469f-addd-8e76a84257e5-kube-api-access-zf64q\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.333594 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.333545 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/876007f4-ecc5-469f-addd-8e76a84257e5-istio-token\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.415039 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.414963 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-podinfo\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.415039 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.415017 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-workload-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.415244 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.415104 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-envoy\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.415244 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.415156 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-data\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.415353 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.415295 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-workload-certs\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.415408 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.415350 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-credential-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.415461 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.415435 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6106bf2d-96d6-4452-a356-dd23d3de4087-istiod-ca-cert\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.415545 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.415528 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-token\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.415645 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.415630 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h9zd\" (UniqueName: \"kubernetes.io/projected/6106bf2d-96d6-4452-a356-dd23d3de4087-kube-api-access-4h9zd\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.509943 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.509903 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:22.516595 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.516567 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-token\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.516707 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.516615 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h9zd\" (UniqueName: \"kubernetes.io/projected/6106bf2d-96d6-4452-a356-dd23d3de4087-kube-api-access-4h9zd\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.516707 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.516641 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-podinfo\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.516707 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.516677 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-workload-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.516840 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.516706 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-envoy\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.516840 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.516754 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-data\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.516840 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.516829 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-workload-certs\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.516988 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.516895 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-credential-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.516988 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.516957 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6106bf2d-96d6-4452-a356-dd23d3de4087-istiod-ca-cert\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.517196 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.517168 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-workload-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.517378 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.517349 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-workload-certs\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.517466 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.517410 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-data\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.517532 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.517466 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-credential-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.517771 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.517748 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6106bf2d-96d6-4452-a356-dd23d3de4087-istiod-ca-cert\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.519105 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.519080 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-envoy\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.519476 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.519452 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-podinfo\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.527422 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.527390 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-token\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.527590 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.527569 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h9zd\" (UniqueName: \"kubernetes.io/projected/6106bf2d-96d6-4452-a356-dd23d3de4087-kube-api-access-4h9zd\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.650604 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.650541 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:22.793081 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.793048 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9"] Oct 31 01:12:22.795406 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:12:22.795375 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876007f4_ecc5_469f_addd_8e76a84257e5.slice/crio-3d436faee7b9183ea16cdfb4af8f5cf590e79994db78b5af3952dbcb2d88705a WatchSource:0}: Error finding container 3d436faee7b9183ea16cdfb4af8f5cf590e79994db78b5af3952dbcb2d88705a: Status 404 returned error can't find the container with id 3d436faee7b9183ea16cdfb4af8f5cf590e79994db78b5af3952dbcb2d88705a Oct 31 01:12:22.798402 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.798367 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:22.798503 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.798434 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:22.798503 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.798468 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:23.002661 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:22.985609 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz"] Oct 31 01:12:23.002661 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:23.001836 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:23.002661 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:23.001921 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:23.002661 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:23.001963 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:23.624273 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:23.624239 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" event={"ID":"876007f4-ecc5-469f-addd-8e76a84257e5","Type":"ContainerStarted","Data":"19f4f5c7516a21ac62dfc7cf52f2e301b0645069dd8a1852a85cd257c517299e"} Oct 31 01:12:23.624757 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:23.624297 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" event={"ID":"876007f4-ecc5-469f-addd-8e76a84257e5","Type":"ContainerStarted","Data":"3d436faee7b9183ea16cdfb4af8f5cf590e79994db78b5af3952dbcb2d88705a"} Oct 31 01:12:23.625847 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:23.625813 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" event={"ID":"6106bf2d-96d6-4452-a356-dd23d3de4087","Type":"ContainerStarted","Data":"b446f47f03bbe640da3a67cf48a3882144c63746fe2742b30a5dfcb0a677d591"} Oct 31 01:12:23.625989 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:23.625864 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" event={"ID":"6106bf2d-96d6-4452-a356-dd23d3de4087","Type":"ContainerStarted","Data":"deb1fc7588669fb291e373707eb97f6cc8bdf47778ea6012fbfe988fe337f316"} Oct 31 01:12:23.662576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:23.656239 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" podStartSLOduration=1.656218708 podStartE2EDuration="1.656218708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:12:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:12:23.653139537 +0000 UTC m=+960.232553445" watchObservedRunningTime="2026-10-31 01:12:23.656218708 +0000 UTC m=+960.235632616" Oct 31 01:12:23.673688 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:23.672761 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:23.693968 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:23.693904 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" podStartSLOduration=1.693870484 podStartE2EDuration="1.693870484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:12:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:12:23.69030484 +0000 UTC m=+960.269718744" watchObservedRunningTime="2026-10-31 01:12:23.693870484 +0000 UTC m=+960.273284394" Oct 31 01:12:24.510819 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:24.510779 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:24.512510 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:24.512480 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Oct 31 01:12:24.512705 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:24.512681 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" podUID="876007f4-ecc5-469f-addd-8e76a84257e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Oct 31 01:12:24.665439 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:24.665393 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Oct 31 01:12:24.666071 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:24.666025 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" podUID="6106bf2d-96d6-4452-a356-dd23d3de4087" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Oct 31 01:12:25.359319 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:25.356071 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:25.410241 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:25.410204 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:25.512308 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:25.512264 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Oct 31 01:12:25.512583 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:25.512534 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" podUID="876007f4-ecc5-469f-addd-8e76a84257e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Oct 31 01:12:25.673573 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:25.673273 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Oct 31 01:12:25.673573 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:25.673332 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" podUID="6106bf2d-96d6-4452-a356-dd23d3de4087" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Oct 31 01:12:25.796813 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:25.796494 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:12:26.511185 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:26.511139 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Oct 31 01:12:26.511369 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:26.511206 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" podUID="876007f4-ecc5-469f-addd-8e76a84257e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Oct 31 01:12:26.652647 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:26.652606 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Oct 31 01:12:26.653043 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:26.652998 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" podUID="6106bf2d-96d6-4452-a356-dd23d3de4087" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Oct 31 01:12:27.511104 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:27.511056 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Oct 31 01:12:27.511603 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:27.511119 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" podUID="876007f4-ecc5-469f-addd-8e76a84257e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Oct 31 01:12:27.661575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:27.651922 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Oct 31 01:12:27.661575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:27.651987 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" podUID="6106bf2d-96d6-4452-a356-dd23d3de4087" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Oct 31 01:12:28.511091 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:28.511049 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Oct 31 01:12:28.511302 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:28.511115 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" podUID="876007f4-ecc5-469f-addd-8e76a84257e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Oct 31 01:12:28.659906 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:28.659871 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Oct 31 01:12:28.660922 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:28.660890 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" podUID="6106bf2d-96d6-4452-a356-dd23d3de4087" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Oct 31 01:12:29.510400 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:29.510363 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Oct 31 01:12:29.510663 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:29.510634 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" podUID="876007f4-ecc5-469f-addd-8e76a84257e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Oct 31 01:12:29.653214 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:29.653177 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Oct 31 01:12:29.653953 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:29.653919 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" podUID="6106bf2d-96d6-4452-a356-dd23d3de4087" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Oct 31 01:12:30.516048 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:30.516016 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:30.516627 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:30.516594 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:30.517808 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:30.517785 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:12:30.747809 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:30.747779 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:30.748796 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:30.748606 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:30.750624 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:30.750599 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:12:36.863035 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:36.863000 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x"] Oct 31 01:12:36.872941 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:36.872912 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:36.906583 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:36.903016 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69"] Oct 31 01:12:36.959529 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:36.959492 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/280e663b-1387-450a-8d9a-7e9f5d574bb9-istiod-ca-cert\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:36.959888 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:36.959864 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-workload-socket\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:36.960017 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:36.960002 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-credential-socket\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:36.960158 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:36.960142 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-envoy\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:36.960275 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:36.960261 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-token\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:36.960382 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:36.960369 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgwkq\" (UniqueName: \"kubernetes.io/projected/280e663b-1387-450a-8d9a-7e9f5d574bb9-kube-api-access-hgwkq\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:36.960509 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:36.960496 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-podinfo\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:36.960656 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:36.960640 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-workload-certs\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:36.960820 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:36.960805 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-data\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:37.000266 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.000231 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x"] Oct 31 01:12:37.000562 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.000513 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69"] Oct 31 01:12:37.000886 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.000866 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.061946 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.061905 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-envoy\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:37.074762 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.074729 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-token\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:37.075006 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.074989 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgwkq\" (UniqueName: \"kubernetes.io/projected/280e663b-1387-450a-8d9a-7e9f5d574bb9-kube-api-access-hgwkq\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:37.075168 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.075148 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-podinfo\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:37.075291 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.075278 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-workload-certs\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:37.075440 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.075416 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-data\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:37.077415 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.075949 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-data\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:37.079763 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.077693 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/280e663b-1387-450a-8d9a-7e9f5d574bb9-istiod-ca-cert\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:37.080038 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.080012 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-workload-socket\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:37.080174 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.080160 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-credential-socket\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:37.080691 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.080673 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-credential-socket\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:37.080851 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.078471 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/280e663b-1387-450a-8d9a-7e9f5d574bb9-istiod-ca-cert\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:37.081268 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.081238 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-workload-socket\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:37.094703 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.094669 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-workload-certs\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:37.104811 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.104781 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-token\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:37.109827 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.109794 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-envoy\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:37.157610 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.152616 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgwkq\" (UniqueName: \"kubernetes.io/projected/280e663b-1387-450a-8d9a-7e9f5d574bb9-kube-api-access-hgwkq\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:37.175198 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.175141 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-podinfo\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:37.195618 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.182051 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-workload-socket\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.195618 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.182147 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc894\" (UniqueName: \"kubernetes.io/projected/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-kube-api-access-kc894\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.195618 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.182182 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-podinfo\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.195618 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.182218 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-envoy\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.195618 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.182277 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-credential-socket\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.195618 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.182377 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-workload-certs\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.195618 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.182421 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-data\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.195618 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.182453 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istiod-ca-cert\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.195618 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.182548 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-token\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.204815 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.204784 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7"] Oct 31 01:12:37.209135 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.209113 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.244137 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.244087 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7"] Oct 31 01:12:37.259690 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.259646 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:37.292540 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.292502 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc894\" (UniqueName: \"kubernetes.io/projected/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-kube-api-access-kc894\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.292749 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.292728 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-envoy\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.296059 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.292901 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-podinfo\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.296258 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.296240 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-credential-socket\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.296478 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.296450 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-envoy\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.297175 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.297152 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-workload-certs\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.297273 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.297233 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-credential-socket\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.298592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.297376 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istiod-ca-cert\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.298592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.297416 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-workload-certs\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.298592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.297474 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-workload-socket\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.298592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.297540 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-data\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.298592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.297608 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46c84\" (UniqueName: \"kubernetes.io/projected/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-kube-api-access-46c84\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.298592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.297662 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-credential-socket\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.298592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.297641 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istiod-ca-cert\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.298592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.297743 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-token\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.298592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.297797 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-workload-socket\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.298592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.297836 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-podinfo\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.298592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.297863 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-token\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.298592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.297936 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-data\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.298592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.298500 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-workload-socket\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.299322 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.298989 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-workload-certs\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.299322 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.299248 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-data\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.299437 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.299422 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istiod-ca-cert\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.307814 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.306773 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc894\" (UniqueName: \"kubernetes.io/projected/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-kube-api-access-kc894\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.308375 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.308334 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-podinfo\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.308696 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.308665 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-envoy\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.311612 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.311567 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-token\") pod \"e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.412773 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.411389 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istiod-ca-cert\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.412773 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.411484 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-workload-socket\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.412773 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.411618 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46c84\" (UniqueName: \"kubernetes.io/projected/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-kube-api-access-46c84\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.412773 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.411757 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-podinfo\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.412773 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.411789 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-token\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.412773 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.411852 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-data\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.412773 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.411904 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-envoy\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.412773 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.411953 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-credential-socket\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.412773 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.412025 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-workload-certs\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.412773 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.412516 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-workload-certs\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.511349 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.497492 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istiod-ca-cert\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.511349 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.508215 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-data\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.511349 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.508389 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-workload-socket\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.511349 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.508484 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-credential-socket\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.511349 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.510163 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:37.541629 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.527545 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h"] Oct 31 01:12:37.557619 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.544145 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:37.557619 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.548826 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-acdaed\"/\"distinct-2-w0-acdaed-kserve-self-signed-certs\"" Oct 31 01:12:37.559286 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.558827 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h"] Oct 31 01:12:37.672628 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.661759 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/185a60e1-d259-4509-8dd7-885be5c00ae1-tls-certs\") pod \"distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:37.672628 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.661828 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-tmp-dir\") pod \"distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:37.672628 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.661977 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4gvc\" (UniqueName: \"kubernetes.io/projected/185a60e1-d259-4509-8dd7-885be5c00ae1-kube-api-access-k4gvc\") pod \"distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:37.672628 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.662024 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-home\") pod \"distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:37.672628 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.662202 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-model-cache\") pod \"distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:37.672628 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.662316 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-dshm\") pod \"distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:37.749017 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.744539 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-token\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.749017 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.745265 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46c84\" (UniqueName: \"kubernetes.io/projected/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-kube-api-access-46c84\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.794410 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.764925 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-envoy\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.794410 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.765477 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-model-cache\") pod \"distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:37.794410 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.765579 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-dshm\") pod \"distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:37.794410 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.765686 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/185a60e1-d259-4509-8dd7-885be5c00ae1-tls-certs\") pod \"distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:37.794410 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.765727 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-tmp-dir\") pod \"distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:37.794410 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.765811 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4gvc\" (UniqueName: \"kubernetes.io/projected/185a60e1-d259-4509-8dd7-885be5c00ae1-kube-api-access-k4gvc\") pod \"distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:37.794410 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.765853 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-home\") pod \"distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:37.794410 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.766510 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-home\") pod \"distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:37.794410 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.766796 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-model-cache\") pod \"distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:37.794410 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.785494 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-podinfo\") pod \"e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.794410 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.786077 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-tmp-dir\") pod \"distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:37.833420 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.832837 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:37.912836 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.912674 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x"] Oct 31 01:12:37.954532 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:37.953239 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4gvc\" (UniqueName: \"kubernetes.io/projected/185a60e1-d259-4509-8dd7-885be5c00ae1-kube-api-access-k4gvc\") pod \"distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:38.079127 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:38.038365 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-dshm\") pod \"distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:38.079127 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:38.038889 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/185a60e1-d259-4509-8dd7-885be5c00ae1-tls-certs\") pod \"distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:38.123432 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:38.122850 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:38.326524 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:38.314025 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:38.326524 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:38.314122 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:38.326524 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:38.314164 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:39.184778 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:39.184216 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" event={"ID":"280e663b-1387-450a-8d9a-7e9f5d574bb9","Type":"ContainerStarted","Data":"e582aba58db70f5085493c0477ebf4a33d179c2fe4e4027cc9962bff8a8998cd"} Oct 31 01:12:39.184778 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:39.184283 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" event={"ID":"280e663b-1387-450a-8d9a-7e9f5d574bb9","Type":"ContainerStarted","Data":"bbd46bf4b4fcb24ecfb0d518e9ebeb286c7b3b9fe1cce591faa8bed9407b9698"} Oct 31 01:12:39.245575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:39.243517 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" podStartSLOduration=3.243497552 podStartE2EDuration="3.243497552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:12:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:12:39.239815727 +0000 UTC m=+975.819229640" watchObservedRunningTime="2026-10-31 01:12:39.243497552 +0000 UTC m=+975.822911461" Oct 31 01:12:39.245575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:39.244825 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h"] Oct 31 01:12:39.293576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:39.272349 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:39.293576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:39.272455 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Oct 31 01:12:39.293576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:39.272496 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" podUID="280e663b-1387-450a-8d9a-7e9f5d574bb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Oct 31 01:12:39.384981 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:39.384919 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69"] Oct 31 01:12:39.389178 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:39.389145 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7"] Oct 31 01:12:39.445610 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:39.445500 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:39.491240 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:39.491191 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:39.491539 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:39.491507 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:39.492325 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:39.457913 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:39.492588 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:39.492538 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:39.492807 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:39.492782 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:40.274066 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:40.274015 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Oct 31 01:12:40.343670 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:40.328653 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" podUID="280e663b-1387-450a-8d9a-7e9f5d574bb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Oct 31 01:12:40.487806 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:40.480168 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" event={"ID":"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc","Type":"ContainerStarted","Data":"6fb53438531a9c6f302733a1f7c136d3578f2cb4e17d09d0a7e81b4704024c05"} Oct 31 01:12:40.487806 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:40.480235 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" event={"ID":"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc","Type":"ContainerStarted","Data":"c2d5cf20ea9093dcf959031a2e9c3d156771992af489442998ca225bc1567bbe"} Oct 31 01:12:40.516598 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:40.514404 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" event={"ID":"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a","Type":"ContainerStarted","Data":"32005af02b1f5074e563b5da11c2d59d00250d288b96a08e6f89eb078427649a"} Oct 31 01:12:40.540103 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:40.540068 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" event={"ID":"185a60e1-d259-4509-8dd7-885be5c00ae1","Type":"ContainerStarted","Data":"a30ef63011715ea299c4ce6f3179a17c5beb5a1d3eaedd86c2d4916762399af3"} Oct 31 01:12:40.540337 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:40.540319 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" event={"ID":"185a60e1-d259-4509-8dd7-885be5c00ae1","Type":"ContainerStarted","Data":"41774bbfd299e9e578ff04e09a668aec72c640c5bff69184079631fda812e6b2"} Oct 31 01:12:40.577979 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:40.576138 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" podStartSLOduration=3.576120495 podStartE2EDuration="3.576120495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:12:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:12:40.541329259 +0000 UTC m=+977.120743172" watchObservedRunningTime="2026-10-31 01:12:40.576120495 +0000 UTC m=+977.155534401" Oct 31 01:12:40.655715 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:40.654352 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podStartSLOduration=3.65433098 podStartE2EDuration="3.65433098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:12:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:12:40.636635066 +0000 UTC m=+977.216048975" watchObservedRunningTime="2026-10-31 01:12:40.65433098 +0000 UTC m=+977.233744889" Oct 31 01:12:40.865576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:40.862745 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:41.123938 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:41.123908 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:41.275702 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:41.275664 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Oct 31 01:12:41.277959 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:41.277639 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" podUID="280e663b-1387-450a-8d9a-7e9f5d574bb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Oct 31 01:12:41.555630 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:41.551592 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" event={"ID":"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a","Type":"ContainerStarted","Data":"04bbb849a5d031b6b4e1dcb65da292c97eea3c10239d32b40151beba3c6b7896"} Oct 31 01:12:41.605577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:41.601727 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" podStartSLOduration=5.601707971 podStartE2EDuration="5.601707971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:12:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:12:41.577009303 +0000 UTC m=+978.156423224" watchObservedRunningTime="2026-10-31 01:12:41.601707971 +0000 UTC m=+978.181121880" Oct 31 01:12:41.850636 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:41.850141 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Oct 31 01:12:41.850636 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:41.850207 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" podUID="960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Oct 31 01:12:42.273759 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:42.273724 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Oct 31 01:12:42.274032 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:42.274004 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" podUID="280e663b-1387-450a-8d9a-7e9f5d574bb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Oct 31 01:12:42.534637 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:42.526454 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:42.534637 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:42.526600 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Oct 31 01:12:42.534637 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:42.526643 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" podUID="c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Oct 31 01:12:42.851628 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:42.848740 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Oct 31 01:12:42.851628 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:42.848807 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" podUID="960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Oct 31 01:12:43.272585 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.269949 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Oct 31 01:12:43.272585 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.270043 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" podUID="280e663b-1387-450a-8d9a-7e9f5d574bb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Oct 31 01:12:43.524636 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.523935 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Oct 31 01:12:43.524636 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.523992 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" podUID="c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Oct 31 01:12:43.694592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.664539 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj"] Oct 31 01:12:43.706952 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.705749 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj"] Oct 31 01:12:43.706952 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.705880 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:43.721389 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.720766 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-7f6d1e\"/\"distinct-2-w1-7f6d1e-kserve-self-signed-certs\"" Oct 31 01:12:43.821706 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.820537 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-tmp-dir\") pod \"distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:43.856576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.851230 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-model-cache\") pod \"distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:43.856576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.851419 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-home\") pod \"distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:43.856576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.851506 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8647a1e0-bcd2-4045-a01e-497bdb3d460f-tls-certs\") pod \"distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:43.856576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.851537 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-dshm\") pod \"distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:43.856576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.851644 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvnsv\" (UniqueName: \"kubernetes.io/projected/8647a1e0-bcd2-4045-a01e-497bdb3d460f-kube-api-access-nvnsv\") pod \"distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:43.856576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.852680 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Oct 31 01:12:43.856576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.852727 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" podUID="960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Oct 31 01:12:43.955378 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.955333 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-tmp-dir\") pod \"distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:43.973577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.955715 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-model-cache\") pod \"distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:43.973991 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.973957 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-home\") pod \"distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:43.974232 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.974210 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8647a1e0-bcd2-4045-a01e-497bdb3d460f-tls-certs\") pod \"distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:43.974358 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.974343 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-dshm\") pod \"distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:43.974487 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.974473 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvnsv\" (UniqueName: \"kubernetes.io/projected/8647a1e0-bcd2-4045-a01e-497bdb3d460f-kube-api-access-nvnsv\") pod \"distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:43.975011 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.964130 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-model-cache\") pod \"distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:43.975582 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.975546 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-home\") pod \"distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:43.975711 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:43.964457 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-tmp-dir\") pod \"distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:44.032619 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:44.032417 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8647a1e0-bcd2-4045-a01e-497bdb3d460f-tls-certs\") pod \"distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:44.036577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:44.032798 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-dshm\") pod \"distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:44.062575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:44.047256 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvnsv\" (UniqueName: \"kubernetes.io/projected/8647a1e0-bcd2-4045-a01e-497bdb3d460f-kube-api-access-nvnsv\") pod \"distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:44.217666 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:44.217632 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:44.303627 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:44.291247 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Oct 31 01:12:44.303627 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:44.291307 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" podUID="280e663b-1387-450a-8d9a-7e9f5d574bb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Oct 31 01:12:44.525423 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:44.524966 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Oct 31 01:12:44.525423 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:44.525027 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" podUID="c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Oct 31 01:12:44.666835 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:44.666743 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:12:44.859193 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:44.858131 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Oct 31 01:12:44.859193 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:44.858220 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" podUID="960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Oct 31 01:12:44.863029 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:44.862981 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj"] Oct 31 01:12:45.278592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:45.275416 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Oct 31 01:12:45.278592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:45.275475 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" podUID="280e663b-1387-450a-8d9a-7e9f5d574bb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Oct 31 01:12:45.524633 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:45.523648 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Oct 31 01:12:45.524633 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:45.523743 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" podUID="c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Oct 31 01:12:45.651173 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:45.649108 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" event={"ID":"8647a1e0-bcd2-4045-a01e-497bdb3d460f","Type":"ContainerStarted","Data":"2544927d3ef51285abee57b4d314fd4f3c68b0c12dd7fb78c4b35f762454d874"} Oct 31 01:12:45.862805 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:45.855853 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Oct 31 01:12:45.862805 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:45.855922 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" podUID="960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Oct 31 01:12:46.271634 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:46.270911 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Oct 31 01:12:46.271634 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:46.270978 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" podUID="280e663b-1387-450a-8d9a-7e9f5d574bb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Oct 31 01:12:46.534376 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:46.534279 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Oct 31 01:12:46.534591 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:46.534363 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" podUID="c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Oct 31 01:12:46.686243 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:46.686203 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" event={"ID":"8647a1e0-bcd2-4045-a01e-497bdb3d460f","Type":"ContainerStarted","Data":"ec7782eb459f19729e5d3a8de39258e86a6fb2785ccc9b32a1a9166f66570327"} Oct 31 01:12:46.851636 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:46.851506 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Oct 31 01:12:46.851636 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:46.851584 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" podUID="960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Oct 31 01:12:47.218491 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:47.218454 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:47.273602 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:47.271977 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Oct 31 01:12:47.273602 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:47.272069 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" podUID="280e663b-1387-450a-8d9a-7e9f5d574bb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Oct 31 01:12:47.273602 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:12:47.272731 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:12:47.531653 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:47.525940 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Oct 31 01:12:47.531653 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:47.526038 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" podUID="c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Oct 31 01:12:47.851633 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:47.849913 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Oct 31 01:12:47.851633 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:47.849971 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" podUID="960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Oct 31 01:12:48.129607 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:48.124121 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:48.147334 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:48.147297 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:48.165264 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:48.165222 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podStartSLOduration=5.165206127 podStartE2EDuration="5.165206127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:12:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:12:46.722935586 +0000 UTC m=+983.302349494" watchObservedRunningTime="2026-10-31 01:12:48.165206127 +0000 UTC m=+984.744620035" Oct 31 01:12:48.491627 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:48.477627 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:48.491627 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:48.478596 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:48.491627 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:48.479467 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:12:48.523814 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:48.523779 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Oct 31 01:12:48.523982 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:48.523848 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" podUID="c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Oct 31 01:12:48.732430 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:48.732402 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:12:49.392351 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:49.392317 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:49.393751 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:49.393725 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:49.394631 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:49.394610 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:12:49.527767 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:49.527737 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:49.528141 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:49.528027 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:49.528712 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:49.528693 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:12:51.725572 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.712613 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj"] Oct 31 01:12:51.725572 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.718008 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.781390 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.781342 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17283d64-4c76-433f-9a21-d6de6ab9e470-istiod-ca-cert\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.781611 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.781410 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44bd9\" (UniqueName: \"kubernetes.io/projected/17283d64-4c76-433f-9a21-d6de6ab9e470-kube-api-access-44bd9\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.781611 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.781460 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-token\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.781611 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.781491 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-podinfo\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.781611 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.781543 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-envoy\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.781845 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.781647 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-data\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.781845 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.781743 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-workload-socket\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.781845 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.781809 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-workload-certs\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.782014 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.781851 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-credential-socket\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.811669 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.811635 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj"] Oct 31 01:12:51.815089 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.815053 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9"] Oct 31 01:12:51.821934 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.821905 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.826898 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.826868 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9"] Oct 31 01:12:51.882682 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.882655 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44bd9\" (UniqueName: \"kubernetes.io/projected/17283d64-4c76-433f-9a21-d6de6ab9e470-kube-api-access-44bd9\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.882839 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.882696 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-envoy\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.882839 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.882734 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-token\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.882839 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.882756 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-podinfo\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.882839 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.882780 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-token\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.883073 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.882850 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-envoy\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.883073 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.882896 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-workload-socket\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.883073 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.882960 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-workload-certs\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.883073 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.882987 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-credential-socket\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.883073 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.883037 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-podinfo\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.883310 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.883119 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-data\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.883310 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.883269 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-data\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.883310 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.883304 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-workload-socket\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.883454 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.883322 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkwbh\" (UniqueName: \"kubernetes.io/projected/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-kube-api-access-gkwbh\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.883454 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.883429 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-data\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.883454 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.883442 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istiod-ca-cert\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.883629 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.883483 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-workload-certs\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.883629 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.883520 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-credential-socket\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.883734 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.883621 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17283d64-4c76-433f-9a21-d6de6ab9e470-istiod-ca-cert\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.883734 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.883696 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-workload-socket\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.883847 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.883818 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-credential-socket\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.884033 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.884004 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-workload-certs\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.884339 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.884315 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17283d64-4c76-433f-9a21-d6de6ab9e470-istiod-ca-cert\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.885393 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.885364 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-envoy\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.885783 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.885763 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-podinfo\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.890768 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.890741 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-token\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.891381 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.891365 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44bd9\" (UniqueName: \"kubernetes.io/projected/17283d64-4c76-433f-9a21-d6de6ab9e470-kube-api-access-44bd9\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:51.985354 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.985281 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-workload-certs\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.985354 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.985318 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-credential-socket\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.985354 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.985338 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-podinfo\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.985780 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.985422 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-data\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.985780 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.985454 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkwbh\" (UniqueName: \"kubernetes.io/projected/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-kube-api-access-gkwbh\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.985780 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.985505 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istiod-ca-cert\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.985780 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.985653 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-envoy\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.985780 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.985721 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-token\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.986030 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.985828 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-credential-socket\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.986030 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.985876 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-workload-certs\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.986030 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.985916 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-workload-socket\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.986030 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.985999 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-data\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.986244 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.986228 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istiod-ca-cert\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.986294 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.986256 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-workload-socket\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.987909 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.987885 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-envoy\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.988020 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.988002 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-podinfo\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.993776 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.993756 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-token\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:51.993915 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:51.993897 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkwbh\" (UniqueName: \"kubernetes.io/projected/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-kube-api-access-gkwbh\") pod \"e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:52.089868 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:52.089835 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:52.139373 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:52.139327 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:52.383368 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:52.382862 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj"] Oct 31 01:12:52.385377 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:12:52.385346 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17283d64_4c76_433f_9a21_d6de6ab9e470.slice/crio-dcf3b1b3ee1492905f9913c08495eaf30aa37be1dbd78621e48dc6b6e051ec48 WatchSource:0}: Error finding container dcf3b1b3ee1492905f9913c08495eaf30aa37be1dbd78621e48dc6b6e051ec48: Status 404 returned error can't find the container with id dcf3b1b3ee1492905f9913c08495eaf30aa37be1dbd78621e48dc6b6e051ec48 Oct 31 01:12:52.388117 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:52.388087 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:52.388179 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:52.388150 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:52.388213 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:52.388181 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:52.493176 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:52.491541 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9"] Oct 31 01:12:52.495068 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:12:52.495030 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e8db137_6e00_4d6a_9f9f_9e4df9a71328.slice/crio-f3d6956502a0bd88936c9fc777e4368fc253e2eda262402bc73b5ed107d08622 WatchSource:0}: Error finding container f3d6956502a0bd88936c9fc777e4368fc253e2eda262402bc73b5ed107d08622: Status 404 returned error can't find the container with id f3d6956502a0bd88936c9fc777e4368fc253e2eda262402bc73b5ed107d08622 Oct 31 01:12:52.498967 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:52.498935 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:52.499092 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:52.499015 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:52.499092 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:52.499061 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:12:52.796210 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:52.796163 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" event={"ID":"4e8db137-6e00-4d6a-9f9f-9e4df9a71328","Type":"ContainerStarted","Data":"000152a67ffb63ce731d9cf908d9df301dcc9b5d986a3b51871ad0f4b7591efe"} Oct 31 01:12:52.796728 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:52.796229 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" event={"ID":"4e8db137-6e00-4d6a-9f9f-9e4df9a71328","Type":"ContainerStarted","Data":"f3d6956502a0bd88936c9fc777e4368fc253e2eda262402bc73b5ed107d08622"} Oct 31 01:12:52.799381 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:52.799353 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" event={"ID":"17283d64-4c76-433f-9a21-d6de6ab9e470","Type":"ContainerStarted","Data":"5fea23b22898a0d7773a92047bb3eddd5b72e11e53ea249d36527d124f6650a7"} Oct 31 01:12:52.799520 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:52.799396 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" event={"ID":"17283d64-4c76-433f-9a21-d6de6ab9e470","Type":"ContainerStarted","Data":"dcf3b1b3ee1492905f9913c08495eaf30aa37be1dbd78621e48dc6b6e051ec48"} Oct 31 01:12:52.823261 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:52.822841 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" podStartSLOduration=1.822821161 podStartE2EDuration="1.822821161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:12:52.818425288 +0000 UTC m=+989.397839197" watchObservedRunningTime="2026-10-31 01:12:52.822821161 +0000 UTC m=+989.402235084" Oct 31 01:12:52.846430 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:52.846364 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" podStartSLOduration=1.846344825 podStartE2EDuration="1.846344825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:12:52.8422261 +0000 UTC m=+989.421640010" watchObservedRunningTime="2026-10-31 01:12:52.846344825 +0000 UTC m=+989.425758734" Oct 31 01:12:53.090980 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:53.090904 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:12:53.092472 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:53.092442 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Oct 31 01:12:53.092622 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:53.092491 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" podUID="17283d64-4c76-433f-9a21-d6de6ab9e470" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Oct 31 01:12:53.140143 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:53.140108 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:12:53.150295 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:53.149866 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Oct 31 01:12:53.150295 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:53.149928 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" podUID="4e8db137-6e00-4d6a-9f9f-9e4df9a71328" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Oct 31 01:12:54.096657 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:54.095692 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Oct 31 01:12:54.096657 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:54.095757 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" podUID="17283d64-4c76-433f-9a21-d6de6ab9e470" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Oct 31 01:12:54.140921 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:54.140889 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Oct 31 01:12:54.141081 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:54.140948 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" podUID="4e8db137-6e00-4d6a-9f9f-9e4df9a71328" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Oct 31 01:12:54.218618 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:54.218584 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:54.231459 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:54.231430 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:54.829036 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:54.829008 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:12:55.092998 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:55.092907 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Oct 31 01:12:55.093810 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:55.093776 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" podUID="17283d64-4c76-433f-9a21-d6de6ab9e470" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Oct 31 01:12:55.140616 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:55.140573 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Oct 31 01:12:55.140990 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:55.140643 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" podUID="4e8db137-6e00-4d6a-9f9f-9e4df9a71328" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Oct 31 01:12:56.098027 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:56.097991 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Oct 31 01:12:56.098331 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:56.098286 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" podUID="17283d64-4c76-433f-9a21-d6de6ab9e470" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Oct 31 01:12:56.140078 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:56.140041 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Oct 31 01:12:56.140292 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:56.140273 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" podUID="4e8db137-6e00-4d6a-9f9f-9e4df9a71328" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Oct 31 01:12:57.096578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:57.093918 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Oct 31 01:12:57.096578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:57.093981 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" podUID="17283d64-4c76-433f-9a21-d6de6ab9e470" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Oct 31 01:12:57.140973 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:57.140943 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Oct 31 01:12:57.141138 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:57.141000 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" podUID="4e8db137-6e00-4d6a-9f9f-9e4df9a71328" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Oct 31 01:12:58.102645 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:58.091407 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Oct 31 01:12:58.102645 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:58.091479 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" podUID="17283d64-4c76-433f-9a21-d6de6ab9e470" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Oct 31 01:12:58.140315 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:58.140005 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Oct 31 01:12:58.140315 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:58.140061 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" podUID="4e8db137-6e00-4d6a-9f9f-9e4df9a71328" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Oct 31 01:12:59.090420 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:59.090376 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Oct 31 01:12:59.090623 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:59.090454 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" podUID="17283d64-4c76-433f-9a21-d6de6ab9e470" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Oct 31 01:12:59.140542 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:59.140508 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Oct 31 01:12:59.141034 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:12:59.141005 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" podUID="4e8db137-6e00-4d6a-9f9f-9e4df9a71328" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Oct 31 01:13:00.783069 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:00.783023 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:13:00.783617 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:00.783562 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:13:00.784613 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:00.784591 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:13:00.802240 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:00.801064 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:13:00.802240 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:00.801862 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:13:00.802602 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:00.802541 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:13:05.674601 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:05.671678 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:05.721694 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:05.721641 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:05.814696 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:05.814647 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded" Oct 31 01:13:06.133580 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:06.121660 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:06.133580 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:06.122103 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": context deadline exceeded" Oct 31 01:13:06.133580 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:06.125056 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": context deadline exceeded" Oct 31 01:13:06.149677 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:06.149636 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/health\": context deadline exceeded" Oct 31 01:13:06.207673 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:06.206655 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:06.286722 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:06.286662 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:06.318708 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:06.318653 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:06.357675 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:06.357631 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:06.725718 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:06.725663 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:06.726811 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:06.726786 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:13:06.856588 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:06.854525 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:06.964975 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:06.857078 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:13:07.158578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:07.132763 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:07.158578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:07.134576 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": context deadline exceeded" Oct 31 01:13:07.158578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:07.135645 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": context deadline exceeded" Oct 31 01:13:07.179008 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:07.165651 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:13:07.179008 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:07.166046 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:13:07.179008 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:07.166140 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:13:07.417605 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:07.387241 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:07.417605 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:07.387442 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded" Oct 31 01:13:07.417605 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:07.397066 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": context deadline exceeded" Oct 31 01:13:07.417605 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:07.397399 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:13:07.417605 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:07.397461 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:13:07.453602 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:07.442712 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:07.480601 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:07.464058 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": context deadline exceeded" Oct 31 01:13:07.480601 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:07.466668 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:13:07.672722 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:07.660937 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:07.785577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:07.756821 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded" Oct 31 01:13:07.873391 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:07.873344 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:07.875000 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:07.874967 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/health\": context deadline exceeded" Oct 31 01:13:08.105652 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.076232 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm"] Oct 31 01:13:08.105652 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.101959 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:08.172776 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.157018 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": context deadline exceeded" Oct 31 01:13:08.172776 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.159268 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:08.172776 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.159622 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:08.351584 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.301885 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.404645 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.404602 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:08.405238 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.405206 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded" Oct 31 01:13:08.466902 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.465351 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": context deadline exceeded" Oct 31 01:13:08.506334 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.501075 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-credential-socket\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.506334 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.501144 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpbrq\" (UniqueName: \"kubernetes.io/projected/b1d931c4-c812-4646-94a2-d7469b0ca856-kube-api-access-xpbrq\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.506334 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.501211 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-workload-certs\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.506334 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.501250 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-workload-socket\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.506334 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.501330 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1d931c4-c812-4646-94a2-d7469b0ca856-istiod-ca-cert\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.506334 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.501451 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-data\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.506334 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.501509 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-podinfo\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.506334 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.501542 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-token\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.506334 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.501650 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-envoy\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.537896 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.537836 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:08.538977 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.538942 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:13:08.667639 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.648816 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1d931c4-c812-4646-94a2-d7469b0ca856-istiod-ca-cert\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.716579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.675377 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-data\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.823726 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.823689 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-podinfo\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.831757 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.831724 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-token\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.832082 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.832050 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-envoy\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.832327 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.832308 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-credential-socket\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.832521 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.832501 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpbrq\" (UniqueName: \"kubernetes.io/projected/b1d931c4-c812-4646-94a2-d7469b0ca856-kube-api-access-xpbrq\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.836835 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.836800 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-workload-certs\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.837017 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.836998 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-workload-socket\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.841829 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.841806 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-workload-socket\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.841998 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.718126 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:08.870574 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.782255 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-data\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.925624 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.771789 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm"] Oct 31 01:13:08.925624 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.924794 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:13:08.925624 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.924871 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:13:08.950609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.669847 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1d931c4-c812-4646-94a2-d7469b0ca856-istiod-ca-cert\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.950609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.854634 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-credential-socket\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.950609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.879723 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded" Oct 31 01:13:08.950609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.771847 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:08.950609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.854356 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-workload-certs\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:08.950609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:08.907719 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-envoy\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:09.144609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:09.103872 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-podinfo\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:09.144609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:09.104410 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-token\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:09.194918 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:09.167255 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": context deadline exceeded" Oct 31 01:13:09.195419 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:09.170622 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:09.196191 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:09.170660 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:09.196568 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:09.193530 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpbrq\" (UniqueName: \"kubernetes.io/projected/b1d931c4-c812-4646-94a2-d7469b0ca856-kube-api-access-xpbrq\") pod \"e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:09.361284 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:09.361242 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:09.400916 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:09.400863 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:09.421690 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:09.421650 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded" Oct 31 01:13:09.479293 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:09.479193 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:09.542723 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:09.542672 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": context deadline exceeded" Oct 31 01:13:09.805211 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:09.774089 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:09.805211 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:09.793335 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:09.892755 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:09.892704 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded" Oct 31 01:13:09.968690 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:09.967912 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:10.029244 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:10.011961 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:10.188220 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:10.188188 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:13:10.219893 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:10.218711 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:10.249481 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:10.223730 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": context deadline exceeded" Oct 31 01:13:10.249481 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:10.234201 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": context deadline exceeded" Oct 31 01:13:10.521703 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:10.489732 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": context deadline exceeded" Oct 31 01:13:10.521703 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:10.491080 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:10.617495 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:10.603661 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:10.932583 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:10.902643 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:11.036524 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:11.036483 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:11.220962 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:11.219451 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": context deadline exceeded" Oct 31 01:13:11.226837 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:11.226799 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:11.243178 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:11.243141 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm"] Oct 31 01:13:11.243915 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:11.243883 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:11.292942 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:11.292912 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:13:11.471874 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:13:11.471800 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1d931c4_c812_4646_94a2_d7469b0ca856.slice/crio-8fab7e5f90aab61c06eb3c71ec9af98312d8120307de53db6833d49d747278c9 WatchSource:0}: Error finding container 8fab7e5f90aab61c06eb3c71ec9af98312d8120307de53db6833d49d747278c9: Status 404 returned error can't find the container with id 8fab7e5f90aab61c06eb3c71ec9af98312d8120307de53db6833d49d747278c9 Oct 31 01:13:11.507682 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:11.505018 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:11.507682 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:11.505744 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": context deadline exceeded" Oct 31 01:13:11.510374 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:11.510322 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:13:11.510675 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:11.510650 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:13:11.510863 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:11.510845 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:13:11.531576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:11.531535 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:13:11.538753 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:11.538722 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:13:11.604871 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:11.604715 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:11.663220 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:11.662058 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:13:11.682070 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:11.682033 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:13:11.772487 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:11.772429 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:12.007539 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:12.007403 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:13:12.049831 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:12.049761 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:12.072875 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:12.072777 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" event={"ID":"b1d931c4-c812-4646-94a2-d7469b0ca856","Type":"ContainerStarted","Data":"8fab7e5f90aab61c06eb3c71ec9af98312d8120307de53db6833d49d747278c9"} Oct 31 01:13:12.084461 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:12.084431 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:13:12.094890 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:12.094846 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:13:13.081286 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:13.081237 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" event={"ID":"b1d931c4-c812-4646-94a2-d7469b0ca856","Type":"ContainerStarted","Data":"90d2ee6cf472989af77ce0596d44b8557cbe39186b90f5cfaeae085290bdbc87"} Oct 31 01:13:13.105904 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:13.105857 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" podStartSLOduration=6.105843375 podStartE2EDuration="6.105843375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:13:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:13:13.101696483 +0000 UTC m=+1009.681110391" watchObservedRunningTime="2026-10-31 01:13:13.105843375 +0000 UTC m=+1009.685257289" Oct 31 01:13:13.405685 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:13.405645 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:13.406167 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:13.406143 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Oct 31 01:13:13.406240 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:13.406190 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" podUID="b1d931c4-c812-4646-94a2-d7469b0ca856" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Oct 31 01:13:14.405580 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:14.405523 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Oct 31 01:13:14.405941 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:14.405603 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" podUID="b1d931c4-c812-4646-94a2-d7469b0ca856" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Oct 31 01:13:15.404897 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:15.404863 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Oct 31 01:13:15.405082 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:15.404917 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" podUID="b1d931c4-c812-4646-94a2-d7469b0ca856" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Oct 31 01:13:16.405512 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:16.405473 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Oct 31 01:13:16.405938 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:16.405525 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" podUID="b1d931c4-c812-4646-94a2-d7469b0ca856" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Oct 31 01:13:17.216920 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:13:17.216887 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:13:17.404832 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:17.404803 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Oct 31 01:13:17.404972 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:17.404855 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" podUID="b1d931c4-c812-4646-94a2-d7469b0ca856" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Oct 31 01:13:18.405155 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:18.405124 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Oct 31 01:13:18.405617 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:18.405177 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" podUID="b1d931c4-c812-4646-94a2-d7469b0ca856" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Oct 31 01:13:19.710625 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:19.710590 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:19.711530 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:19.711004 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:19.711759 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:19.711740 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:13:22.253573 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.245751 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp"] Oct 31 01:13:22.259629 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.259602 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.309779 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.309728 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp"] Oct 31 01:13:22.319748 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.319714 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh"] Oct 31 01:13:22.336678 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.336642 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh"] Oct 31 01:13:22.336824 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.336765 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.374116 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.374007 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-workload-socket\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.374414 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.374390 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-workload-certs\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.374609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.374591 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-envoy\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.374790 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.374773 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-credential-socket\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.374991 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.374974 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-token\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.375158 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.375141 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t55fb\" (UniqueName: \"kubernetes.io/projected/d88cf0ef-5780-485b-9984-e40c5040d5f4-kube-api-access-t55fb\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.375311 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.375296 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d88cf0ef-5780-485b-9984-e40c5040d5f4-istiod-ca-cert\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.375466 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.375451 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-workload-socket\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.375627 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.375611 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-token\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.375789 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.375773 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-podinfo\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.375983 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.375965 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-data\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.376139 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.376122 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-envoy\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.376293 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.376278 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-credential-socket\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.376453 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.376435 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtgm9\" (UniqueName: \"kubernetes.io/projected/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-kube-api-access-jtgm9\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.376631 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.376614 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-data\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.376796 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.376779 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-workload-certs\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.376970 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.376954 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istiod-ca-cert\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.377135 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.377119 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-podinfo\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.419836 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.419804 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp"] Oct 31 01:13:22.424185 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.424161 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.437537 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.437513 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp"] Oct 31 01:13:22.471067 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.471025 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh"] Oct 31 01:13:22.475741 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.475718 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.478857 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.478825 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-podinfo\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.479059 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.478911 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-workload-socket\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.479059 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.478958 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-workload-certs\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.479059 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.478992 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-envoy\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.479249 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.479190 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istiod-ca-cert\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.479301 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.479281 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdmzs\" (UniqueName: \"kubernetes.io/projected/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-kube-api-access-cdmzs\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.479360 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.479310 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-credential-socket\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.479360 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.479342 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-envoy\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.479453 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.479428 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-token\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.479517 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.479453 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t55fb\" (UniqueName: \"kubernetes.io/projected/d88cf0ef-5780-485b-9984-e40c5040d5f4-kube-api-access-t55fb\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.479517 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.479484 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-token\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.479636 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.479518 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d88cf0ef-5780-485b-9984-e40c5040d5f4-istiod-ca-cert\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.479636 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.479576 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-workload-socket\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.479636 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.479609 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-token\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.479811 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.479636 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-podinfo\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.479811 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.479666 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-podinfo\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.479811 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.479696 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-data\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.479811 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.479761 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-credential-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.479811 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.479795 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-data\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.480033 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.479838 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-workload-certs\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.480033 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.479876 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-envoy\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.480033 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.479909 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-credential-socket\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.480033 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.479943 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-workload-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.480033 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.480000 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtgm9\" (UniqueName: \"kubernetes.io/projected/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-kube-api-access-jtgm9\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.480033 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.480029 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-credential-socket\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.480255 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.480036 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-data\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.480255 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.480109 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-workload-certs\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.480255 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.480136 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istiod-ca-cert\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.480427 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.480406 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-data\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.480909 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.480878 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istiod-ca-cert\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.481436 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.481413 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-workload-socket\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.481997 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.481969 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-workload-certs\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.482344 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.482323 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-workload-certs\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.482450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.482358 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d88cf0ef-5780-485b-9984-e40c5040d5f4-istiod-ca-cert\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.482732 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.482672 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-data\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.482911 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.482677 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-credential-socket\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.484499 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.484475 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-workload-socket\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.485101 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.485059 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-envoy\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.485449 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.485411 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh"] Oct 31 01:13:22.488321 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.488294 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-podinfo\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.491142 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.491113 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-podinfo\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.491631 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.491611 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-envoy\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.495112 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.495084 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-token\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.498960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.498919 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtgm9\" (UniqueName: \"kubernetes.io/projected/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-kube-api-access-jtgm9\") pod \"e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.511024 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.509197 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-token\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.519753 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.516131 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t55fb\" (UniqueName: \"kubernetes.io/projected/d88cf0ef-5780-485b-9984-e40c5040d5f4-kube-api-access-t55fb\") pod \"e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.581337 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.581308 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-workload-certs\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.581456 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.581350 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-workload-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.581456 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.581414 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9cc4\" (UniqueName: \"kubernetes.io/projected/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-kube-api-access-j9cc4\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.581600 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.581464 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-token\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.581600 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.581569 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istiod-ca-cert\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.581714 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.581674 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-credential-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.581757 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.581721 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-workload-certs\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.581796 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.581757 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istiod-ca-cert\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.581796 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.581772 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-workload-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.581855 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.581828 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-workload-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.581888 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.581859 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-workload-certs\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.581921 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.581889 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdmzs\" (UniqueName: \"kubernetes.io/projected/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-kube-api-access-cdmzs\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.581963 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.581918 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-envoy\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.582092 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.582074 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-token\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.582158 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.582124 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-envoy\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.582217 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.582196 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-podinfo\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.582276 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.582227 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-podinfo\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.582276 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.582262 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-data\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.582391 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.582375 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istiod-ca-cert\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.583173 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.582387 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-data\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.583173 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.582512 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-credential-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.583173 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.582725 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-data\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.583173 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.582819 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-credential-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.584965 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.584941 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-envoy\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.585080 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.584989 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-podinfo\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.590677 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.590651 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-token\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.590754 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.590676 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdmzs\" (UniqueName: \"kubernetes.io/projected/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-kube-api-access-cdmzs\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.598246 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.598226 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:22.659074 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.659042 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:22.686593 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.685440 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-token\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.686593 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.685493 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istiod-ca-cert\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.686593 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.685576 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-credential-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.686593 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.685632 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-workload-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.686593 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.685666 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-workload-certs\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.686593 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.685796 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-envoy\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.686593 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.685836 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-podinfo\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.686593 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.685881 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-data\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.686593 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.686031 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9cc4\" (UniqueName: \"kubernetes.io/projected/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-kube-api-access-j9cc4\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.687133 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.686753 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-workload-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.687133 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.687007 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-data\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.687240 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.687161 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istiod-ca-cert\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.687291 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.687253 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-credential-socket\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.687438 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.687417 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-workload-certs\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.689927 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.689904 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-envoy\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.693087 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.693046 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-podinfo\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.694114 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.694080 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9cc4\" (UniqueName: \"kubernetes.io/projected/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-kube-api-access-j9cc4\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.694918 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.694891 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-token\") pod \"e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.741464 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.741219 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:22.851504 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.851349 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:22.888307 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.887818 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp"] Oct 31 01:13:22.891486 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:13:22.891459 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd88cf0ef_5780_485b_9984_e40c5040d5f4.slice/crio-adc651ffdca9623518a6269e5085c61ee040b72ccbee27eceb7f074ce0394db4 WatchSource:0}: Error finding container adc651ffdca9623518a6269e5085c61ee040b72ccbee27eceb7f074ce0394db4: Status 404 returned error can't find the container with id adc651ffdca9623518a6269e5085c61ee040b72ccbee27eceb7f074ce0394db4 Oct 31 01:13:22.894715 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.894681 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:13:22.894803 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.894752 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:13:22.894803 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.894779 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:13:22.969980 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.969949 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh"] Oct 31 01:13:22.970453 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:13:22.970421 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc1e8160_8f4e_4be3_96a9_b2d5b339959b.slice/crio-52585a6f1ca91199b8a38f9ba2f8673820ccb78ca526574a2b12e9ea947931ce WatchSource:0}: Error finding container 52585a6f1ca91199b8a38f9ba2f8673820ccb78ca526574a2b12e9ea947931ce: Status 404 returned error can't find the container with id 52585a6f1ca91199b8a38f9ba2f8673820ccb78ca526574a2b12e9ea947931ce Oct 31 01:13:22.974891 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.974852 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:13:22.974960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.974941 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:13:22.975007 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:22.974987 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:13:23.055538 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:23.055506 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp"] Oct 31 01:13:23.064286 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:23.064249 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:13:23.064373 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:23.064338 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:13:23.064415 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:23.064381 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:13:23.270805 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:23.270764 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh"] Oct 31 01:13:23.279919 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:23.278814 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" event={"ID":"d88cf0ef-5780-485b-9984-e40c5040d5f4","Type":"ContainerStarted","Data":"79a447cb80d3da792bef3b5197ef562b1fe547cc759aa7b19285b3a67fb82872"} Oct 31 01:13:23.279919 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:23.278886 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" event={"ID":"d88cf0ef-5780-485b-9984-e40c5040d5f4","Type":"ContainerStarted","Data":"adc651ffdca9623518a6269e5085c61ee040b72ccbee27eceb7f074ce0394db4"} Oct 31 01:13:23.280402 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:13:23.280367 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbed3e81b_9c9a_4bf2_b609_5d8b122a4e6f.slice/crio-59cce3802eea0503d9f78739ee5615dd8698b12cf2200c5c09b34ed5a981883d WatchSource:0}: Error finding container 59cce3802eea0503d9f78739ee5615dd8698b12cf2200c5c09b34ed5a981883d: Status 404 returned error can't find the container with id 59cce3802eea0503d9f78739ee5615dd8698b12cf2200c5c09b34ed5a981883d Oct 31 01:13:23.286063 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:23.286020 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:13:23.286875 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:23.286847 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:13:23.287030 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:23.287013 5821 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 31 01:13:23.287510 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:23.286394 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" event={"ID":"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6","Type":"ContainerStarted","Data":"54b7f3c770b533c1149a596373d83966000bbbdf5448589da97004c7339ede90"} Oct 31 01:13:23.298057 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:23.297226 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" event={"ID":"fc1e8160-8f4e-4be3-96a9-b2d5b339959b","Type":"ContainerStarted","Data":"e7dd2e7b862601adadca9e595a9b1f139b294897143402e6a541e07cfc1496a1"} Oct 31 01:13:23.298057 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:23.297282 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" event={"ID":"fc1e8160-8f4e-4be3-96a9-b2d5b339959b","Type":"ContainerStarted","Data":"52585a6f1ca91199b8a38f9ba2f8673820ccb78ca526574a2b12e9ea947931ce"} Oct 31 01:13:23.302087 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:23.302030 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" podStartSLOduration=1.302014234 podStartE2EDuration="1.302014234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:13:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:13:23.301003303 +0000 UTC m=+1019.880417211" watchObservedRunningTime="2026-10-31 01:13:23.302014234 +0000 UTC m=+1019.881428142" Oct 31 01:13:23.323113 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:23.322989 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" podStartSLOduration=1.3229702859999999 podStartE2EDuration="1.322970286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:13:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:13:23.320441155 +0000 UTC m=+1019.899855066" watchObservedRunningTime="2026-10-31 01:13:23.322970286 +0000 UTC m=+1019.902384195" Oct 31 01:13:23.599087 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:23.599008 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:23.600987 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:23.600963 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Oct 31 01:13:23.601173 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:23.601151 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" podUID="d88cf0ef-5780-485b-9984-e40c5040d5f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Oct 31 01:13:23.660039 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:23.659989 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:24.413591 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:24.412405 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" event={"ID":"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f","Type":"ContainerStarted","Data":"85b4611fb17f474bacad76a19fc0c764c9836c0708c1c57eb99e9861bea8cf98"} Oct 31 01:13:24.413591 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:24.412478 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" event={"ID":"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f","Type":"ContainerStarted","Data":"59cce3802eea0503d9f78739ee5615dd8698b12cf2200c5c09b34ed5a981883d"} Oct 31 01:13:24.447591 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:24.432595 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" event={"ID":"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6","Type":"ContainerStarted","Data":"2eddd3e2ed0dd3830b7cc3442058a3ea3a81af6b1d247d0c51657a1fc96d17f2"} Oct 31 01:13:24.477591 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:24.452861 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" podStartSLOduration=2.452840804 podStartE2EDuration="2.452840804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:13:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:13:24.444754587 +0000 UTC m=+1021.024168499" watchObservedRunningTime="2026-10-31 01:13:24.452840804 +0000 UTC m=+1021.032254713" Oct 31 01:13:24.559588 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:24.554325 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" podStartSLOduration=2.554301905 podStartE2EDuration="2.554301905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:13:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:13:24.488214245 +0000 UTC m=+1021.067628154" watchObservedRunningTime="2026-10-31 01:13:24.554301905 +0000 UTC m=+1021.133715816" Oct 31 01:13:24.634588 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:24.631730 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Oct 31 01:13:24.634588 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:24.631791 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" podUID="d88cf0ef-5780-485b-9984-e40c5040d5f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Oct 31 01:13:24.706643 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:24.691312 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Oct 31 01:13:24.706643 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:24.691373 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" podUID="fc1e8160-8f4e-4be3-96a9-b2d5b339959b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Oct 31 01:13:24.745618 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:24.745276 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:24.745618 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:24.745487 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Oct 31 01:13:24.745618 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:24.745539 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" podUID="2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Oct 31 01:13:24.854803 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:24.854753 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:24.855022 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:24.854892 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Oct 31 01:13:24.855022 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:24.854939 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" podUID="bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Oct 31 01:13:25.164578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:25.158144 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:25.182576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:25.165383 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:25.220997 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:25.220646 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:25.250868 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:25.249646 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": context deadline exceeded" Oct 31 01:13:25.312480 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:25.308842 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:25.434722 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:25.434617 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:25.560733 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:25.560694 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:25.745808 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:25.745714 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Oct 31 01:13:25.746478 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:25.746430 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" podUID="d88cf0ef-5780-485b-9984-e40c5040d5f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Oct 31 01:13:25.753188 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:25.753159 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Oct 31 01:13:25.760675 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:25.760634 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" podUID="fc1e8160-8f4e-4be3-96a9-b2d5b339959b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Oct 31 01:13:25.784915 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:25.784879 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Oct 31 01:13:25.785190 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:25.785160 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" podUID="2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Oct 31 01:13:25.811866 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:25.811819 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:25.826487 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:25.826449 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:25.870764 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:25.870726 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Oct 31 01:13:25.870965 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:25.870787 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" podUID="bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Oct 31 01:13:25.893581 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:25.885642 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:26.149746 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.149679 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:26.307580 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.241811 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:26.307580 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.241851 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": context deadline exceeded" Oct 31 01:13:26.307580 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.294852 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:13:26.307580 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.294918 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:13:26.360578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.359870 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:26.433626 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.361248 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:26.433626 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.369684 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:13:26.433626 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.375109 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": context deadline exceeded" Oct 31 01:13:26.455579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.448316 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:13:26.503576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.461307 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:26.768624 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.736834 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:13:26.819587 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.562675 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": context deadline exceeded" Oct 31 01:13:26.877526 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.779248 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Oct 31 01:13:26.877811 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.877777 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" podUID="fc1e8160-8f4e-4be3-96a9-b2d5b339959b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Oct 31 01:13:26.919588 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.822716 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:26.921687 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.844257 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:26.933773 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.878297 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:13:26.933773 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.921960 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:13:26.933773 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.922014 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:13:26.935183 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.503925 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:26.949611 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.808694 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Oct 31 01:13:26.949611 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.936266 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" podUID="2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Oct 31 01:13:26.949611 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.813599 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Oct 31 01:13:26.949611 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.936315 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" podUID="d88cf0ef-5780-485b-9984-e40c5040d5f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Oct 31 01:13:26.949611 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.875378 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Oct 31 01:13:26.949611 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:26.936353 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" podUID="bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Oct 31 01:13:27.013358 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:27.013316 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded" Oct 31 01:13:27.046623 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:27.020603 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:13:27.309629 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:27.295422 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:27.309629 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:27.295688 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": context deadline exceeded" Oct 31 01:13:27.389577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:27.381785 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/health\": context deadline exceeded" Oct 31 01:13:27.389577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:27.382311 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:27.423575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:27.423001 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:27.624667 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:27.622152 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Oct 31 01:13:27.624667 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:27.622209 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" podUID="d88cf0ef-5780-485b-9984-e40c5040d5f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Oct 31 01:13:27.731576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:27.726948 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Oct 31 01:13:27.731576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:27.727028 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" podUID="fc1e8160-8f4e-4be3-96a9-b2d5b339959b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Oct 31 01:13:27.848150 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:27.757208 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:28.143574 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:27.932383 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:28.143574 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:27.932434 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": context deadline exceeded" Oct 31 01:13:28.143574 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:27.932475 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:28.143574 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:27.940439 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": context deadline exceeded" Oct 31 01:13:28.143574 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:28.134688 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Oct 31 01:13:28.143574 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:28.134848 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:28.143574 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:28.134885 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:28.298577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:28.297979 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:28.307582 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:28.300624 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": context deadline exceeded" Oct 31 01:13:28.319584 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:28.310659 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Oct 31 01:13:28.319584 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:28.310715 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" podUID="2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Oct 31 01:13:28.326625 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:28.320840 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" podUID="bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Oct 31 01:13:28.368251 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:28.367383 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:28.394446 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:28.394358 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:28.469606 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:28.469257 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:13:28.469606 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:28.469368 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:13:28.679647 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:28.674570 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Oct 31 01:13:28.679647 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:28.674655 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" podUID="d88cf0ef-5780-485b-9984-e40c5040d5f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Oct 31 01:13:28.679647 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:28.676076 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Oct 31 01:13:28.679647 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:28.676126 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" podUID="fc1e8160-8f4e-4be3-96a9-b2d5b339959b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Oct 31 01:13:28.763771 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:28.763721 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Oct 31 01:13:28.764088 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:28.764060 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" podUID="2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Oct 31 01:13:28.853978 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:28.853941 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Oct 31 01:13:28.854260 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:28.854231 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" podUID="bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Oct 31 01:13:29.166584 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:29.166475 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:29.170579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:29.167506 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/health\": context deadline exceeded" Oct 31 01:13:29.170579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:29.167602 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": context deadline exceeded" Oct 31 01:13:29.245702 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:29.245655 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded" Oct 31 01:13:29.281701 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:29.281649 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:29.312088 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:29.300709 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:29.327621 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:29.312410 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:29.327621 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:29.315592 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:29.339117 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:29.339087 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:13:29.385530 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:29.385486 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:29.399672 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:29.399625 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:29.629173 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:29.629137 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Oct 31 01:13:29.634578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:29.630620 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" podUID="d88cf0ef-5780-485b-9984-e40c5040d5f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Oct 31 01:13:29.640519 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:29.640495 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:13:29.781598 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:29.740178 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:13:29.781598 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:29.742078 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Oct 31 01:13:29.781598 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:29.742123 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" podUID="2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Oct 31 01:13:29.883229 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:29.882328 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Oct 31 01:13:29.883229 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:29.882386 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" podUID="bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Oct 31 01:13:30.081584 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:30.077755 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Oct 31 01:13:30.081881 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:30.081847 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" podUID="fc1e8160-8f4e-4be3-96a9-b2d5b339959b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Oct 31 01:13:30.193051 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:30.191872 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded" Oct 31 01:13:30.193051 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:30.192084 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": context deadline exceeded" Oct 31 01:13:30.285281 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:30.284191 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded" Oct 31 01:13:30.310577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:30.309817 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:30.315826 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:30.315790 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:30.354725 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:30.354670 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:30.418211 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:30.417540 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:30.605801 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:30.605708 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Oct 31 01:13:30.606062 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:30.606024 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" podUID="d88cf0ef-5780-485b-9984-e40c5040d5f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Oct 31 01:13:30.670501 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:30.670461 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Oct 31 01:13:30.670808 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:30.670775 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" podUID="fc1e8160-8f4e-4be3-96a9-b2d5b339959b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Oct 31 01:13:30.749578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:30.740876 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:30.798578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:30.787471 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Oct 31 01:13:30.798578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:30.787537 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" podUID="2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Oct 31 01:13:30.854520 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:30.854051 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Oct 31 01:13:30.854520 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:30.854121 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" podUID="bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Oct 31 01:13:31.200588 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:31.199437 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:31.200588 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:31.199768 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded" Oct 31 01:13:31.259691 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:31.254711 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:31.275737 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:31.275692 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:31.289577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:31.285300 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:31.318572 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:31.313245 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": context deadline exceeded" Oct 31 01:13:31.320846 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:31.318957 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:31.393577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:31.369117 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:31.393577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:31.376183 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:13:31.414690 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:31.413678 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:13:31.424258 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:31.424205 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": context deadline exceeded" Oct 31 01:13:31.609814 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:31.606905 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Oct 31 01:13:31.609814 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:31.606960 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" podUID="d88cf0ef-5780-485b-9984-e40c5040d5f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Oct 31 01:13:31.680539 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:31.680504 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Oct 31 01:13:31.680837 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:31.680803 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" podUID="fc1e8160-8f4e-4be3-96a9-b2d5b339959b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Oct 31 01:13:31.891627 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:31.862685 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Oct 31 01:13:31.891627 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:31.862747 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" podUID="2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Oct 31 01:13:31.891627 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:31.865173 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:13:31.938578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:31.937452 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Oct 31 01:13:31.938578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:31.937522 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" podUID="bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Oct 31 01:13:31.995034 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:31.994893 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:13:32.011352 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:32.011323 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:13:32.088316 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:32.088278 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:13:32.176108 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:32.176028 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:13:32.208241 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:32.199643 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:32.296939 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:32.296902 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:13:32.660695 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:32.660664 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Oct 31 01:13:32.660964 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:32.660936 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" podUID="fc1e8160-8f4e-4be3-96a9-b2d5b339959b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Oct 31 01:13:32.750576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:32.750003 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Oct 31 01:13:32.750576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:32.750075 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" podUID="2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Oct 31 01:13:32.878882 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:32.875127 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Oct 31 01:13:32.878882 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:32.875192 5821 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" podUID="bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Oct 31 01:13:33.179882 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:33.179852 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:33.182039 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:33.182019 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:33.186564 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:33.186526 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:13:33.686928 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:33.686883 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:33.688831 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:33.688810 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:33.703586 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:33.699855 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:13:34.116956 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:34.116924 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:34.117411 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:34.117391 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:34.118383 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:34.118362 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:13:34.252070 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:34.252041 5821 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:34.253290 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:34.253267 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:34.254566 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:34.254535 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:13:39.141589 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:39.140895 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:39.185723 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:39.185675 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:39.253731 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:39.253650 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:39.275836 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:39.275753 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:39.290781 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:39.290741 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded" Oct 31 01:13:39.304916 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:39.300630 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:39.316579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:39.313639 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": context deadline exceeded" Oct 31 01:13:39.394759 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:39.394655 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:39.603576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:39.602694 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:39.788849 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:39.788746 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:40.020577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:40.014936 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:40.142912 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:40.142869 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:40.144275 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:40.144249 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:13:40.186818 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:40.186774 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:40.187791 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:40.187766 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:13:40.270704 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:40.270653 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded" Oct 31 01:13:40.285582 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:40.277143 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:13:40.327577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:40.300642 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:40.339708 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:40.306911 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:40.361711 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:40.312589 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": context deadline exceeded" Oct 31 01:13:40.361711 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:40.338725 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:13:40.361711 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:40.353806 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:13:40.361711 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:40.353867 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:13:40.517762 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:40.495668 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": context deadline exceeded" Oct 31 01:13:40.517762 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:40.496032 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:13:40.816751 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:40.816629 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:40.831234 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:40.818028 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:13:41.078729 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:41.066232 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded" Oct 31 01:13:41.258667 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:41.237605 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": context deadline exceeded" Oct 31 01:13:41.258667 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:41.238803 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded" Oct 31 01:13:41.258667 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:41.241207 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:13:41.281749 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:41.280992 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:41.334635 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:41.314662 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": context deadline exceeded" Oct 31 01:13:41.349785 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:41.349718 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded" Oct 31 01:13:41.371263 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:41.355688 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:41.399509 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:41.355746 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": context deadline exceeded" Oct 31 01:13:41.524960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:41.524597 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:41.830214 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:41.830162 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": context deadline exceeded" Oct 31 01:13:42.068685 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:42.068634 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded" Oct 31 01:13:42.263577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:42.261041 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:42.263577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:42.263068 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": context deadline exceeded" Oct 31 01:13:42.288576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:42.281736 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:42.363736 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:42.332930 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": context deadline exceeded" Oct 31 01:13:42.363736 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:42.333305 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:13:42.389641 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:42.376066 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded" Oct 31 01:13:42.389641 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:42.377239 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": context deadline exceeded" Oct 31 01:13:42.389641 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:42.377503 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": context deadline exceeded" Oct 31 01:13:42.569266 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:42.537486 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:42.885049 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:42.852625 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/health\": context deadline exceeded" Oct 31 01:13:42.885049 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:42.852957 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": context deadline exceeded" Oct 31 01:13:42.885452 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:42.885405 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:43.149635 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:43.143169 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded" Oct 31 01:13:43.263763 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:43.263710 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded" Oct 31 01:13:43.265117 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:43.265051 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:43.286980 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:43.286727 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:43.346994 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:43.346941 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:43.384057 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:43.384009 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": context deadline exceeded" Oct 31 01:13:43.384457 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:43.384316 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:43.385540 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:43.383966 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:43.705639 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:43.634067 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": context deadline exceeded" Oct 31 01:13:43.855753 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:43.855703 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:44.207807 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:44.207755 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:44.280098 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:44.269003 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:44.289731 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:44.277689 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:44.300674 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:44.300629 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:44.363464 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:44.348690 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:44.387594 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:44.387531 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:44.388275 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:44.388237 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:44.388792 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:44.388768 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded" Oct 31 01:13:45.021577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:45.020654 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:45.037007 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:45.035773 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:45.230750 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:45.230707 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:13:45.231081 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:45.231032 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" podUID="dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:45.235739 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:45.235698 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": context deadline exceeded" Oct 31 01:13:45.298163 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:45.298058 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:45.315330 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:45.313838 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded" Oct 31 01:13:45.317543 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:45.314994 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded" Oct 31 01:13:45.317543 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:45.315022 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": context deadline exceeded" Oct 31 01:13:45.366492 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:45.365678 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": context deadline exceeded" Oct 31 01:13:45.403260 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:45.392010 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:45.403260 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:45.392406 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": context deadline exceeded" Oct 31 01:13:45.403260 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:45.392693 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:45.980444 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:45.980400 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:13:45.980788 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:45.980759 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" podUID="8f24afcc-82f0-4d26-bf4d-4969762ede4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:46.027171 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.027124 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": context deadline exceeded" Oct 31 01:13:46.039899 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.039857 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:46.150607 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.142667 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:13:46.150607 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.142735 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" podUID="8900532b-edb2-4cf6-bc7c-d6f60473221c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:46.157299 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.157251 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:46.217343 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.217301 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:13:46.217531 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.217369 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" podUID="2e88678f-d491-46fa-839c-913ffe8a0a6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:46.312633 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.309168 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:13:46.312633 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.309238 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" podUID="53e0539d-33d9-4c6c-afb8-0e67e95e18d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:46.339225 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.338642 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded" Oct 31 01:13:46.339854 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.339820 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded" Oct 31 01:13:46.391983 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.340046 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": context deadline exceeded" Oct 31 01:13:46.391983 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.340091 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded" Oct 31 01:13:46.391983 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.381783 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:46.391983 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.382161 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": context deadline exceeded" Oct 31 01:13:46.393440 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.392515 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:46.393440 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.392883 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded" Oct 31 01:13:46.393440 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.393196 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": context deadline exceeded" Oct 31 01:13:46.484582 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.483712 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:13:46.484582 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.483781 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" podUID="74944bd5-3fcb-48a6-a208-6f17f70df82b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:46.567792 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.567698 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:13:46.568473 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.568080 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" podUID="876007f4-ecc5-469f-addd-8e76a84257e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:46.593591 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.581710 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz"] Oct 31 01:13:46.813614 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.813584 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:13:46.834697 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.827409 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:13:46.834697 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:46.827490 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" podUID="17283d64-4c76-433f-9a21-d6de6ab9e470" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:47.060634 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:47.060167 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:47.065569 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:47.063282 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:13:47.073479 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:47.071500 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:13:47.104417 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:47.103608 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:13:47.123609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:47.122630 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:13:47.190902 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:47.190869 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:13:47.208242 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:47.206229 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:13:47.270466 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:47.270436 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:13:47.309722 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:13:47.309680 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:13:47.312945 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:47.312919 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:13:47.317218 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:47.317184 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:13:47.325068 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:13:47.325048 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:14:01.866810 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:01.866746 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" containerID="cri-o://8b3a9c727bb5172015f817487e48780ca2eb68287f3f621bea472fa31a698565" gracePeriod=45 Oct 31 01:14:02.162026 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.161990 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:14:02.199979 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.199948 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-tls-certs\" (UniqueName: \"kubernetes.io/secret/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-tls-certs\") pod \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " Oct 31 01:14:02.200239 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.200210 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-tmp-dir\") pod \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " Oct 31 01:14:02.200565 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.200523 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-tmp-dir" pod "1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" (UID: "1dd9865a-0dd7-46da-997d-3ed1ea8f99bf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:02.200873 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.200847 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-model-cache" pod "1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" (UID: "1dd9865a-0dd7-46da-997d-3ed1ea8f99bf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:02.200974 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.200646 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-model-cache\") pod \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " Oct 31 01:14:02.200974 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.200969 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-dshm\") pod \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " Oct 31 01:14:02.201147 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.201128 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-kube-api-access-n452q\" (UniqueName: \"kubernetes.io/projected/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-kube-api-access-n452q\") pod \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " Oct 31 01:14:02.201231 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.201217 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-home\" (UniqueName: \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-home\") pod \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\" (UID: \"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf\") " Oct 31 01:14:02.201919 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.201890 5821 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-tmp-dir\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:02.201919 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.201917 5821 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-model-cache\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:02.202141 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.202122 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-home" pod "1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" (UID: "1dd9865a-0dd7-46da-997d-3ed1ea8f99bf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:02.206285 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.205672 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-dshm" pod "1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" (UID: "1dd9865a-0dd7-46da-997d-3ed1ea8f99bf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:02.206285 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.205681 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-tls-certs" pod "1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" (UID: "1dd9865a-0dd7-46da-997d-3ed1ea8f99bf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:14:02.208066 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.208038 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-kube-api-access-n452q" pod "1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" (UID: "1dd9865a-0dd7-46da-997d-3ed1ea8f99bf"). InnerVolumeSpecName "kube-api-access-n452q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:02.303468 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.303428 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n452q\" (UniqueName: \"kubernetes.io/projected/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-kube-api-access-n452q\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:02.306986 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.306955 5821 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-home\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:02.306986 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.306985 5821 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-tls-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:02.307142 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.306999 5821 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf-dshm\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:02.431060 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.430970 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f"] Oct 31 01:14:02.645924 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.645886 5821 generic.go:356] "Generic (PLEG): container finished" podID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerID="8b3a9c727bb5172015f817487e48780ca2eb68287f3f621bea472fa31a698565" exitCode=0 Oct 31 01:14:02.646198 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.646174 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" event={"ID":"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf","Type":"ContainerDied","Data":"8b3a9c727bb5172015f817487e48780ca2eb68287f3f621bea472fa31a698565"} Oct 31 01:14:02.646328 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.646313 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" event={"ID":"1dd9865a-0dd7-46da-997d-3ed1ea8f99bf","Type":"ContainerDied","Data":"ba3f70df8f624fd275f3ce24bdb250a57c2464d96a1be60f271660f60da07493"} Oct 31 01:14:02.646642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.646481 5821 scope.go:122] "RemoveContainer" containerID="8b3a9c727bb5172015f817487e48780ca2eb68287f3f621bea472fa31a698565" Oct 31 01:14:02.646842 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.646569 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" Oct 31 01:14:02.680438 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.679843 5821 scope.go:122] "RemoveContainer" containerID="8b3a9c727bb5172015f817487e48780ca2eb68287f3f621bea472fa31a698565" Oct 31 01:14:02.688040 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:14:02.682054 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b3a9c727bb5172015f817487e48780ca2eb68287f3f621bea472fa31a698565\": container with ID starting with 8b3a9c727bb5172015f817487e48780ca2eb68287f3f621bea472fa31a698565 not found: ID does not exist" containerID="8b3a9c727bb5172015f817487e48780ca2eb68287f3f621bea472fa31a698565" Oct 31 01:14:02.688040 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.682096 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b3a9c727bb5172015f817487e48780ca2eb68287f3f621bea472fa31a698565"} err="failed to get container status \"8b3a9c727bb5172015f817487e48780ca2eb68287f3f621bea472fa31a698565\": rpc error: code = NotFound desc = could not find container \"8b3a9c727bb5172015f817487e48780ca2eb68287f3f621bea472fa31a698565\": container with ID starting with 8b3a9c727bb5172015f817487e48780ca2eb68287f3f621bea472fa31a698565 not found: ID does not exist" Oct 31 01:14:02.695604 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.695543 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz"] Oct 31 01:14:02.700474 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:02.700442 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz"] Oct 31 01:14:03.064835 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:03.064752 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1b8d05/simulator-w6-1b8d05-kserve-6bb8f775d5-qnrzz" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:03.567632 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:03.567595 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" path="/var/lib/kubelet/pods/1dd9865a-0dd7-46da-997d-3ed1ea8f99bf/volumes" Oct 31 01:14:08.792063 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:08.791936 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4"] Oct 31 01:14:12.859632 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:12.858406 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": context deadline exceeded" Oct 31 01:14:13.072573 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:13.071685 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded" Oct 31 01:14:13.264620 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:13.260033 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:13.284221 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:13.283215 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded" Oct 31 01:14:13.305028 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:13.304948 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:13.387718 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:13.387666 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:13.389795 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:13.387969 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:13.390873 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:13.388010 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:14.074577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:14.073653 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:14.075126 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:14.074609 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:14:14.349670 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:14.332317 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": context deadline exceeded" Oct 31 01:14:14.349670 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:14.333089 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:14:14.349670 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:14.333373 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded" Oct 31 01:14:14.349670 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:14.333693 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:14:14.349670 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:14.334603 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:14.349670 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:14.334926 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:14:14.404599 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:14.372026 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:14.404599 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:14.402168 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:14.404599 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:14.402852 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:14:14.404599 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:14.403712 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:14.404599 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:14.404033 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": context deadline exceeded" Oct 31 01:14:14.406262 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:14.405127 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:14:14.406262 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:14.405188 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:14:14.512579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:14.488858 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:14:14.861462 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:14.859656 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:15.228887 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:15.228753 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:14:15.229474 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:15.229434 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" podUID="dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:15.397624 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:15.397569 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:15.454577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:15.403187 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:15.472960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:15.472911 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": context deadline exceeded" Oct 31 01:14:15.473422 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:15.473392 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:15.475248 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:15.475225 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:14:15.517110 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:15.517013 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:15.519049 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:15.519015 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": context deadline exceeded" Oct 31 01:14:15.543307 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:15.543245 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded" Oct 31 01:14:15.546581 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:15.544063 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:15.885579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:15.870604 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:15.920086 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:15.920051 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:14:15.920864 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:15.920839 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:14:16.015928 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.015881 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:14:16.016264 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.016236 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" podUID="8f24afcc-82f0-4d26-bf4d-4969762ede4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:16.166276 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.166184 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:16.262911 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.252656 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:14:16.262911 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.252747 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" podUID="2e88678f-d491-46fa-839c-913ffe8a0a6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:16.408792 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.408729 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": context deadline exceeded" Oct 31 01:14:16.413587 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.411216 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/health\": context deadline exceeded" Oct 31 01:14:16.487629 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.473633 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:16.487629 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.474624 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:16.533589 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.521925 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:16.533589 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.522264 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:16.546702 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.546658 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded" Oct 31 01:14:16.569577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.546861 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:16.891579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.867978 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:14:16.891579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.868221 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" podUID="34724cef-6f8d-4da1-9312-7b85f4814d52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:16.891579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.870808 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": context deadline exceeded" Oct 31 01:14:16.892128 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.891979 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:14:16.892128 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.892045 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" podUID="17283d64-4c76-433f-9a21-d6de6ab9e470" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:16.898761 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.898723 5821 patch_prober.go:29] interesting pod/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:14:16.906578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.902629 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" podUID="4e8db137-6e00-4d6a-9f9f-9e4df9a71328" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:16.916681 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.915911 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:14:16.916681 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:16.915986 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" podUID="6106bf2d-96d6-4452-a356-dd23d3de4087" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:17.148882 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.148796 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9"] Oct 31 01:14:17.149320 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.149285 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" podUID="4e8db137-6e00-4d6a-9f9f-9e4df9a71328" containerName="istio-proxy" containerID="cri-o://000152a67ffb63ce731d9cf908d9df301dcc9b5d986a3b51871ad0f4b7591efe" gracePeriod=30 Oct 31 01:14:17.216813 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.216777 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569"] Oct 31 01:14:17.217290 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.217255 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" podUID="8f24afcc-82f0-4d26-bf4d-4969762ede4d" containerName="istio-proxy" containerID="cri-o://270cc31e6605e939672bb5fd1e25c4185242ee84b253f60e0b1fcfa79e0481c5" gracePeriod=30 Oct 31 01:14:17.249165 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.249104 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:17.273422 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.273383 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj"] Oct 31 01:14:17.274304 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.274267 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" podUID="17283d64-4c76-433f-9a21-d6de6ab9e470" containerName="istio-proxy" containerID="cri-o://5fea23b22898a0d7773a92047bb3eddd5b72e11e53ea249d36527d124f6650a7" gracePeriod=30 Oct 31 01:14:17.408930 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.408765 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:17.448574 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.409167 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": context deadline exceeded" Oct 31 01:14:17.489588 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.477651 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:17.489588 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.478497 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded" Oct 31 01:14:17.530574 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.500704 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:14:17.530574 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.500771 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" podUID="d34c9445-cbcd-4f23-b685-f0edc29d2301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:17.530574 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.530096 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:17.558580 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.531879 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:17.558580 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.543933 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:14:17.558580 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.545228 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" containerID="cri-o://128bf8ab6df8fe8404131d2310450ea82b9355c439aee71c74b84992ed5db3f4" gracePeriod=45 Oct 31 01:14:17.558580 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.547120 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:17.590709 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.590659 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:17.685795 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.680644 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:14:17.685795 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.680717 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" podUID="6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:17.897583 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.877578 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": context deadline exceeded" Oct 31 01:14:17.981650 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:14:17.976943 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:14:17.981650 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.979978 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:14:17.998131 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:17.998004 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/health\": context deadline exceeded" Oct 31 01:14:18.261005 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:18.260906 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:18.296702 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:18.296657 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:14:18.350851 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:18.350810 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": dial tcp 10.132.0.51:8000: connect: connection refused" Oct 31 01:14:18.482885 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:18.470598 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:18.536060 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:18.477453 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:14:18.536775 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:18.477820 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:18.556612 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:18.521660 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:18.556612 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:18.534699 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:18.646579 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:18.643345 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded" Oct 31 01:14:18.791255 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:18.791154 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded" Oct 31 01:14:19.193448 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:19.193406 5821 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/health\": context deadline exceeded" Oct 31 01:14:19.246976 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:19.246930 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": dial tcp 10.132.0.51:8000: connect: connection refused" Oct 31 01:14:19.319865 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:19.319831 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:14:19.431602 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:19.416169 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:14:19.538775 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:19.538669 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:19.560436 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:19.555431 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:19.676577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:19.650987 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:19.747059 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:19.746000 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:14:19.785598 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:19.756698 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:19.968804 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:19.966647 5821 patch_prober.go:29] interesting pod/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:14:19.968804 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:19.966713 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" podUID="fc1e8160-8f4e-4be3-96a9-b2d5b339959b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:20.090776 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.090694 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:14:20.103800 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.103748 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:14:20.150619 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.150586 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:14:20.150886 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.150857 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" podUID="bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:20.252511 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.252465 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": dial tcp 10.132.0.51:8000: connect: connection refused" Oct 31 01:14:20.317411 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.317381 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:14:20.461048 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.461009 5821 generic.go:356] "Generic (PLEG): container finished" podID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerID="128bf8ab6df8fe8404131d2310450ea82b9355c439aee71c74b84992ed5db3f4" exitCode=0 Oct 31 01:14:20.461476 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.461176 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" event={"ID":"115b8c20-dcea-4cbd-aeee-c3f93f159685","Type":"ContainerDied","Data":"128bf8ab6df8fe8404131d2310450ea82b9355c439aee71c74b84992ed5db3f4"} Oct 31 01:14:20.649847 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.649816 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:14:20.765657 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.765565 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/115b8c20-dcea-4cbd-aeee-c3f93f159685-kube-api-access-gv8gr\" (UniqueName: \"kubernetes.io/projected/115b8c20-dcea-4cbd-aeee-c3f93f159685-kube-api-access-gv8gr\") pod \"115b8c20-dcea-4cbd-aeee-c3f93f159685\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " Oct 31 01:14:20.765657 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.765638 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-tmp-dir\") pod \"115b8c20-dcea-4cbd-aeee-c3f93f159685\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " Oct 31 01:14:20.765886 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.765750 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-model-cache\") pod \"115b8c20-dcea-4cbd-aeee-c3f93f159685\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " Oct 31 01:14:20.765886 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.765871 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-dshm\" (UniqueName: \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-dshm\") pod \"115b8c20-dcea-4cbd-aeee-c3f93f159685\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " Oct 31 01:14:20.765988 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.765894 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/115b8c20-dcea-4cbd-aeee-c3f93f159685-tls-certs\" (UniqueName: \"kubernetes.io/secret/115b8c20-dcea-4cbd-aeee-c3f93f159685-tls-certs\") pod \"115b8c20-dcea-4cbd-aeee-c3f93f159685\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " Oct 31 01:14:20.765988 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.765943 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-tmp-dir" pod "115b8c20-dcea-4cbd-aeee-c3f93f159685" (UID: "115b8c20-dcea-4cbd-aeee-c3f93f159685"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:20.766113 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.766068 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-home\" (UniqueName: \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-home\") pod \"115b8c20-dcea-4cbd-aeee-c3f93f159685\" (UID: \"115b8c20-dcea-4cbd-aeee-c3f93f159685\") " Oct 31 01:14:20.766211 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.766182 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-model-cache" pod "115b8c20-dcea-4cbd-aeee-c3f93f159685" (UID: "115b8c20-dcea-4cbd-aeee-c3f93f159685"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:20.766817 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.766792 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-home" pod "115b8c20-dcea-4cbd-aeee-c3f93f159685" (UID: "115b8c20-dcea-4cbd-aeee-c3f93f159685"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:20.767323 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.767297 5821 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-home\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:20.767432 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.767353 5821 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-tmp-dir\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:20.767432 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.767369 5821 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-model-cache\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:20.768367 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.768339 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-dshm" pod "115b8c20-dcea-4cbd-aeee-c3f93f159685" (UID: "115b8c20-dcea-4cbd-aeee-c3f93f159685"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:20.768607 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.768583 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/115b8c20-dcea-4cbd-aeee-c3f93f159685-tls-certs" pod "115b8c20-dcea-4cbd-aeee-c3f93f159685" (UID: "115b8c20-dcea-4cbd-aeee-c3f93f159685"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:14:20.768698 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.768673 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/115b8c20-dcea-4cbd-aeee-c3f93f159685-kube-api-access-gv8gr" pod "115b8c20-dcea-4cbd-aeee-c3f93f159685" (UID: "115b8c20-dcea-4cbd-aeee-c3f93f159685"). InnerVolumeSpecName "kube-api-access-gv8gr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:20.877575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.877012 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gv8gr\" (UniqueName: \"kubernetes.io/projected/115b8c20-dcea-4cbd-aeee-c3f93f159685-kube-api-access-gv8gr\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:20.877575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.877052 5821 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/115b8c20-dcea-4cbd-aeee-c3f93f159685-dshm\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:20.877575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:20.877067 5821 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/115b8c20-dcea-4cbd-aeee-c3f93f159685-tls-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:21.469645 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:21.469603 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" event={"ID":"115b8c20-dcea-4cbd-aeee-c3f93f159685","Type":"ContainerDied","Data":"a97a9d1b3be7082b63c5e7324eec562332b15f86a263059cab15e3ec95603677"} Oct 31 01:14:21.469645 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:21.469626 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f" Oct 31 01:14:21.470191 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:21.469665 5821 scope.go:122] "RemoveContainer" containerID="128bf8ab6df8fe8404131d2310450ea82b9355c439aee71c74b84992ed5db3f4" Oct 31 01:14:21.505246 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:21.505215 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f"] Oct 31 01:14:21.508699 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:21.508675 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-0a6cca/premium-w2-0a6cca-kserve-6b4667f64d-8np7f"] Oct 31 01:14:21.569105 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:21.569074 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" path="/var/lib/kubelet/pods/115b8c20-dcea-4cbd-aeee-c3f93f159685/volumes" Oct 31 01:14:22.263609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:22.254011 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm"] Oct 31 01:14:22.263609 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:22.254622 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" podUID="ca001694-4577-4273-84de-8ae4bd47c12e" containerName="maas-api" containerID="cri-o://a516d1cc579d8f6886847b9905ba0164774c8c6896abf98d8d601986d0a4cb3e" gracePeriod=30 Oct 31 01:14:22.620901 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:22.620842 5821 generic.go:356] "Generic (PLEG): container finished" podID="ca001694-4577-4273-84de-8ae4bd47c12e" containerID="a516d1cc579d8f6886847b9905ba0164774c8c6896abf98d8d601986d0a4cb3e" exitCode=0 Oct 31 01:14:22.621400 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:22.621059 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" event={"ID":"ca001694-4577-4273-84de-8ae4bd47c12e","Type":"ContainerDied","Data":"a516d1cc579d8f6886847b9905ba0164774c8c6896abf98d8d601986d0a4cb3e"} Oct 31 01:14:22.952701 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:22.952668 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" Oct 31 01:14:23.065167 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.063429 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ca001694-4577-4273-84de-8ae4bd47c12e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca001694-4577-4273-84de-8ae4bd47c12e-openshift-service-ca\") pod \"ca001694-4577-4273-84de-8ae4bd47c12e\" (UID: \"ca001694-4577-4273-84de-8ae4bd47c12e\") " Oct 31 01:14:23.065167 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.063496 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ca001694-4577-4273-84de-8ae4bd47c12e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca001694-4577-4273-84de-8ae4bd47c12e-metrics-certs\") pod \"ca001694-4577-4273-84de-8ae4bd47c12e\" (UID: \"ca001694-4577-4273-84de-8ae4bd47c12e\") " Oct 31 01:14:23.065167 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.063662 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ca001694-4577-4273-84de-8ae4bd47c12e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca001694-4577-4273-84de-8ae4bd47c12e-maas-api-tls\") pod \"ca001694-4577-4273-84de-8ae4bd47c12e\" (UID: \"ca001694-4577-4273-84de-8ae4bd47c12e\") " Oct 31 01:14:23.065167 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.063765 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ca001694-4577-4273-84de-8ae4bd47c12e-kube-api-access-5l6xl\" (UniqueName: \"kubernetes.io/projected/ca001694-4577-4273-84de-8ae4bd47c12e-kube-api-access-5l6xl\") pod \"ca001694-4577-4273-84de-8ae4bd47c12e\" (UID: \"ca001694-4577-4273-84de-8ae4bd47c12e\") " Oct 31 01:14:23.066922 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.066892 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca001694-4577-4273-84de-8ae4bd47c12e-openshift-service-ca" pod "ca001694-4577-4273-84de-8ae4bd47c12e" (UID: "ca001694-4577-4273-84de-8ae4bd47c12e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:14:23.074537 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.074470 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca001694-4577-4273-84de-8ae4bd47c12e-metrics-certs" pod "ca001694-4577-4273-84de-8ae4bd47c12e" (UID: "ca001694-4577-4273-84de-8ae4bd47c12e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:14:23.081869 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.081821 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca001694-4577-4273-84de-8ae4bd47c12e-maas-api-tls" pod "ca001694-4577-4273-84de-8ae4bd47c12e" (UID: "ca001694-4577-4273-84de-8ae4bd47c12e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:14:23.091788 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.091723 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca001694-4577-4273-84de-8ae4bd47c12e-kube-api-access-5l6xl" pod "ca001694-4577-4273-84de-8ae4bd47c12e" (UID: "ca001694-4577-4273-84de-8ae4bd47c12e"). InnerVolumeSpecName "kube-api-access-5l6xl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:23.165956 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.165886 5821 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca001694-4577-4273-84de-8ae4bd47c12e-openshift-service-ca\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:23.165956 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.165924 5821 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca001694-4577-4273-84de-8ae4bd47c12e-metrics-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:23.165956 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.165934 5821 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca001694-4577-4273-84de-8ae4bd47c12e-maas-api-tls\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:23.165956 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.165943 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l6xl\" (UniqueName: \"kubernetes.io/projected/ca001694-4577-4273-84de-8ae4bd47c12e-kube-api-access-5l6xl\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:23.166200 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.166153 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:14:23.267071 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.267032 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-credential-socket\") pod \"17283d64-4c76-433f-9a21-d6de6ab9e470\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " Oct 31 01:14:23.267447 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.267401 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-workload-socket\") pod \"17283d64-4c76-433f-9a21-d6de6ab9e470\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " Oct 31 01:14:23.268122 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.268101 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/17283d64-4c76-433f-9a21-d6de6ab9e470-kube-api-access-44bd9\" (UniqueName: \"kubernetes.io/projected/17283d64-4c76-433f-9a21-d6de6ab9e470-kube-api-access-44bd9\") pod \"17283d64-4c76-433f-9a21-d6de6ab9e470\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " Oct 31 01:14:23.268836 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.267715 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-credential-socket" pod "17283d64-4c76-433f-9a21-d6de6ab9e470" (UID: "17283d64-4c76-433f-9a21-d6de6ab9e470"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:23.268836 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.267866 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-workload-socket" pod "17283d64-4c76-433f-9a21-d6de6ab9e470" (UID: "17283d64-4c76-433f-9a21-d6de6ab9e470"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:23.269366 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.269338 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17283d64-4c76-433f-9a21-d6de6ab9e470-istiod-ca-cert" pod "17283d64-4c76-433f-9a21-d6de6ab9e470" (UID: "17283d64-4c76-433f-9a21-d6de6ab9e470"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:14:23.269467 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.269378 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/17283d64-4c76-433f-9a21-d6de6ab9e470-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17283d64-4c76-433f-9a21-d6de6ab9e470-istiod-ca-cert\") pod \"17283d64-4c76-433f-9a21-d6de6ab9e470\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " Oct 31 01:14:23.269467 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.269440 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-token\" (UniqueName: \"kubernetes.io/projected/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-token\") pod \"17283d64-4c76-433f-9a21-d6de6ab9e470\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " Oct 31 01:14:23.269719 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.269478 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-envoy\") pod \"17283d64-4c76-433f-9a21-d6de6ab9e470\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " Oct 31 01:14:23.269719 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.269515 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-data\") pod \"17283d64-4c76-433f-9a21-d6de6ab9e470\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " Oct 31 01:14:23.269846 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.269817 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-workload-certs\") pod \"17283d64-4c76-433f-9a21-d6de6ab9e470\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " Oct 31 01:14:23.269908 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.269870 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-podinfo\") pod \"17283d64-4c76-433f-9a21-d6de6ab9e470\" (UID: \"17283d64-4c76-433f-9a21-d6de6ab9e470\") " Oct 31 01:14:23.295715 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.279355 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:23.295715 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.279401 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:23.295715 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.279426 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17283d64-4c76-433f-9a21-d6de6ab9e470-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:23.295715 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.279990 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-data" pod "17283d64-4c76-433f-9a21-d6de6ab9e470" (UID: "17283d64-4c76-433f-9a21-d6de6ab9e470"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:23.295715 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.280188 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-workload-certs" pod "17283d64-4c76-433f-9a21-d6de6ab9e470" (UID: "17283d64-4c76-433f-9a21-d6de6ab9e470"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:23.323964 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.323884 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-token" pod "17283d64-4c76-433f-9a21-d6de6ab9e470" (UID: "17283d64-4c76-433f-9a21-d6de6ab9e470"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:23.331809 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.331750 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-envoy" pod "17283d64-4c76-433f-9a21-d6de6ab9e470" (UID: "17283d64-4c76-433f-9a21-d6de6ab9e470"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:23.332170 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.332117 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-podinfo" pod "17283d64-4c76-433f-9a21-d6de6ab9e470" (UID: "17283d64-4c76-433f-9a21-d6de6ab9e470"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:14:23.332897 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.332805 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17283d64-4c76-433f-9a21-d6de6ab9e470-kube-api-access-44bd9" pod "17283d64-4c76-433f-9a21-d6de6ab9e470" (UID: "17283d64-4c76-433f-9a21-d6de6ab9e470"). InnerVolumeSpecName "kube-api-access-44bd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:23.387330 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.382960 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:23.387330 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.383004 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:23.387330 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.383019 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44bd9\" (UniqueName: \"kubernetes.io/projected/17283d64-4c76-433f-9a21-d6de6ab9e470-kube-api-access-44bd9\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:23.387330 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.383034 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:23.387330 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.383049 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:23.387330 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.383063 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17283d64-4c76-433f-9a21-d6de6ab9e470-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:23.774529 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.774451 5821 generic.go:356] "Generic (PLEG): container finished" podID="17283d64-4c76-433f-9a21-d6de6ab9e470" containerID="5fea23b22898a0d7773a92047bb3eddd5b72e11e53ea249d36527d124f6650a7" exitCode=0 Oct 31 01:14:23.775077 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.774870 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" Oct 31 01:14:23.783737 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.783701 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" event={"ID":"17283d64-4c76-433f-9a21-d6de6ab9e470","Type":"ContainerDied","Data":"5fea23b22898a0d7773a92047bb3eddd5b72e11e53ea249d36527d124f6650a7"} Oct 31 01:14:23.783960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.783941 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj" event={"ID":"17283d64-4c76-433f-9a21-d6de6ab9e470","Type":"ContainerDied","Data":"dcf3b1b3ee1492905f9913c08495eaf30aa37be1dbd78621e48dc6b6e051ec48"} Oct 31 01:14:23.784086 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.784072 5821 scope.go:122] "RemoveContainer" containerID="5fea23b22898a0d7773a92047bb3eddd5b72e11e53ea249d36527d124f6650a7" Oct 31 01:14:23.784881 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.784851 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" event={"ID":"ca001694-4577-4273-84de-8ae4bd47c12e","Type":"ContainerDied","Data":"e6bdfab08f2ff38e6e34eabb2fb36a26f42076cdb985d6cd1c8c7d372b2186f7"} Oct 31 01:14:23.785004 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.784984 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm" Oct 31 01:14:23.794306 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.794200 5821 generic.go:356] "Generic (PLEG): container finished" podID="8f24afcc-82f0-4d26-bf4d-4969762ede4d" containerID="270cc31e6605e939672bb5fd1e25c4185242ee84b253f60e0b1fcfa79e0481c5" exitCode=0 Oct 31 01:14:23.794306 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.794260 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" event={"ID":"8f24afcc-82f0-4d26-bf4d-4969762ede4d","Type":"ContainerDied","Data":"270cc31e6605e939672bb5fd1e25c4185242ee84b253f60e0b1fcfa79e0481c5"} Oct 31 01:14:23.812890 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.812868 5821 scope.go:122] "RemoveContainer" containerID="5fea23b22898a0d7773a92047bb3eddd5b72e11e53ea249d36527d124f6650a7" Oct 31 01:14:23.813341 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:14:23.813313 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fea23b22898a0d7773a92047bb3eddd5b72e11e53ea249d36527d124f6650a7\": container with ID starting with 5fea23b22898a0d7773a92047bb3eddd5b72e11e53ea249d36527d124f6650a7 not found: ID does not exist" containerID="5fea23b22898a0d7773a92047bb3eddd5b72e11e53ea249d36527d124f6650a7" Oct 31 01:14:23.813396 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.813356 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fea23b22898a0d7773a92047bb3eddd5b72e11e53ea249d36527d124f6650a7"} err="failed to get container status \"5fea23b22898a0d7773a92047bb3eddd5b72e11e53ea249d36527d124f6650a7\": rpc error: code = NotFound desc = could not find container \"5fea23b22898a0d7773a92047bb3eddd5b72e11e53ea249d36527d124f6650a7\": container with ID starting with 5fea23b22898a0d7773a92047bb3eddd5b72e11e53ea249d36527d124f6650a7 not found: ID does not exist" Oct 31 01:14:23.813396 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.813381 5821 scope.go:122] "RemoveContainer" containerID="a516d1cc579d8f6886847b9905ba0164774c8c6896abf98d8d601986d0a4cb3e" Oct 31 01:14:23.822468 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.822445 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj"] Oct 31 01:14:23.825546 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.825517 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-qvztj"] Oct 31 01:14:23.852524 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.852499 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:14:23.856072 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.856043 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm"] Oct 31 01:14:23.859954 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.859926 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-0a6cca-7b56c9584c-shgxm"] Oct 31 01:14:23.898110 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.898058 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" containerID="cri-o://ffe48edf7e21b6c7efaed1d7f71bf5e39740f599b8e32f9bb0a716c2d3b263b0" gracePeriod=45 Oct 31 01:14:23.968602 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.968512 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-credential-socket\") pod \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " Oct 31 01:14:23.968747 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.968729 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8f24afcc-82f0-4d26-bf4d-4969762ede4d-kube-api-access-rxvdh\" (UniqueName: \"kubernetes.io/projected/8f24afcc-82f0-4d26-bf4d-4969762ede4d-kube-api-access-rxvdh\") pod \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " Oct 31 01:14:23.968808 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.968772 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-token\" (UniqueName: \"kubernetes.io/projected/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-token\") pod \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " Oct 31 01:14:23.968808 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.968774 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-credential-socket" pod "8f24afcc-82f0-4d26-bf4d-4969762ede4d" (UID: "8f24afcc-82f0-4d26-bf4d-4969762ede4d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:23.968917 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.968828 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-data\") pod \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " Oct 31 01:14:23.969962 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.968912 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-podinfo\") pod \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " Oct 31 01:14:23.969962 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.968954 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-workload-socket\") pod \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " Oct 31 01:14:23.969962 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.968984 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-workload-certs\") pod \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " Oct 31 01:14:23.969962 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.969075 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istiod-ca-cert\") pod \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " Oct 31 01:14:23.969962 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.969146 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-envoy\") pod \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\" (UID: \"8f24afcc-82f0-4d26-bf4d-4969762ede4d\") " Oct 31 01:14:23.969962 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.969413 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-workload-socket" pod "8f24afcc-82f0-4d26-bf4d-4969762ede4d" (UID: "8f24afcc-82f0-4d26-bf4d-4969762ede4d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:23.970618 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.970363 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:23.970618 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.970389 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:23.977727 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.977688 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-envoy" pod "8f24afcc-82f0-4d26-bf4d-4969762ede4d" (UID: "8f24afcc-82f0-4d26-bf4d-4969762ede4d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:23.977944 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.977923 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-workload-certs" pod "8f24afcc-82f0-4d26-bf4d-4969762ede4d" (UID: "8f24afcc-82f0-4d26-bf4d-4969762ede4d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:23.978262 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.978218 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istiod-ca-cert" pod "8f24afcc-82f0-4d26-bf4d-4969762ede4d" (UID: "8f24afcc-82f0-4d26-bf4d-4969762ede4d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:14:23.978262 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.978198 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-token" pod "8f24afcc-82f0-4d26-bf4d-4969762ede4d" (UID: "8f24afcc-82f0-4d26-bf4d-4969762ede4d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:23.980068 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.980040 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-data" pod "8f24afcc-82f0-4d26-bf4d-4969762ede4d" (UID: "8f24afcc-82f0-4d26-bf4d-4969762ede4d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:23.980068 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.980453 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f24afcc-82f0-4d26-bf4d-4969762ede4d-kube-api-access-rxvdh" pod "8f24afcc-82f0-4d26-bf4d-4969762ede4d" (UID: "8f24afcc-82f0-4d26-bf4d-4969762ede4d"). InnerVolumeSpecName "kube-api-access-rxvdh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:23.983241 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:23.983206 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-podinfo" pod "8f24afcc-82f0-4d26-bf4d-4969762ede4d" (UID: "8f24afcc-82f0-4d26-bf4d-4969762ede4d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:14:24.071646 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.071607 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.071646 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.071642 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.071899 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.071658 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxvdh\" (UniqueName: \"kubernetes.io/projected/8f24afcc-82f0-4d26-bf4d-4969762ede4d-kube-api-access-rxvdh\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.071899 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.071671 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.071899 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.071683 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.071899 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.071695 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f24afcc-82f0-4d26-bf4d-4969762ede4d-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.071899 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.071706 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f24afcc-82f0-4d26-bf4d-4969762ede4d-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.425848 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.425815 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:14:24.608131 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.608036 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-dshm\") pod \"c8595d89-40e5-4246-925f-cfa9b42e2a11\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " Oct 31 01:14:24.627901 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.627866 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-model-cache\") pod \"c8595d89-40e5-4246-925f-cfa9b42e2a11\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " Oct 31 01:14:24.628185 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.628166 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-tmp-dir\") pod \"c8595d89-40e5-4246-925f-cfa9b42e2a11\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " Oct 31 01:14:24.628333 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.628317 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-home\" (UniqueName: \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-home\") pod \"c8595d89-40e5-4246-925f-cfa9b42e2a11\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " Oct 31 01:14:24.628489 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.628438 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c8595d89-40e5-4246-925f-cfa9b42e2a11-tls-certs\" (UniqueName: \"kubernetes.io/secret/c8595d89-40e5-4246-925f-cfa9b42e2a11-tls-certs\") pod \"c8595d89-40e5-4246-925f-cfa9b42e2a11\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " Oct 31 01:14:24.628785 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.628767 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8595d89-40e5-4246-925f-cfa9b42e2a11-kube-api-access-7hszr\" (UniqueName: \"kubernetes.io/projected/c8595d89-40e5-4246-925f-cfa9b42e2a11-kube-api-access-7hszr\") pod \"c8595d89-40e5-4246-925f-cfa9b42e2a11\" (UID: \"c8595d89-40e5-4246-925f-cfa9b42e2a11\") " Oct 31 01:14:24.628884 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.628851 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-dshm" pod "c8595d89-40e5-4246-925f-cfa9b42e2a11" (UID: "c8595d89-40e5-4246-925f-cfa9b42e2a11"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:24.651689 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.629584 5821 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-dshm\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.651689 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.630170 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-home" pod "c8595d89-40e5-4246-925f-cfa9b42e2a11" (UID: "c8595d89-40e5-4246-925f-cfa9b42e2a11"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:24.651689 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.649655 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-model-cache" pod "c8595d89-40e5-4246-925f-cfa9b42e2a11" (UID: "c8595d89-40e5-4246-925f-cfa9b42e2a11"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:24.675732 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.658364 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-tmp-dir" pod "c8595d89-40e5-4246-925f-cfa9b42e2a11" (UID: "c8595d89-40e5-4246-925f-cfa9b42e2a11"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:24.675732 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.666124 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:14:24.690243 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.689793 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8595d89-40e5-4246-925f-cfa9b42e2a11-kube-api-access-7hszr" pod "c8595d89-40e5-4246-925f-cfa9b42e2a11" (UID: "c8595d89-40e5-4246-925f-cfa9b42e2a11"). InnerVolumeSpecName "kube-api-access-7hszr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:24.700133 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.700092 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8595d89-40e5-4246-925f-cfa9b42e2a11-tls-certs" pod "c8595d89-40e5-4246-925f-cfa9b42e2a11" (UID: "c8595d89-40e5-4246-925f-cfa9b42e2a11"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:14:24.730820 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.730781 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-kube-api-access-gkwbh\" (UniqueName: \"kubernetes.io/projected/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-kube-api-access-gkwbh\") pod \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " Oct 31 01:14:24.731052 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.730863 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-data\") pod \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " Oct 31 01:14:24.731052 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.730898 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-token\" (UniqueName: \"kubernetes.io/projected/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-token\") pod \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " Oct 31 01:14:24.731052 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.730934 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-envoy\") pod \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " Oct 31 01:14:24.731052 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.730983 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-podinfo\") pod \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " Oct 31 01:14:24.731052 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.731044 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istiod-ca-cert\") pod \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " Oct 31 01:14:24.731373 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.731096 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-credential-socket\") pod \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " Oct 31 01:14:24.731373 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.731160 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-workload-socket\") pod \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " Oct 31 01:14:24.731373 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.731309 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-workload-certs\") pod \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\" (UID: \"4e8db137-6e00-4d6a-9f9f-9e4df9a71328\") " Oct 31 01:14:24.732298 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.731951 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hszr\" (UniqueName: \"kubernetes.io/projected/c8595d89-40e5-4246-925f-cfa9b42e2a11-kube-api-access-7hszr\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.732298 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.731978 5821 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-model-cache\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.732298 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.731991 5821 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-tmp-dir\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.732298 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.732003 5821 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8595d89-40e5-4246-925f-cfa9b42e2a11-home\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.732298 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.732015 5821 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8595d89-40e5-4246-925f-cfa9b42e2a11-tls-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.732748 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.732718 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-workload-certs" pod "4e8db137-6e00-4d6a-9f9f-9e4df9a71328" (UID: "4e8db137-6e00-4d6a-9f9f-9e4df9a71328"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:24.733306 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.733285 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-credential-socket" pod "4e8db137-6e00-4d6a-9f9f-9e4df9a71328" (UID: "4e8db137-6e00-4d6a-9f9f-9e4df9a71328"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:24.733485 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.733454 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istiod-ca-cert" pod "4e8db137-6e00-4d6a-9f9f-9e4df9a71328" (UID: "4e8db137-6e00-4d6a-9f9f-9e4df9a71328"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:14:24.733777 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.733749 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-workload-socket" pod "4e8db137-6e00-4d6a-9f9f-9e4df9a71328" (UID: "4e8db137-6e00-4d6a-9f9f-9e4df9a71328"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:24.734055 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.734036 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-data" pod "4e8db137-6e00-4d6a-9f9f-9e4df9a71328" (UID: "4e8db137-6e00-4d6a-9f9f-9e4df9a71328"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:24.735984 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.735948 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-envoy" pod "4e8db137-6e00-4d6a-9f9f-9e4df9a71328" (UID: "4e8db137-6e00-4d6a-9f9f-9e4df9a71328"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:24.736332 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.736303 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-kube-api-access-gkwbh" pod "4e8db137-6e00-4d6a-9f9f-9e4df9a71328" (UID: "4e8db137-6e00-4d6a-9f9f-9e4df9a71328"). InnerVolumeSpecName "kube-api-access-gkwbh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:24.736416 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.736392 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-podinfo" pod "4e8db137-6e00-4d6a-9f9f-9e4df9a71328" (UID: "4e8db137-6e00-4d6a-9f9f-9e4df9a71328"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:14:24.737702 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.737676 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-token" pod "4e8db137-6e00-4d6a-9f9f-9e4df9a71328" (UID: "4e8db137-6e00-4d6a-9f9f-9e4df9a71328"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:24.806179 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.806142 5821 generic.go:356] "Generic (PLEG): container finished" podID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerID="ffe48edf7e21b6c7efaed1d7f71bf5e39740f599b8e32f9bb0a716c2d3b263b0" exitCode=0 Oct 31 01:14:24.806179 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.806189 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" Oct 31 01:14:24.806767 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.806233 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" event={"ID":"c8595d89-40e5-4246-925f-cfa9b42e2a11","Type":"ContainerDied","Data":"ffe48edf7e21b6c7efaed1d7f71bf5e39740f599b8e32f9bb0a716c2d3b263b0"} Oct 31 01:14:24.806767 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.806287 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4" event={"ID":"c8595d89-40e5-4246-925f-cfa9b42e2a11","Type":"ContainerDied","Data":"b92312bb514bcae8ba7a21d12428e731c8aa2c830afe1330d487db06c9f1245f"} Oct 31 01:14:24.806767 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.806310 5821 scope.go:122] "RemoveContainer" containerID="ffe48edf7e21b6c7efaed1d7f71bf5e39740f599b8e32f9bb0a716c2d3b263b0" Oct 31 01:14:24.807919 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.807890 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" event={"ID":"8f24afcc-82f0-4d26-bf4d-4969762ede4d","Type":"ContainerDied","Data":"f475340118c498c0ec25a34afe599ab4325fa869a028561a57432c46603d4b6c"} Oct 31 01:14:24.808031 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.807988 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569" Oct 31 01:14:24.819806 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.819532 5821 scope.go:122] "RemoveContainer" containerID="ffe48edf7e21b6c7efaed1d7f71bf5e39740f599b8e32f9bb0a716c2d3b263b0" Oct 31 01:14:24.819929 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.819813 5821 generic.go:356] "Generic (PLEG): container finished" podID="4e8db137-6e00-4d6a-9f9f-9e4df9a71328" containerID="000152a67ffb63ce731d9cf908d9df301dcc9b5d986a3b51871ad0f4b7591efe" exitCode=0 Oct 31 01:14:24.819929 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.819853 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" event={"ID":"4e8db137-6e00-4d6a-9f9f-9e4df9a71328","Type":"ContainerDied","Data":"000152a67ffb63ce731d9cf908d9df301dcc9b5d986a3b51871ad0f4b7591efe"} Oct 31 01:14:24.819929 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.819898 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" event={"ID":"4e8db137-6e00-4d6a-9f9f-9e4df9a71328","Type":"ContainerDied","Data":"f3d6956502a0bd88936c9fc777e4368fc253e2eda262402bc73b5ed107d08622"} Oct 31 01:14:24.820118 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.819979 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9" Oct 31 01:14:24.821281 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:14:24.821247 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffe48edf7e21b6c7efaed1d7f71bf5e39740f599b8e32f9bb0a716c2d3b263b0\": container with ID starting with ffe48edf7e21b6c7efaed1d7f71bf5e39740f599b8e32f9bb0a716c2d3b263b0 not found: ID does not exist" containerID="ffe48edf7e21b6c7efaed1d7f71bf5e39740f599b8e32f9bb0a716c2d3b263b0" Oct 31 01:14:24.821380 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.821286 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe48edf7e21b6c7efaed1d7f71bf5e39740f599b8e32f9bb0a716c2d3b263b0"} err="failed to get container status \"ffe48edf7e21b6c7efaed1d7f71bf5e39740f599b8e32f9bb0a716c2d3b263b0\": rpc error: code = NotFound desc = could not find container \"ffe48edf7e21b6c7efaed1d7f71bf5e39740f599b8e32f9bb0a716c2d3b263b0\": container with ID starting with ffe48edf7e21b6c7efaed1d7f71bf5e39740f599b8e32f9bb0a716c2d3b263b0 not found: ID does not exist" Oct 31 01:14:24.821380 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.821313 5821 scope.go:122] "RemoveContainer" containerID="270cc31e6605e939672bb5fd1e25c4185242ee84b253f60e0b1fcfa79e0481c5" Oct 31 01:14:24.833485 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.833462 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.833598 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.833490 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.833598 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.833514 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.833598 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.833527 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.833598 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.833541 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.833598 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.833569 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkwbh\" (UniqueName: \"kubernetes.io/projected/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-kube-api-access-gkwbh\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.833598 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.833583 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.833598 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.833595 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.833931 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.833610 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e8db137-6e00-4d6a-9f9f-9e4df9a71328-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:24.833931 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.833694 5821 scope.go:122] "RemoveContainer" containerID="000152a67ffb63ce731d9cf908d9df301dcc9b5d986a3b51871ad0f4b7591efe" Oct 31 01:14:24.836244 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.836217 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4"] Oct 31 01:14:24.845627 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.845601 5821 scope.go:122] "RemoveContainer" containerID="000152a67ffb63ce731d9cf908d9df301dcc9b5d986a3b51871ad0f4b7591efe" Oct 31 01:14:24.845957 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:14:24.845936 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"000152a67ffb63ce731d9cf908d9df301dcc9b5d986a3b51871ad0f4b7591efe\": container with ID starting with 000152a67ffb63ce731d9cf908d9df301dcc9b5d986a3b51871ad0f4b7591efe not found: ID does not exist" containerID="000152a67ffb63ce731d9cf908d9df301dcc9b5d986a3b51871ad0f4b7591efe" Oct 31 01:14:24.846005 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.845964 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"000152a67ffb63ce731d9cf908d9df301dcc9b5d986a3b51871ad0f4b7591efe"} err="failed to get container status \"000152a67ffb63ce731d9cf908d9df301dcc9b5d986a3b51871ad0f4b7591efe\": rpc error: code = NotFound desc = could not find container \"000152a67ffb63ce731d9cf908d9df301dcc9b5d986a3b51871ad0f4b7591efe\": container with ID starting with 000152a67ffb63ce731d9cf908d9df301dcc9b5d986a3b51871ad0f4b7591efe not found: ID does not exist" Oct 31 01:14:24.855029 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.854999 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-8499c8/premium-w4-8499c8-kserve-5dc785dd69-mj2t4"] Oct 31 01:14:24.882842 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.882809 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569"] Oct 31 01:14:24.903218 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.903190 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-r8569"] Oct 31 01:14:24.933137 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.933110 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9"] Oct 31 01:14:24.951965 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:24.951938 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-1b8d05-openshift-default-659bf8c59c-g8jq9"] Oct 31 01:14:25.150448 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:25.150350 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj"] Oct 31 01:14:25.164949 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:25.164919 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz"] Oct 31 01:14:25.320014 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:25.319970 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx"] Oct 31 01:14:25.576589 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:25.576482 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="17283d64-4c76-433f-9a21-d6de6ab9e470" path="/var/lib/kubelet/pods/17283d64-4c76-433f-9a21-d6de6ab9e470/volumes" Oct 31 01:14:25.577395 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:25.577372 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4e8db137-6e00-4d6a-9f9f-9e4df9a71328" path="/var/lib/kubelet/pods/4e8db137-6e00-4d6a-9f9f-9e4df9a71328/volumes" Oct 31 01:14:25.578122 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:25.578097 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8f24afcc-82f0-4d26-bf4d-4969762ede4d" path="/var/lib/kubelet/pods/8f24afcc-82f0-4d26-bf4d-4969762ede4d/volumes" Oct 31 01:14:25.579003 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:25.578982 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" path="/var/lib/kubelet/pods/c8595d89-40e5-4246-925f-cfa9b42e2a11/volumes" Oct 31 01:14:25.579444 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:25.579428 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ca001694-4577-4273-84de-8ae4bd47c12e" path="/var/lib/kubelet/pods/ca001694-4577-4273-84de-8ae4bd47c12e/volumes" Oct 31 01:14:29.699458 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:29.699424 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b"] Oct 31 01:14:29.700383 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:29.700327 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" podUID="d34c9445-cbcd-4f23-b685-f0edc29d2301" containerName="istio-proxy" containerID="cri-o://3c1f245c281cc5c06cf7dba7ebd128d7bfcdd4990056e5c5f686bc016adcbca0" gracePeriod=30 Oct 31 01:14:29.716236 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:29.716204 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp"] Oct 31 01:14:29.716576 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:29.716526 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" podUID="d88cf0ef-5780-485b-9984-e40c5040d5f4" containerName="istio-proxy" containerID="cri-o://79a447cb80d3da792bef3b5197ef562b1fe547cc759aa7b19285b3a67fb82872" gracePeriod=30 Oct 31 01:14:29.721418 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:29.721297 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh"] Oct 31 01:14:29.721732 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:29.721538 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" podUID="2e88678f-d491-46fa-839c-913ffe8a0a6d" containerName="istio-proxy" containerID="cri-o://3137a57a74576365d5f840e94c4b775e8fe097054ee0bfc1989de1edbe68dc6a" gracePeriod=30 Oct 31 01:14:30.170602 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:30.170525 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 31 01:14:30.170785 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:30.170632 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" podUID="2e88678f-d491-46fa-839c-913ffe8a0a6d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:14:31.410485 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:31.410442 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 31 01:14:31.411318 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:31.411282 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" podUID="d34c9445-cbcd-4f23-b685-f0edc29d2301" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:14:33.184318 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:33.184279 5821 patch_prober.go:29] interesting pod/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 31 01:14:33.184718 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:33.184348 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" podUID="d88cf0ef-5780-485b-9984-e40c5040d5f4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:14:35.028526 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.028492 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:14:35.047594 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.047011 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:14:35.071900 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.068367 5821 generic.go:356] "Generic (PLEG): container finished" podID="d88cf0ef-5780-485b-9984-e40c5040d5f4" containerID="79a447cb80d3da792bef3b5197ef562b1fe547cc759aa7b19285b3a67fb82872" exitCode=0 Oct 31 01:14:35.071900 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.068603 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" event={"ID":"d88cf0ef-5780-485b-9984-e40c5040d5f4","Type":"ContainerDied","Data":"79a447cb80d3da792bef3b5197ef562b1fe547cc759aa7b19285b3a67fb82872"} Oct 31 01:14:35.071900 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.068666 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" event={"ID":"d88cf0ef-5780-485b-9984-e40c5040d5f4","Type":"ContainerDied","Data":"adc651ffdca9623518a6269e5085c61ee040b72ccbee27eceb7f074ce0394db4"} Oct 31 01:14:35.071900 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.068701 5821 scope.go:122] "RemoveContainer" containerID="79a447cb80d3da792bef3b5197ef562b1fe547cc759aa7b19285b3a67fb82872" Oct 31 01:14:35.071900 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.068856 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp" Oct 31 01:14:35.078115 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.077734 5821 generic.go:356] "Generic (PLEG): container finished" podID="2e88678f-d491-46fa-839c-913ffe8a0a6d" containerID="3137a57a74576365d5f840e94c4b775e8fe097054ee0bfc1989de1edbe68dc6a" exitCode=0 Oct 31 01:14:35.078115 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.077892 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" event={"ID":"2e88678f-d491-46fa-839c-913ffe8a0a6d","Type":"ContainerDied","Data":"3137a57a74576365d5f840e94c4b775e8fe097054ee0bfc1989de1edbe68dc6a"} Oct 31 01:14:35.080236 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.079657 5821 generic.go:356] "Generic (PLEG): container finished" podID="d34c9445-cbcd-4f23-b685-f0edc29d2301" containerID="3c1f245c281cc5c06cf7dba7ebd128d7bfcdd4990056e5c5f686bc016adcbca0" exitCode=0 Oct 31 01:14:35.080236 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.079710 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" event={"ID":"d34c9445-cbcd-4f23-b685-f0edc29d2301","Type":"ContainerDied","Data":"3c1f245c281cc5c06cf7dba7ebd128d7bfcdd4990056e5c5f686bc016adcbca0"} Oct 31 01:14:35.080236 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.079754 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" event={"ID":"d34c9445-cbcd-4f23-b685-f0edc29d2301","Type":"ContainerDied","Data":"f77dbaaefb606b9b344b51c525e335eb03220d4b4f4b2c893f0d430633457bfe"} Oct 31 01:14:35.080236 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.079834 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b" Oct 31 01:14:35.092800 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.092777 5821 scope.go:122] "RemoveContainer" containerID="79a447cb80d3da792bef3b5197ef562b1fe547cc759aa7b19285b3a67fb82872" Oct 31 01:14:35.093140 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:14:35.093106 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79a447cb80d3da792bef3b5197ef562b1fe547cc759aa7b19285b3a67fb82872\": container with ID starting with 79a447cb80d3da792bef3b5197ef562b1fe547cc759aa7b19285b3a67fb82872 not found: ID does not exist" containerID="79a447cb80d3da792bef3b5197ef562b1fe547cc759aa7b19285b3a67fb82872" Oct 31 01:14:35.093262 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.093146 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79a447cb80d3da792bef3b5197ef562b1fe547cc759aa7b19285b3a67fb82872"} err="failed to get container status \"79a447cb80d3da792bef3b5197ef562b1fe547cc759aa7b19285b3a67fb82872\": rpc error: code = NotFound desc = could not find container \"79a447cb80d3da792bef3b5197ef562b1fe547cc759aa7b19285b3a67fb82872\": container with ID starting with 79a447cb80d3da792bef3b5197ef562b1fe547cc759aa7b19285b3a67fb82872 not found: ID does not exist" Oct 31 01:14:35.093262 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.093164 5821 scope.go:122] "RemoveContainer" containerID="3c1f245c281cc5c06cf7dba7ebd128d7bfcdd4990056e5c5f686bc016adcbca0" Oct 31 01:14:35.107656 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.107629 5821 scope.go:122] "RemoveContainer" containerID="3c1f245c281cc5c06cf7dba7ebd128d7bfcdd4990056e5c5f686bc016adcbca0" Oct 31 01:14:35.108245 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:14:35.108171 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c1f245c281cc5c06cf7dba7ebd128d7bfcdd4990056e5c5f686bc016adcbca0\": container with ID starting with 3c1f245c281cc5c06cf7dba7ebd128d7bfcdd4990056e5c5f686bc016adcbca0 not found: ID does not exist" containerID="3c1f245c281cc5c06cf7dba7ebd128d7bfcdd4990056e5c5f686bc016adcbca0" Oct 31 01:14:35.108245 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.108209 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c1f245c281cc5c06cf7dba7ebd128d7bfcdd4990056e5c5f686bc016adcbca0"} err="failed to get container status \"3c1f245c281cc5c06cf7dba7ebd128d7bfcdd4990056e5c5f686bc016adcbca0\": rpc error: code = NotFound desc = could not find container \"3c1f245c281cc5c06cf7dba7ebd128d7bfcdd4990056e5c5f686bc016adcbca0\": container with ID starting with 3c1f245c281cc5c06cf7dba7ebd128d7bfcdd4990056e5c5f686bc016adcbca0 not found: ID does not exist" Oct 31 01:14:35.112199 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.111178 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d34c9445-cbcd-4f23-b685-f0edc29d2301-kube-api-access-nvtgg\" (UniqueName: \"kubernetes.io/projected/d34c9445-cbcd-4f23-b685-f0edc29d2301-kube-api-access-nvtgg\") pod \"d34c9445-cbcd-4f23-b685-f0edc29d2301\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " Oct 31 01:14:35.112199 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.111237 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d88cf0ef-5780-485b-9984-e40c5040d5f4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d88cf0ef-5780-485b-9984-e40c5040d5f4-istiod-ca-cert\") pod \"d88cf0ef-5780-485b-9984-e40c5040d5f4\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " Oct 31 01:14:35.112199 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.111281 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-workload-socket\") pod \"d34c9445-cbcd-4f23-b685-f0edc29d2301\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " Oct 31 01:14:35.112199 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.111365 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-workload-certs\") pod \"d88cf0ef-5780-485b-9984-e40c5040d5f4\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " Oct 31 01:14:35.112199 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.111414 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-data\") pod \"d34c9445-cbcd-4f23-b685-f0edc29d2301\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " Oct 31 01:14:35.112199 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.111441 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d34c9445-cbcd-4f23-b685-f0edc29d2301-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d34c9445-cbcd-4f23-b685-f0edc29d2301-istiod-ca-cert\") pod \"d34c9445-cbcd-4f23-b685-f0edc29d2301\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " Oct 31 01:14:35.112199 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.111475 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-data\") pod \"d88cf0ef-5780-485b-9984-e40c5040d5f4\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " Oct 31 01:14:35.112199 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.111579 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-envoy\") pod \"d34c9445-cbcd-4f23-b685-f0edc29d2301\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " Oct 31 01:14:35.112199 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.111621 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-credential-socket\") pod \"d34c9445-cbcd-4f23-b685-f0edc29d2301\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " Oct 31 01:14:35.112199 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.111666 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-workload-certs\") pod \"d34c9445-cbcd-4f23-b685-f0edc29d2301\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " Oct 31 01:14:35.112199 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.111710 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-podinfo\") pod \"d88cf0ef-5780-485b-9984-e40c5040d5f4\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " Oct 31 01:14:35.112199 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.111766 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-credential-socket\") pod \"d88cf0ef-5780-485b-9984-e40c5040d5f4\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " Oct 31 01:14:35.112199 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.111827 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-workload-socket\") pod \"d88cf0ef-5780-485b-9984-e40c5040d5f4\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " Oct 31 01:14:35.112199 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.111855 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-envoy\") pod \"d88cf0ef-5780-485b-9984-e40c5040d5f4\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " Oct 31 01:14:35.112199 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.111911 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-token\" (UniqueName: \"kubernetes.io/projected/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-token\") pod \"d88cf0ef-5780-485b-9984-e40c5040d5f4\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " Oct 31 01:14:35.112199 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.111993 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d88cf0ef-5780-485b-9984-e40c5040d5f4-kube-api-access-t55fb\" (UniqueName: \"kubernetes.io/projected/d88cf0ef-5780-485b-9984-e40c5040d5f4-kube-api-access-t55fb\") pod \"d88cf0ef-5780-485b-9984-e40c5040d5f4\" (UID: \"d88cf0ef-5780-485b-9984-e40c5040d5f4\") " Oct 31 01:14:35.112199 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.112064 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-podinfo\") pod \"d34c9445-cbcd-4f23-b685-f0edc29d2301\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " Oct 31 01:14:35.112199 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.112101 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-token\" (UniqueName: \"kubernetes.io/projected/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-token\") pod \"d34c9445-cbcd-4f23-b685-f0edc29d2301\" (UID: \"d34c9445-cbcd-4f23-b685-f0edc29d2301\") " Oct 31 01:14:35.115908 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.115292 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-workload-certs" pod "d88cf0ef-5780-485b-9984-e40c5040d5f4" (UID: "d88cf0ef-5780-485b-9984-e40c5040d5f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:35.115908 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.115401 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-credential-socket" pod "d34c9445-cbcd-4f23-b685-f0edc29d2301" (UID: "d34c9445-cbcd-4f23-b685-f0edc29d2301"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:35.115908 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.115483 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d88cf0ef-5780-485b-9984-e40c5040d5f4-istiod-ca-cert" pod "d88cf0ef-5780-485b-9984-e40c5040d5f4" (UID: "d88cf0ef-5780-485b-9984-e40c5040d5f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:14:35.115908 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.115649 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-data" pod "d34c9445-cbcd-4f23-b685-f0edc29d2301" (UID: "d34c9445-cbcd-4f23-b685-f0edc29d2301"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:35.115908 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.115681 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-workload-socket" pod "d88cf0ef-5780-485b-9984-e40c5040d5f4" (UID: "d88cf0ef-5780-485b-9984-e40c5040d5f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:35.115908 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.115827 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-workload-certs" pod "d34c9445-cbcd-4f23-b685-f0edc29d2301" (UID: "d34c9445-cbcd-4f23-b685-f0edc29d2301"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:35.116280 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.115931 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d34c9445-cbcd-4f23-b685-f0edc29d2301-istiod-ca-cert" pod "d34c9445-cbcd-4f23-b685-f0edc29d2301" (UID: "d34c9445-cbcd-4f23-b685-f0edc29d2301"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:14:35.116393 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.116283 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-workload-socket" pod "d34c9445-cbcd-4f23-b685-f0edc29d2301" (UID: "d34c9445-cbcd-4f23-b685-f0edc29d2301"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:35.117361 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.116589 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-data" pod "d88cf0ef-5780-485b-9984-e40c5040d5f4" (UID: "d88cf0ef-5780-485b-9984-e40c5040d5f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:35.117361 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.116609 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-credential-socket" pod "d88cf0ef-5780-485b-9984-e40c5040d5f4" (UID: "d88cf0ef-5780-485b-9984-e40c5040d5f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:35.120670 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.120640 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-token" pod "d88cf0ef-5780-485b-9984-e40c5040d5f4" (UID: "d88cf0ef-5780-485b-9984-e40c5040d5f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:35.120818 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.120677 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d34c9445-cbcd-4f23-b685-f0edc29d2301-kube-api-access-nvtgg" pod "d34c9445-cbcd-4f23-b685-f0edc29d2301" (UID: "d34c9445-cbcd-4f23-b685-f0edc29d2301"). InnerVolumeSpecName "kube-api-access-nvtgg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:35.125023 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.124993 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d88cf0ef-5780-485b-9984-e40c5040d5f4-kube-api-access-t55fb" pod "d88cf0ef-5780-485b-9984-e40c5040d5f4" (UID: "d88cf0ef-5780-485b-9984-e40c5040d5f4"). InnerVolumeSpecName "kube-api-access-t55fb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:35.125125 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.125060 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-podinfo" pod "d88cf0ef-5780-485b-9984-e40c5040d5f4" (UID: "d88cf0ef-5780-485b-9984-e40c5040d5f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:14:35.125193 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.125164 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-podinfo" pod "d34c9445-cbcd-4f23-b685-f0edc29d2301" (UID: "d34c9445-cbcd-4f23-b685-f0edc29d2301"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:14:35.125562 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.125252 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-envoy" pod "d88cf0ef-5780-485b-9984-e40c5040d5f4" (UID: "d88cf0ef-5780-485b-9984-e40c5040d5f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:35.125724 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.125663 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-token" pod "d34c9445-cbcd-4f23-b685-f0edc29d2301" (UID: "d34c9445-cbcd-4f23-b685-f0edc29d2301"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:35.126847 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.126825 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-envoy" pod "d34c9445-cbcd-4f23-b685-f0edc29d2301" (UID: "d34c9445-cbcd-4f23-b685-f0edc29d2301"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:35.129931 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.129908 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:14:35.215167 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.215126 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-envoy\") pod \"2e88678f-d491-46fa-839c-913ffe8a0a6d\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " Oct 31 01:14:35.215355 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.215226 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e88678f-d491-46fa-839c-913ffe8a0a6d-kube-api-access-5pxbq\" (UniqueName: \"kubernetes.io/projected/2e88678f-d491-46fa-839c-913ffe8a0a6d-kube-api-access-5pxbq\") pod \"2e88678f-d491-46fa-839c-913ffe8a0a6d\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " Oct 31 01:14:35.215355 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.215286 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2e88678f-d491-46fa-839c-913ffe8a0a6d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e88678f-d491-46fa-839c-913ffe8a0a6d-istiod-ca-cert\") pod \"2e88678f-d491-46fa-839c-913ffe8a0a6d\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " Oct 31 01:14:35.215355 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.215338 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-token\" (UniqueName: \"kubernetes.io/projected/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-token\") pod \"2e88678f-d491-46fa-839c-913ffe8a0a6d\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " Oct 31 01:14:35.215521 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.215403 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-workload-certs\") pod \"2e88678f-d491-46fa-839c-913ffe8a0a6d\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " Oct 31 01:14:35.215521 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.215456 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-credential-socket\") pod \"2e88678f-d491-46fa-839c-913ffe8a0a6d\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " Oct 31 01:14:35.215521 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.215507 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-data\") pod \"2e88678f-d491-46fa-839c-913ffe8a0a6d\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " Oct 31 01:14:35.215762 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.215592 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-podinfo\") pod \"2e88678f-d491-46fa-839c-913ffe8a0a6d\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " Oct 31 01:14:35.215762 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.215714 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-workload-certs" pod "2e88678f-d491-46fa-839c-913ffe8a0a6d" (UID: "2e88678f-d491-46fa-839c-913ffe8a0a6d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:35.215906 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.215759 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-workload-socket\") pod \"2e88678f-d491-46fa-839c-913ffe8a0a6d\" (UID: \"2e88678f-d491-46fa-839c-913ffe8a0a6d\") " Oct 31 01:14:35.215906 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.215849 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-workload-socket" pod "2e88678f-d491-46fa-839c-913ffe8a0a6d" (UID: "2e88678f-d491-46fa-839c-913ffe8a0a6d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:35.215906 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.215868 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e88678f-d491-46fa-839c-913ffe8a0a6d-istiod-ca-cert" pod "2e88678f-d491-46fa-839c-913ffe8a0a6d" (UID: "2e88678f-d491-46fa-839c-913ffe8a0a6d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:14:35.216054 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.215962 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-credential-socket" pod "2e88678f-d491-46fa-839c-913ffe8a0a6d" (UID: "2e88678f-d491-46fa-839c-913ffe8a0a6d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:35.216054 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.215809 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-data" pod "2e88678f-d491-46fa-839c-913ffe8a0a6d" (UID: "2e88678f-d491-46fa-839c-913ffe8a0a6d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:35.216591 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216547 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216694 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216597 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216694 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216612 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216694 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216625 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216694 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216638 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216694 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216652 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d34c9445-cbcd-4f23-b685-f0edc29d2301-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216694 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216665 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216694 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216679 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216694 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216692 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216977 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216706 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216977 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216720 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216977 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216733 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216977 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216747 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216977 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216761 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216977 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216775 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216977 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216792 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d88cf0ef-5780-485b-9984-e40c5040d5f4-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216977 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216806 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t55fb\" (UniqueName: \"kubernetes.io/projected/d88cf0ef-5780-485b-9984-e40c5040d5f4-kube-api-access-t55fb\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216977 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216820 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216977 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216833 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d34c9445-cbcd-4f23-b685-f0edc29d2301-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216977 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216847 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e88678f-d491-46fa-839c-913ffe8a0a6d-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216977 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216863 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvtgg\" (UniqueName: \"kubernetes.io/projected/d34c9445-cbcd-4f23-b685-f0edc29d2301-kube-api-access-nvtgg\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216977 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216877 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d88cf0ef-5780-485b-9984-e40c5040d5f4-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.216977 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.216892 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d34c9445-cbcd-4f23-b685-f0edc29d2301-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.218048 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.218014 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-token" pod "2e88678f-d491-46fa-839c-913ffe8a0a6d" (UID: "2e88678f-d491-46fa-839c-913ffe8a0a6d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:35.218156 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.218059 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e88678f-d491-46fa-839c-913ffe8a0a6d-kube-api-access-5pxbq" pod "2e88678f-d491-46fa-839c-913ffe8a0a6d" (UID: "2e88678f-d491-46fa-839c-913ffe8a0a6d"). InnerVolumeSpecName "kube-api-access-5pxbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:35.218303 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.218283 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-podinfo" pod "2e88678f-d491-46fa-839c-913ffe8a0a6d" (UID: "2e88678f-d491-46fa-839c-913ffe8a0a6d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:14:35.218303 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.218297 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-envoy" pod "2e88678f-d491-46fa-839c-913ffe8a0a6d" (UID: "2e88678f-d491-46fa-839c-913ffe8a0a6d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:35.323682 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.319741 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.323682 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.319786 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pxbq\" (UniqueName: \"kubernetes.io/projected/2e88678f-d491-46fa-839c-913ffe8a0a6d-kube-api-access-5pxbq\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.323682 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.319807 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.323682 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.319821 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e88678f-d491-46fa-839c-913ffe8a0a6d-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:35.420039 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.420004 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp"] Oct 31 01:14:35.425416 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.425385 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-fcbzp"] Oct 31 01:14:35.439848 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.439816 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b"] Oct 31 01:14:35.445858 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.445825 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-b5t4b"] Oct 31 01:14:35.490959 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.490923 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r"] Oct 31 01:14:35.491453 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491441 5821 cpu_manager.go:414] "containerMap: removing container" podUID="2e88678f-d491-46fa-839c-913ffe8a0a6d" containerName="istio-proxy" Oct 31 01:14:35.491497 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491455 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e88678f-d491-46fa-839c-913ffe8a0a6d" containerName="istio-proxy" Oct 31 01:14:35.491497 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491468 5821 cpu_manager.go:414] "containerMap: removing container" podUID="8f24afcc-82f0-4d26-bf4d-4969762ede4d" containerName="istio-proxy" Oct 31 01:14:35.491497 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491473 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8f24afcc-82f0-4d26-bf4d-4969762ede4d" containerName="istio-proxy" Oct 31 01:14:35.491497 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491479 5821 cpu_manager.go:414] "containerMap: removing container" podUID="17283d64-4c76-433f-9a21-d6de6ab9e470" containerName="istio-proxy" Oct 31 01:14:35.491497 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491484 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="17283d64-4c76-433f-9a21-d6de6ab9e470" containerName="istio-proxy" Oct 31 01:14:35.491497 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491493 5821 cpu_manager.go:414] "containerMap: removing container" podUID="4e8db137-6e00-4d6a-9f9f-9e4df9a71328" containerName="istio-proxy" Oct 31 01:14:35.491497 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491498 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4e8db137-6e00-4d6a-9f9f-9e4df9a71328" containerName="istio-proxy" Oct 31 01:14:35.491729 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491508 5821 cpu_manager.go:414] "containerMap: removing container" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" Oct 31 01:14:35.491729 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491513 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" Oct 31 01:14:35.491729 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491525 5821 cpu_manager.go:414] "containerMap: removing container" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" Oct 31 01:14:35.491729 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491532 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" Oct 31 01:14:35.491729 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491540 5821 cpu_manager.go:414] "containerMap: removing container" podUID="ca001694-4577-4273-84de-8ae4bd47c12e" containerName="maas-api" Oct 31 01:14:35.491729 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491545 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca001694-4577-4273-84de-8ae4bd47c12e" containerName="maas-api" Oct 31 01:14:35.491729 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491577 5821 cpu_manager.go:414] "containerMap: removing container" podUID="d88cf0ef-5780-485b-9984-e40c5040d5f4" containerName="istio-proxy" Oct 31 01:14:35.491729 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491586 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d88cf0ef-5780-485b-9984-e40c5040d5f4" containerName="istio-proxy" Oct 31 01:14:35.491729 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491617 5821 cpu_manager.go:414] "containerMap: removing container" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" Oct 31 01:14:35.491729 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491622 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" Oct 31 01:14:35.491729 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491632 5821 cpu_manager.go:414] "containerMap: removing container" podUID="d34c9445-cbcd-4f23-b685-f0edc29d2301" containerName="istio-proxy" Oct 31 01:14:35.491729 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491636 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d34c9445-cbcd-4f23-b685-f0edc29d2301" containerName="istio-proxy" Oct 31 01:14:35.492083 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491736 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="c8595d89-40e5-4246-925f-cfa9b42e2a11" containerName="main" Oct 31 01:14:35.492083 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491744 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="d34c9445-cbcd-4f23-b685-f0edc29d2301" containerName="istio-proxy" Oct 31 01:14:35.492083 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491751 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e88678f-d491-46fa-839c-913ffe8a0a6d" containerName="istio-proxy" Oct 31 01:14:35.492083 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491756 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="8f24afcc-82f0-4d26-bf4d-4969762ede4d" containerName="istio-proxy" Oct 31 01:14:35.492083 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491761 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="17283d64-4c76-433f-9a21-d6de6ab9e470" containerName="istio-proxy" Oct 31 01:14:35.492083 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491767 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="4e8db137-6e00-4d6a-9f9f-9e4df9a71328" containerName="istio-proxy" Oct 31 01:14:35.492083 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491772 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="115b8c20-dcea-4cbd-aeee-c3f93f159685" containerName="main" Oct 31 01:14:35.492083 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491779 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="1dd9865a-0dd7-46da-997d-3ed1ea8f99bf" containerName="main" Oct 31 01:14:35.492083 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491784 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="ca001694-4577-4273-84de-8ae4bd47c12e" containerName="maas-api" Oct 31 01:14:35.492083 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.491790 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="d88cf0ef-5780-485b-9984-e40c5040d5f4" containerName="istio-proxy" Oct 31 01:14:35.496477 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.496456 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r" Oct 31 01:14:35.500577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.500507 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 31 01:14:35.500789 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.500754 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zs6l6\"" Oct 31 01:14:35.503472 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.503444 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r"] Oct 31 01:14:35.522759 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.522716 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r\" (UID: \"243c8dfb-7210-4abc-987d-fdcc3ab9cc9c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r" Oct 31 01:14:35.522932 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.522887 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r\" (UID: \"243c8dfb-7210-4abc-987d-fdcc3ab9cc9c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r" Oct 31 01:14:35.523106 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.523081 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbpq5\" (UniqueName: \"kubernetes.io/projected/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c-kube-api-access-pbpq5\") pod \"maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r\" (UID: \"243c8dfb-7210-4abc-987d-fdcc3ab9cc9c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r" Oct 31 01:14:35.578090 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.577974 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d34c9445-cbcd-4f23-b685-f0edc29d2301" path="/var/lib/kubelet/pods/d34c9445-cbcd-4f23-b685-f0edc29d2301/volumes" Oct 31 01:14:35.579032 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.579004 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d88cf0ef-5780-485b-9984-e40c5040d5f4" path="/var/lib/kubelet/pods/d88cf0ef-5780-485b-9984-e40c5040d5f4/volumes" Oct 31 01:14:35.624932 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.624895 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r\" (UID: \"243c8dfb-7210-4abc-987d-fdcc3ab9cc9c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r" Oct 31 01:14:35.625105 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.625029 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbpq5\" (UniqueName: \"kubernetes.io/projected/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c-kube-api-access-pbpq5\") pod \"maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r\" (UID: \"243c8dfb-7210-4abc-987d-fdcc3ab9cc9c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r" Oct 31 01:14:35.625167 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.625153 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r\" (UID: \"243c8dfb-7210-4abc-987d-fdcc3ab9cc9c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r" Oct 31 01:14:35.626367 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.626335 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r\" (UID: \"243c8dfb-7210-4abc-987d-fdcc3ab9cc9c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r" Oct 31 01:14:35.627820 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.627787 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r\" (UID: \"243c8dfb-7210-4abc-987d-fdcc3ab9cc9c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r" Oct 31 01:14:35.633692 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.633669 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbpq5\" (UniqueName: \"kubernetes.io/projected/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c-kube-api-access-pbpq5\") pod \"maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r\" (UID: \"243c8dfb-7210-4abc-987d-fdcc3ab9cc9c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r" Oct 31 01:14:35.812331 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:35.812295 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r" Oct 31 01:14:36.087752 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:36.087723 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" Oct 31 01:14:36.087752 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:36.087735 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh" event={"ID":"2e88678f-d491-46fa-839c-913ffe8a0a6d","Type":"ContainerDied","Data":"620658a406fbf2a3c322dbfded71905cc8f8e9cb1aa2b05ca5133d52fbc17644"} Oct 31 01:14:36.088241 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:36.087812 5821 scope.go:122] "RemoveContainer" containerID="3137a57a74576365d5f840e94c4b775e8fe097054ee0bfc1989de1edbe68dc6a" Oct 31 01:14:36.094507 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:36.094483 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r"] Oct 31 01:14:36.096740 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:14:36.096714 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod243c8dfb_7210_4abc_987d_fdcc3ab9cc9c.slice/crio-3325f4125149ecdc818c45ef933b36792e6e1713c40a1a961c61adf7778eec23 WatchSource:0}: Error finding container 3325f4125149ecdc818c45ef933b36792e6e1713c40a1a961c61adf7778eec23: Status 404 returned error can't find the container with id 3325f4125149ecdc818c45ef933b36792e6e1713c40a1a961c61adf7778eec23 Oct 31 01:14:36.099828 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:36.099809 5821 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 31 01:14:36.109023 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:36.109000 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh"] Oct 31 01:14:36.113336 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:36.113314 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-0a6cca-openshift-default-7cf4f9647c-khfmh"] Oct 31 01:14:37.174586 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:37.170825 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r" event={"ID":"243c8dfb-7210-4abc-987d-fdcc3ab9cc9c","Type":"ContainerStarted","Data":"3325f4125149ecdc818c45ef933b36792e6e1713c40a1a961c61adf7778eec23"} Oct 31 01:14:37.569832 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:37.569753 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e88678f-d491-46fa-839c-913ffe8a0a6d" path="/var/lib/kubelet/pods/2e88678f-d491-46fa-839c-913ffe8a0a6d/volumes" Oct 31 01:14:40.183050 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.182662 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" containerID="cri-o://ec7782eb459f19729e5d3a8de39258e86a6fb2785ccc9b32a1a9166f66570327" gracePeriod=45 Oct 31 01:14:40.187432 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.187382 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" containerID="cri-o://fb42a4903cfd3494b0a8c840bc08b3928fc0ab8a93e87491824e987ccc9ad6bc" gracePeriod=45 Oct 31 01:14:40.240536 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.240495 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r" event={"ID":"243c8dfb-7210-4abc-987d-fdcc3ab9cc9c","Type":"ContainerStarted","Data":"6237664f50dfd86d54b090d8d8879b632cfec305e4c9e98883cbcef568b0705f"} Oct 31 01:14:40.261070 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.261017 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r" podStartSLOduration=1.5971075209999999 podStartE2EDuration="5.261003466s" totalImagesPullingTime="3.663895945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:14:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:14:40.259447556 +0000 UTC m=+1096.838861466" watchObservedRunningTime="2026-10-31 01:14:40.261003466 +0000 UTC m=+1096.840417373" Oct 31 01:14:40.364578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.360724 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" containerID="cri-o://b8bfbed3ed2a1d10834dda2f5922332c02c7f106be83a4fd8646074c7edd347a" gracePeriod=45 Oct 31 01:14:40.369633 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.369490 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h"] Oct 31 01:14:40.409571 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.409510 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": dial tcp 10.132.0.52:8000: connect: connection refused" Oct 31 01:14:40.450482 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.449639 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj"] Oct 31 01:14:40.573252 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.545655 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.49:8000/ready\": dial tcp 10.132.0.49:8000: connect: connection refused" Oct 31 01:14:40.702937 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.702862 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:14:40.728980 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.728948 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:14:40.792029 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.791986 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-dshm\" (UniqueName: \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-dshm\") pod \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " Oct 31 01:14:40.792194 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.792072 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8647a1e0-bcd2-4045-a01e-497bdb3d460f-tls-certs\" (UniqueName: \"kubernetes.io/secret/8647a1e0-bcd2-4045-a01e-497bdb3d460f-tls-certs\") pod \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " Oct 31 01:14:40.792194 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.792127 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-tmp-dir\") pod \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " Oct 31 01:14:40.792194 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.792176 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-model-cache\") pod \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " Oct 31 01:14:40.792389 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.792365 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8647a1e0-bcd2-4045-a01e-497bdb3d460f-kube-api-access-nvnsv\" (UniqueName: \"kubernetes.io/projected/8647a1e0-bcd2-4045-a01e-497bdb3d460f-kube-api-access-nvnsv\") pod \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " Oct 31 01:14:40.792707 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.792448 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-home\" (UniqueName: \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-home\") pod \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\" (UID: \"8647a1e0-bcd2-4045-a01e-497bdb3d460f\") " Oct 31 01:14:40.793080 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.792874 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-tmp-dir" pod "8647a1e0-bcd2-4045-a01e-497bdb3d460f" (UID: "8647a1e0-bcd2-4045-a01e-497bdb3d460f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:40.793295 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.793266 5821 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-tmp-dir\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:40.794190 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.794168 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-model-cache" pod "8647a1e0-bcd2-4045-a01e-497bdb3d460f" (UID: "8647a1e0-bcd2-4045-a01e-497bdb3d460f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:40.796368 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.796323 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8647a1e0-bcd2-4045-a01e-497bdb3d460f-tls-certs" pod "8647a1e0-bcd2-4045-a01e-497bdb3d460f" (UID: "8647a1e0-bcd2-4045-a01e-497bdb3d460f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:14:40.796589 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.796526 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8647a1e0-bcd2-4045-a01e-497bdb3d460f-kube-api-access-nvnsv" pod "8647a1e0-bcd2-4045-a01e-497bdb3d460f" (UID: "8647a1e0-bcd2-4045-a01e-497bdb3d460f"). InnerVolumeSpecName "kube-api-access-nvnsv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:40.797669 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.797633 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-home" pod "8647a1e0-bcd2-4045-a01e-497bdb3d460f" (UID: "8647a1e0-bcd2-4045-a01e-497bdb3d460f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:40.798456 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.798434 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-dshm" pod "8647a1e0-bcd2-4045-a01e-497bdb3d460f" (UID: "8647a1e0-bcd2-4045-a01e-497bdb3d460f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:40.841001 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.840589 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:14:40.894069 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.894016 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-dshm\") pod \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " Oct 31 01:14:40.894381 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.894082 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-home\" (UniqueName: \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-home\") pod \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " Oct 31 01:14:40.894381 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.894140 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-tmp-dir\") pod \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " Oct 31 01:14:40.894381 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.894251 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-model-cache\") pod \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " Oct 31 01:14:40.894381 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.894351 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-tls-certs\") pod \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " Oct 31 01:14:40.894381 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.894380 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-kube-api-access-4rtnw\" (UniqueName: \"kubernetes.io/projected/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-kube-api-access-4rtnw\") pod \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\" (UID: \"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c\") " Oct 31 01:14:40.895032 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.895009 5821 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-model-cache\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:40.895100 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.895038 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvnsv\" (UniqueName: \"kubernetes.io/projected/8647a1e0-bcd2-4045-a01e-497bdb3d460f-kube-api-access-nvnsv\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:40.895100 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.895053 5821 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-home\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:40.895100 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.895067 5821 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8647a1e0-bcd2-4045-a01e-497bdb3d460f-dshm\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:40.895100 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.895079 5821 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8647a1e0-bcd2-4045-a01e-497bdb3d460f-tls-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:40.895851 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.895666 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-tmp-dir" pod "b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" (UID: "b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:40.895851 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.895709 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-model-cache" pod "b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" (UID: "b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:40.896111 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.896079 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-home" pod "b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" (UID: "b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:40.897903 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.897849 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-kube-api-access-4rtnw" pod "b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" (UID: "b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c"). InnerVolumeSpecName "kube-api-access-4rtnw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:40.898143 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.898122 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-dshm" pod "b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" (UID: "b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:40.898922 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.898896 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-tls-certs" pod "b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" (UID: "b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:14:40.996473 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.996397 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-model-cache\") pod \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " Oct 31 01:14:40.996473 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.996457 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-dshm\") pod \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " Oct 31 01:14:40.996716 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.996581 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-tls-certs\") pod \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " Oct 31 01:14:40.996716 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.996669 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-kube-api-access-vwxsg\" (UniqueName: \"kubernetes.io/projected/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-kube-api-access-vwxsg\") pod \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " Oct 31 01:14:40.996716 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.996689 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-model-cache" pod "0f7caf26-a0d2-4b14-8d6e-a03e759df90a" (UID: "0f7caf26-a0d2-4b14-8d6e-a03e759df90a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:40.996885 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.996746 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-home\" (UniqueName: \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-home\") pod \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " Oct 31 01:14:40.996885 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.996851 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-tmp-dir\") pod \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\" (UID: \"0f7caf26-a0d2-4b14-8d6e-a03e759df90a\") " Oct 31 01:14:40.997050 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.997015 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-home" pod "0f7caf26-a0d2-4b14-8d6e-a03e759df90a" (UID: "0f7caf26-a0d2-4b14-8d6e-a03e759df90a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:40.997211 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.997184 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-tmp-dir" pod "0f7caf26-a0d2-4b14-8d6e-a03e759df90a" (UID: "0f7caf26-a0d2-4b14-8d6e-a03e759df90a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:40.997476 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.997453 5821 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-model-cache\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:40.997592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.997482 5821 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-tls-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:40.997592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.997499 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rtnw\" (UniqueName: \"kubernetes.io/projected/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-kube-api-access-4rtnw\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:40.997592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.997518 5821 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-home\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:40.997592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.997533 5821 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-tmp-dir\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:40.997592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.997545 5821 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-dshm\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:40.997592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.997574 5821 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-model-cache\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:40.997592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.997591 5821 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-home\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:40.997875 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.997606 5821 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c-tmp-dir\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:40.998927 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.998904 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-dshm" pod "0f7caf26-a0d2-4b14-8d6e-a03e759df90a" (UID: "0f7caf26-a0d2-4b14-8d6e-a03e759df90a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:40.999031 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.999009 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-kube-api-access-vwxsg" pod "0f7caf26-a0d2-4b14-8d6e-a03e759df90a" (UID: "0f7caf26-a0d2-4b14-8d6e-a03e759df90a"). InnerVolumeSpecName "kube-api-access-vwxsg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:40.999075 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:40.999029 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-tls-certs" pod "0f7caf26-a0d2-4b14-8d6e-a03e759df90a" (UID: "0f7caf26-a0d2-4b14-8d6e-a03e759df90a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:14:41.100716 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.100627 5821 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-tls-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:41.100716 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.100668 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwxsg\" (UniqueName: \"kubernetes.io/projected/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-kube-api-access-vwxsg\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:41.100716 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.100683 5821 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f7caf26-a0d2-4b14-8d6e-a03e759df90a-dshm\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:41.248433 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.248344 5821 generic.go:356] "Generic (PLEG): container finished" podID="243c8dfb-7210-4abc-987d-fdcc3ab9cc9c" containerID="6237664f50dfd86d54b090d8d8879b632cfec305e4c9e98883cbcef568b0705f" exitCode=0 Oct 31 01:14:41.248913 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.248434 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r" event={"ID":"243c8dfb-7210-4abc-987d-fdcc3ab9cc9c","Type":"ContainerDied","Data":"6237664f50dfd86d54b090d8d8879b632cfec305e4c9e98883cbcef568b0705f"} Oct 31 01:14:41.249966 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.249945 5821 generic.go:356] "Generic (PLEG): container finished" podID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerID="fb42a4903cfd3494b0a8c840bc08b3928fc0ab8a93e87491824e987ccc9ad6bc" exitCode=0 Oct 31 01:14:41.250087 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.249987 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" Oct 31 01:14:41.250087 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.249975 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" event={"ID":"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c","Type":"ContainerDied","Data":"fb42a4903cfd3494b0a8c840bc08b3928fc0ab8a93e87491824e987ccc9ad6bc"} Oct 31 01:14:41.250171 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.250091 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz" event={"ID":"b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c","Type":"ContainerDied","Data":"3df02c6da4369b50b6cc6d5d97887689dec5335e1d842e86fb68d237d7dbed82"} Oct 31 01:14:41.250171 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.250127 5821 scope.go:122] "RemoveContainer" containerID="fb42a4903cfd3494b0a8c840bc08b3928fc0ab8a93e87491824e987ccc9ad6bc" Oct 31 01:14:41.251439 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.251415 5821 generic.go:356] "Generic (PLEG): container finished" podID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerID="ec7782eb459f19729e5d3a8de39258e86a6fb2785ccc9b32a1a9166f66570327" exitCode=0 Oct 31 01:14:41.251570 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.251458 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" Oct 31 01:14:41.251570 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.251522 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" event={"ID":"8647a1e0-bcd2-4045-a01e-497bdb3d460f","Type":"ContainerDied","Data":"ec7782eb459f19729e5d3a8de39258e86a6fb2785ccc9b32a1a9166f66570327"} Oct 31 01:14:41.251678 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.251598 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" event={"ID":"8647a1e0-bcd2-4045-a01e-497bdb3d460f","Type":"ContainerDied","Data":"2544927d3ef51285abee57b4d314fd4f3c68b0c12dd7fb78c4b35f762454d874"} Oct 31 01:14:41.253079 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.253056 5821 generic.go:356] "Generic (PLEG): container finished" podID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerID="b8bfbed3ed2a1d10834dda2f5922332c02c7f106be83a4fd8646074c7edd347a" exitCode=0 Oct 31 01:14:41.253189 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.253090 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" Oct 31 01:14:41.253189 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.253141 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" event={"ID":"0f7caf26-a0d2-4b14-8d6e-a03e759df90a","Type":"ContainerDied","Data":"b8bfbed3ed2a1d10834dda2f5922332c02c7f106be83a4fd8646074c7edd347a"} Oct 31 01:14:41.253189 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.253182 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx" event={"ID":"0f7caf26-a0d2-4b14-8d6e-a03e759df90a","Type":"ContainerDied","Data":"07f877ac664e97e6703c21807d05fec2a4e6728b2e866a27a29c412c5ffb0441"} Oct 31 01:14:41.261688 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.261669 5821 scope.go:122] "RemoveContainer" containerID="fb42a4903cfd3494b0a8c840bc08b3928fc0ab8a93e87491824e987ccc9ad6bc" Oct 31 01:14:41.261960 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:14:41.261940 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb42a4903cfd3494b0a8c840bc08b3928fc0ab8a93e87491824e987ccc9ad6bc\": container with ID starting with fb42a4903cfd3494b0a8c840bc08b3928fc0ab8a93e87491824e987ccc9ad6bc not found: ID does not exist" containerID="fb42a4903cfd3494b0a8c840bc08b3928fc0ab8a93e87491824e987ccc9ad6bc" Oct 31 01:14:41.262025 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.261972 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb42a4903cfd3494b0a8c840bc08b3928fc0ab8a93e87491824e987ccc9ad6bc"} err="failed to get container status \"fb42a4903cfd3494b0a8c840bc08b3928fc0ab8a93e87491824e987ccc9ad6bc\": rpc error: code = NotFound desc = could not find container \"fb42a4903cfd3494b0a8c840bc08b3928fc0ab8a93e87491824e987ccc9ad6bc\": container with ID starting with fb42a4903cfd3494b0a8c840bc08b3928fc0ab8a93e87491824e987ccc9ad6bc not found: ID does not exist" Oct 31 01:14:41.262025 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.261997 5821 scope.go:122] "RemoveContainer" containerID="ec7782eb459f19729e5d3a8de39258e86a6fb2785ccc9b32a1a9166f66570327" Oct 31 01:14:41.271223 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.271204 5821 scope.go:122] "RemoveContainer" containerID="ec7782eb459f19729e5d3a8de39258e86a6fb2785ccc9b32a1a9166f66570327" Oct 31 01:14:41.271479 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:14:41.271460 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec7782eb459f19729e5d3a8de39258e86a6fb2785ccc9b32a1a9166f66570327\": container with ID starting with ec7782eb459f19729e5d3a8de39258e86a6fb2785ccc9b32a1a9166f66570327 not found: ID does not exist" containerID="ec7782eb459f19729e5d3a8de39258e86a6fb2785ccc9b32a1a9166f66570327" Oct 31 01:14:41.271587 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.271487 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec7782eb459f19729e5d3a8de39258e86a6fb2785ccc9b32a1a9166f66570327"} err="failed to get container status \"ec7782eb459f19729e5d3a8de39258e86a6fb2785ccc9b32a1a9166f66570327\": rpc error: code = NotFound desc = could not find container \"ec7782eb459f19729e5d3a8de39258e86a6fb2785ccc9b32a1a9166f66570327\": container with ID starting with ec7782eb459f19729e5d3a8de39258e86a6fb2785ccc9b32a1a9166f66570327 not found: ID does not exist" Oct 31 01:14:41.271587 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.271511 5821 scope.go:122] "RemoveContainer" containerID="b8bfbed3ed2a1d10834dda2f5922332c02c7f106be83a4fd8646074c7edd347a" Oct 31 01:14:41.280614 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.280501 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz"] Oct 31 01:14:41.282483 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.282461 5821 scope.go:122] "RemoveContainer" containerID="b8bfbed3ed2a1d10834dda2f5922332c02c7f106be83a4fd8646074c7edd347a" Oct 31 01:14:41.282870 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:14:41.282850 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8bfbed3ed2a1d10834dda2f5922332c02c7f106be83a4fd8646074c7edd347a\": container with ID starting with b8bfbed3ed2a1d10834dda2f5922332c02c7f106be83a4fd8646074c7edd347a not found: ID does not exist" containerID="b8bfbed3ed2a1d10834dda2f5922332c02c7f106be83a4fd8646074c7edd347a" Oct 31 01:14:41.282957 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.282877 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8bfbed3ed2a1d10834dda2f5922332c02c7f106be83a4fd8646074c7edd347a"} err="failed to get container status \"b8bfbed3ed2a1d10834dda2f5922332c02c7f106be83a4fd8646074c7edd347a\": rpc error: code = NotFound desc = could not find container \"b8bfbed3ed2a1d10834dda2f5922332c02c7f106be83a4fd8646074c7edd347a\": container with ID starting with b8bfbed3ed2a1d10834dda2f5922332c02c7f106be83a4fd8646074c7edd347a not found: ID does not exist" Oct 31 01:14:41.284357 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.284338 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-7f6d1e/premium-w1-7f6d1e-kserve-85b8d7c94-48bmz"] Oct 31 01:14:41.306896 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.306868 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx"] Oct 31 01:14:41.309379 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.309353 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-28ff08/simulator-w5-28ff08-kserve-7dffbf5554-n7mqx"] Oct 31 01:14:41.321748 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.321723 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj"] Oct 31 01:14:41.325373 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.325348 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj"] Oct 31 01:14:41.544914 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.544805 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f6d1e/distinct-2-w1-7f6d1e-kserve-7754fd5c46-2jrlj" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:41.568820 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.568780 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" path="/var/lib/kubelet/pods/0f7caf26-a0d2-4b14-8d6e-a03e759df90a/volumes" Oct 31 01:14:41.569304 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.569258 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" path="/var/lib/kubelet/pods/8647a1e0-bcd2-4045-a01e-497bdb3d460f/volumes" Oct 31 01:14:41.569791 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:41.569771 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" path="/var/lib/kubelet/pods/b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c/volumes" Oct 31 01:14:42.433172 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:42.433140 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r" Oct 31 01:14:42.546428 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:42.546342 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c-maas-api-openshift-ca\") pod \"243c8dfb-7210-4abc-987d-fdcc3ab9cc9c\" (UID: \"243c8dfb-7210-4abc-987d-fdcc3ab9cc9c\") " Oct 31 01:14:42.546428 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:42.546388 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c-kube-api-access-pbpq5\" (UniqueName: \"kubernetes.io/projected/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c-kube-api-access-pbpq5\") pod \"243c8dfb-7210-4abc-987d-fdcc3ab9cc9c\" (UID: \"243c8dfb-7210-4abc-987d-fdcc3ab9cc9c\") " Oct 31 01:14:42.546692 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:42.546584 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c-maas-api-xks-ca\") pod \"243c8dfb-7210-4abc-987d-fdcc3ab9cc9c\" (UID: \"243c8dfb-7210-4abc-987d-fdcc3ab9cc9c\") " Oct 31 01:14:42.546802 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:42.546775 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c-maas-api-openshift-ca" pod "243c8dfb-7210-4abc-987d-fdcc3ab9cc9c" (UID: "243c8dfb-7210-4abc-987d-fdcc3ab9cc9c"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:14:42.547005 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:42.546985 5821 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c-maas-api-openshift-ca\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:42.548696 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:42.548669 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c-maas-api-xks-ca" pod "243c8dfb-7210-4abc-987d-fdcc3ab9cc9c" (UID: "243c8dfb-7210-4abc-987d-fdcc3ab9cc9c"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:14:42.548696 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:42.548684 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c-kube-api-access-pbpq5" pod "243c8dfb-7210-4abc-987d-fdcc3ab9cc9c" (UID: "243c8dfb-7210-4abc-987d-fdcc3ab9cc9c"). InnerVolumeSpecName "kube-api-access-pbpq5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:42.659621 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:42.659588 5821 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c-maas-api-xks-ca\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:42.664635 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:42.664602 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbpq5\" (UniqueName: \"kubernetes.io/projected/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c-kube-api-access-pbpq5\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:43.271035 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:43.271001 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r" Oct 31 01:14:43.271035 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:43.271013 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r" event={"ID":"243c8dfb-7210-4abc-987d-fdcc3ab9cc9c","Type":"ContainerDied","Data":"3325f4125149ecdc818c45ef933b36792e6e1713c40a1a961c61adf7778eec23"} Oct 31 01:14:43.271266 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:43.271062 5821 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3325f4125149ecdc818c45ef933b36792e6e1713c40a1a961c61adf7778eec23" Oct 31 01:14:45.296446 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:45.296399 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9"] Oct 31 01:14:45.297326 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:45.297278 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" podUID="876007f4-ecc5-469f-addd-8e76a84257e5" containerName="istio-proxy" containerID="cri-o://19f4f5c7516a21ac62dfc7cf52f2e301b0645069dd8a1852a85cd257c517299e" gracePeriod=30 Oct 31 01:14:45.322222 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:45.322194 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7"] Oct 31 01:14:45.322712 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:45.322679 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" podUID="960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" containerName="istio-proxy" containerID="cri-o://6fb53438531a9c6f302733a1f7c136d3578f2cb4e17d09d0a7e81b4704024c05" gracePeriod=30 Oct 31 01:14:45.389014 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:45.374629 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm"] Oct 31 01:14:45.389014 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:45.374926 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" podUID="74944bd5-3fcb-48a6-a208-6f17f70df82b" containerName="istio-proxy" containerID="cri-o://79f68ff55e414e36780906332c113742d73e683517a00adab8f8dab63378a750" gracePeriod=30 Oct 31 01:14:46.530832 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:46.530367 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:46.539435 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:46.539399 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:14:46.539688 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:46.539662 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" podUID="876007f4-ecc5-469f-addd-8e76a84257e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:46.540237 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:46.540209 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:46.581683 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:46.581644 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:14:46.593046 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:46.581917 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" podUID="74944bd5-3fcb-48a6-a208-6f17f70df82b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:14:46.689584 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:46.688904 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded" Oct 31 01:14:47.320759 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:14:47.320716 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:14:47.408592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:47.327513 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q"] Oct 31 01:14:47.408592 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:47.371762 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" podUID="d6149144-2988-41aa-99d2-01a7205486c0" containerName="maas-api" containerID="cri-o://7d69a86a4313be68e2165caa996b7a11836dbb1b03949c23b2d5fb3428f9848d" gracePeriod=30 Oct 31 01:14:47.986875 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:47.982481 5821 generic.go:356] "Generic (PLEG): container finished" podID="d6149144-2988-41aa-99d2-01a7205486c0" containerID="7d69a86a4313be68e2165caa996b7a11836dbb1b03949c23b2d5fb3428f9848d" exitCode=0 Oct 31 01:14:47.986875 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:47.982538 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" event={"ID":"d6149144-2988-41aa-99d2-01a7205486c0","Type":"ContainerDied","Data":"7d69a86a4313be68e2165caa996b7a11836dbb1b03949c23b2d5fb3428f9848d"} Oct 31 01:14:48.187060 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:48.187028 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" Oct 31 01:14:48.363895 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:48.363863 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d6149144-2988-41aa-99d2-01a7205486c0-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6149144-2988-41aa-99d2-01a7205486c0-metrics-certs\") pod \"d6149144-2988-41aa-99d2-01a7205486c0\" (UID: \"d6149144-2988-41aa-99d2-01a7205486c0\") " Oct 31 01:14:48.364053 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:48.363974 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d6149144-2988-41aa-99d2-01a7205486c0-kube-api-access-dbt2j\" (UniqueName: \"kubernetes.io/projected/d6149144-2988-41aa-99d2-01a7205486c0-kube-api-access-dbt2j\") pod \"d6149144-2988-41aa-99d2-01a7205486c0\" (UID: \"d6149144-2988-41aa-99d2-01a7205486c0\") " Oct 31 01:14:48.364053 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:48.363997 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d6149144-2988-41aa-99d2-01a7205486c0-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6149144-2988-41aa-99d2-01a7205486c0-openshift-service-ca\") pod \"d6149144-2988-41aa-99d2-01a7205486c0\" (UID: \"d6149144-2988-41aa-99d2-01a7205486c0\") " Oct 31 01:14:48.364053 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:48.364025 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d6149144-2988-41aa-99d2-01a7205486c0-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6149144-2988-41aa-99d2-01a7205486c0-maas-api-tls\") pod \"d6149144-2988-41aa-99d2-01a7205486c0\" (UID: \"d6149144-2988-41aa-99d2-01a7205486c0\") " Oct 31 01:14:48.364378 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:48.364346 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6149144-2988-41aa-99d2-01a7205486c0-openshift-service-ca" pod "d6149144-2988-41aa-99d2-01a7205486c0" (UID: "d6149144-2988-41aa-99d2-01a7205486c0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:14:48.364711 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:48.364687 5821 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6149144-2988-41aa-99d2-01a7205486c0-openshift-service-ca\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:48.366273 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:48.366241 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6149144-2988-41aa-99d2-01a7205486c0-metrics-certs" pod "d6149144-2988-41aa-99d2-01a7205486c0" (UID: "d6149144-2988-41aa-99d2-01a7205486c0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:14:48.366366 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:48.366276 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6149144-2988-41aa-99d2-01a7205486c0-maas-api-tls" pod "d6149144-2988-41aa-99d2-01a7205486c0" (UID: "d6149144-2988-41aa-99d2-01a7205486c0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:14:48.372729 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:48.372697 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6149144-2988-41aa-99d2-01a7205486c0-kube-api-access-dbt2j" pod "d6149144-2988-41aa-99d2-01a7205486c0" (UID: "d6149144-2988-41aa-99d2-01a7205486c0"). InnerVolumeSpecName "kube-api-access-dbt2j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:48.466152 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:48.466116 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbt2j\" (UniqueName: \"kubernetes.io/projected/d6149144-2988-41aa-99d2-01a7205486c0-kube-api-access-dbt2j\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:48.466152 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:48.466150 5821 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6149144-2988-41aa-99d2-01a7205486c0-maas-api-tls\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:48.466152 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:48.466164 5821 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6149144-2988-41aa-99d2-01a7205486c0-metrics-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:48.991480 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:48.991445 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" Oct 31 01:14:48.991480 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:48.991474 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q" event={"ID":"d6149144-2988-41aa-99d2-01a7205486c0","Type":"ContainerDied","Data":"5713a7b62935d4a66ebdd5fdda6c0c055fca5e6991b08ef19504a5df6343ac25"} Oct 31 01:14:48.992027 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:48.991543 5821 scope.go:122] "RemoveContainer" containerID="7d69a86a4313be68e2165caa996b7a11836dbb1b03949c23b2d5fb3428f9848d" Oct 31 01:14:49.025332 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:49.025282 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q"] Oct 31 01:14:49.034091 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:49.034051 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-28ff08-776db5b67d-6tb6q"] Oct 31 01:14:49.395699 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:49.395666 5821 patch_prober.go:29] interesting pod/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 31 01:14:49.395875 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:49.395718 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" podUID="960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:14:49.590729 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:49.590691 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d6149144-2988-41aa-99d2-01a7205486c0" path="/var/lib/kubelet/pods/d6149144-2988-41aa-99d2-01a7205486c0/volumes" Oct 31 01:14:51.292412 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.292385 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:14:51.313285 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.313243 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-workload-socket\") pod \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " Oct 31 01:14:51.313449 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.313305 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-podinfo\") pod \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " Oct 31 01:14:51.313449 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.313422 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-credential-socket\") pod \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " Oct 31 01:14:51.313548 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.313459 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istiod-ca-cert\") pod \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " Oct 31 01:14:51.313548 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.313536 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-workload-certs\") pod \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " Oct 31 01:14:51.313687 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.313566 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-workload-socket" pod "960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" (UID: "960b5acc-9378-42e7-b0d9-ef5d3f79e1cc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:51.313687 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.313674 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-data\") pod \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " Oct 31 01:14:51.313795 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.313703 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-kube-api-access-46c84\" (UniqueName: \"kubernetes.io/projected/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-kube-api-access-46c84\") pod \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " Oct 31 01:14:51.313795 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.313779 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-credential-socket" pod "960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" (UID: "960b5acc-9378-42e7-b0d9-ef5d3f79e1cc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:51.313898 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.313788 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-token\" (UniqueName: \"kubernetes.io/projected/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-token\") pod \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " Oct 31 01:14:51.313898 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.313870 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-envoy\") pod \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\" (UID: \"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc\") " Oct 31 01:14:51.314070 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.313868 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-workload-certs" pod "960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" (UID: "960b5acc-9378-42e7-b0d9-ef5d3f79e1cc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:51.314070 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.313939 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-data" pod "960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" (UID: "960b5acc-9378-42e7-b0d9-ef5d3f79e1cc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:51.314355 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.314327 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istiod-ca-cert" pod "960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" (UID: "960b5acc-9378-42e7-b0d9-ef5d3f79e1cc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:14:51.316317 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.316285 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-podinfo" pod "960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" (UID: "960b5acc-9378-42e7-b0d9-ef5d3f79e1cc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:14:51.317700 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.316740 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-token" pod "960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" (UID: "960b5acc-9378-42e7-b0d9-ef5d3f79e1cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:51.317700 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.316992 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-envoy" pod "960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" (UID: "960b5acc-9378-42e7-b0d9-ef5d3f79e1cc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:51.317700 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.317341 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:51.317700 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.317364 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:51.317700 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.317377 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:51.317700 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.317391 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:51.317700 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.317401 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:51.317700 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.317410 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:51.317700 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.317418 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:51.317700 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.317427 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:51.325049 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.324803 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-kube-api-access-46c84" pod "960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" (UID: "960b5acc-9378-42e7-b0d9-ef5d3f79e1cc"). InnerVolumeSpecName "kube-api-access-46c84". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:51.418292 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.418255 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46c84\" (UniqueName: \"kubernetes.io/projected/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc-kube-api-access-46c84\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:51.573585 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.573541 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:14:51.620494 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.620456 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-data\") pod \"74944bd5-3fcb-48a6-a208-6f17f70df82b\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " Oct 31 01:14:51.620713 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.620534 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/74944bd5-3fcb-48a6-a208-6f17f70df82b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74944bd5-3fcb-48a6-a208-6f17f70df82b-istiod-ca-cert\") pod \"74944bd5-3fcb-48a6-a208-6f17f70df82b\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " Oct 31 01:14:51.620713 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.620616 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-credential-socket\") pod \"74944bd5-3fcb-48a6-a208-6f17f70df82b\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " Oct 31 01:14:51.620713 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.620667 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-envoy\") pod \"74944bd5-3fcb-48a6-a208-6f17f70df82b\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " Oct 31 01:14:51.620869 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.620724 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/74944bd5-3fcb-48a6-a208-6f17f70df82b-kube-api-access-l7ht9\" (UniqueName: \"kubernetes.io/projected/74944bd5-3fcb-48a6-a208-6f17f70df82b-kube-api-access-l7ht9\") pod \"74944bd5-3fcb-48a6-a208-6f17f70df82b\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " Oct 31 01:14:51.620869 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.620776 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-data" pod "74944bd5-3fcb-48a6-a208-6f17f70df82b" (UID: "74944bd5-3fcb-48a6-a208-6f17f70df82b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:51.620869 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.620827 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-token\" (UniqueName: \"kubernetes.io/projected/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-token\") pod \"74944bd5-3fcb-48a6-a208-6f17f70df82b\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " Oct 31 01:14:51.620969 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.620864 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-workload-socket\") pod \"74944bd5-3fcb-48a6-a208-6f17f70df82b\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " Oct 31 01:14:51.620969 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.620955 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-podinfo\") pod \"74944bd5-3fcb-48a6-a208-6f17f70df82b\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " Oct 31 01:14:51.621064 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.621047 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-workload-certs\") pod \"74944bd5-3fcb-48a6-a208-6f17f70df82b\" (UID: \"74944bd5-3fcb-48a6-a208-6f17f70df82b\") " Oct 31 01:14:51.621161 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.621044 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-credential-socket" pod "74944bd5-3fcb-48a6-a208-6f17f70df82b" (UID: "74944bd5-3fcb-48a6-a208-6f17f70df82b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:51.621224 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.621066 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74944bd5-3fcb-48a6-a208-6f17f70df82b-istiod-ca-cert" pod "74944bd5-3fcb-48a6-a208-6f17f70df82b" (UID: "74944bd5-3fcb-48a6-a208-6f17f70df82b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:14:51.621298 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.621275 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-workload-certs" pod "74944bd5-3fcb-48a6-a208-6f17f70df82b" (UID: "74944bd5-3fcb-48a6-a208-6f17f70df82b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:51.621376 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.621289 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-workload-socket" pod "74944bd5-3fcb-48a6-a208-6f17f70df82b" (UID: "74944bd5-3fcb-48a6-a208-6f17f70df82b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:51.622142 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.621831 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:51.622142 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.621861 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:51.622142 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.621876 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:51.622142 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.621891 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74944bd5-3fcb-48a6-a208-6f17f70df82b-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:51.622142 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.621907 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:51.623608 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.623581 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74944bd5-3fcb-48a6-a208-6f17f70df82b-kube-api-access-l7ht9" pod "74944bd5-3fcb-48a6-a208-6f17f70df82b" (UID: "74944bd5-3fcb-48a6-a208-6f17f70df82b"). InnerVolumeSpecName "kube-api-access-l7ht9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:51.623725 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.623621 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-token" pod "74944bd5-3fcb-48a6-a208-6f17f70df82b" (UID: "74944bd5-3fcb-48a6-a208-6f17f70df82b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:51.623725 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.623646 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-envoy" pod "74944bd5-3fcb-48a6-a208-6f17f70df82b" (UID: "74944bd5-3fcb-48a6-a208-6f17f70df82b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:51.624397 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.624374 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-podinfo" pod "74944bd5-3fcb-48a6-a208-6f17f70df82b" (UID: "74944bd5-3fcb-48a6-a208-6f17f70df82b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:14:51.724382 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.724346 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:51.724382 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.724380 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7ht9\" (UniqueName: \"kubernetes.io/projected/74944bd5-3fcb-48a6-a208-6f17f70df82b-kube-api-access-l7ht9\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:51.724382 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.724392 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:51.724684 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:51.724400 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74944bd5-3fcb-48a6-a208-6f17f70df82b-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:52.014539 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.014449 5821 generic.go:356] "Generic (PLEG): container finished" podID="960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" containerID="6fb53438531a9c6f302733a1f7c136d3578f2cb4e17d09d0a7e81b4704024c05" exitCode=0 Oct 31 01:14:52.014539 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.014509 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" Oct 31 01:14:52.014850 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.014535 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" event={"ID":"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc","Type":"ContainerDied","Data":"6fb53438531a9c6f302733a1f7c136d3578f2cb4e17d09d0a7e81b4704024c05"} Oct 31 01:14:52.014850 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.014605 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7" event={"ID":"960b5acc-9378-42e7-b0d9-ef5d3f79e1cc","Type":"ContainerDied","Data":"c2d5cf20ea9093dcf959031a2e9c3d156771992af489442998ca225bc1567bbe"} Oct 31 01:14:52.014850 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.014632 5821 scope.go:122] "RemoveContainer" containerID="6fb53438531a9c6f302733a1f7c136d3578f2cb4e17d09d0a7e81b4704024c05" Oct 31 01:14:52.016600 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.016545 5821 generic.go:356] "Generic (PLEG): container finished" podID="74944bd5-3fcb-48a6-a208-6f17f70df82b" containerID="79f68ff55e414e36780906332c113742d73e683517a00adab8f8dab63378a750" exitCode=0 Oct 31 01:14:52.016761 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.016614 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" Oct 31 01:14:52.016761 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.016671 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" event={"ID":"74944bd5-3fcb-48a6-a208-6f17f70df82b","Type":"ContainerDied","Data":"79f68ff55e414e36780906332c113742d73e683517a00adab8f8dab63378a750"} Oct 31 01:14:52.016761 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.016727 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm" event={"ID":"74944bd5-3fcb-48a6-a208-6f17f70df82b","Type":"ContainerDied","Data":"c1a93453d41cc3b85d8439976db630023ff86cd269391ef8c5c3373b7dcdf34a"} Oct 31 01:14:52.028939 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.028916 5821 scope.go:122] "RemoveContainer" containerID="6fb53438531a9c6f302733a1f7c136d3578f2cb4e17d09d0a7e81b4704024c05" Oct 31 01:14:52.029260 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:14:52.029242 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fb53438531a9c6f302733a1f7c136d3578f2cb4e17d09d0a7e81b4704024c05\": container with ID starting with 6fb53438531a9c6f302733a1f7c136d3578f2cb4e17d09d0a7e81b4704024c05 not found: ID does not exist" containerID="6fb53438531a9c6f302733a1f7c136d3578f2cb4e17d09d0a7e81b4704024c05" Oct 31 01:14:52.029309 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.029269 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fb53438531a9c6f302733a1f7c136d3578f2cb4e17d09d0a7e81b4704024c05"} err="failed to get container status \"6fb53438531a9c6f302733a1f7c136d3578f2cb4e17d09d0a7e81b4704024c05\": rpc error: code = NotFound desc = could not find container \"6fb53438531a9c6f302733a1f7c136d3578f2cb4e17d09d0a7e81b4704024c05\": container with ID starting with 6fb53438531a9c6f302733a1f7c136d3578f2cb4e17d09d0a7e81b4704024c05 not found: ID does not exist" Oct 31 01:14:52.029309 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.029285 5821 scope.go:122] "RemoveContainer" containerID="79f68ff55e414e36780906332c113742d73e683517a00adab8f8dab63378a750" Oct 31 01:14:52.035668 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.035641 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7"] Oct 31 01:14:52.041040 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.041013 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-hr4w7"] Oct 31 01:14:52.042805 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.042788 5821 scope.go:122] "RemoveContainer" containerID="79f68ff55e414e36780906332c113742d73e683517a00adab8f8dab63378a750" Oct 31 01:14:52.043115 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:14:52.043085 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79f68ff55e414e36780906332c113742d73e683517a00adab8f8dab63378a750\": container with ID starting with 79f68ff55e414e36780906332c113742d73e683517a00adab8f8dab63378a750 not found: ID does not exist" containerID="79f68ff55e414e36780906332c113742d73e683517a00adab8f8dab63378a750" Oct 31 01:14:52.043186 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.043128 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79f68ff55e414e36780906332c113742d73e683517a00adab8f8dab63378a750"} err="failed to get container status \"79f68ff55e414e36780906332c113742d73e683517a00adab8f8dab63378a750\": rpc error: code = NotFound desc = could not find container \"79f68ff55e414e36780906332c113742d73e683517a00adab8f8dab63378a750\": container with ID starting with 79f68ff55e414e36780906332c113742d73e683517a00adab8f8dab63378a750 not found: ID does not exist" Oct 31 01:14:52.056230 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.056202 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm"] Oct 31 01:14:52.061087 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.061063 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-pcbjm"] Oct 31 01:14:52.454307 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.453880 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:14:52.547398 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.547368 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/876007f4-ecc5-469f-addd-8e76a84257e5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/876007f4-ecc5-469f-addd-8e76a84257e5-istio-podinfo\") pod \"876007f4-ecc5-469f-addd-8e76a84257e5\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " Oct 31 01:14:52.547538 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.547442 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-workload-certs\") pod \"876007f4-ecc5-469f-addd-8e76a84257e5\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " Oct 31 01:14:52.547611 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.547532 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-credential-socket\") pod \"876007f4-ecc5-469f-addd-8e76a84257e5\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " Oct 31 01:14:52.547611 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.547596 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-istio-data\") pod \"876007f4-ecc5-469f-addd-8e76a84257e5\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " Oct 31 01:14:52.547733 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.547628 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/876007f4-ecc5-469f-addd-8e76a84257e5-istio-token\" (UniqueName: \"kubernetes.io/projected/876007f4-ecc5-469f-addd-8e76a84257e5-istio-token\") pod \"876007f4-ecc5-469f-addd-8e76a84257e5\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " Oct 31 01:14:52.547733 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.547679 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/876007f4-ecc5-469f-addd-8e76a84257e5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/876007f4-ecc5-469f-addd-8e76a84257e5-istiod-ca-cert\") pod \"876007f4-ecc5-469f-addd-8e76a84257e5\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " Oct 31 01:14:52.547733 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.547692 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-workload-certs" pod "876007f4-ecc5-469f-addd-8e76a84257e5" (UID: "876007f4-ecc5-469f-addd-8e76a84257e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:52.547885 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.547734 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/876007f4-ecc5-469f-addd-8e76a84257e5-kube-api-access-zf64q\" (UniqueName: \"kubernetes.io/projected/876007f4-ecc5-469f-addd-8e76a84257e5-kube-api-access-zf64q\") pod \"876007f4-ecc5-469f-addd-8e76a84257e5\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " Oct 31 01:14:52.547885 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.547770 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-istio-envoy\") pod \"876007f4-ecc5-469f-addd-8e76a84257e5\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " Oct 31 01:14:52.547885 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.547827 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-workload-socket\") pod \"876007f4-ecc5-469f-addd-8e76a84257e5\" (UID: \"876007f4-ecc5-469f-addd-8e76a84257e5\") " Oct 31 01:14:52.548032 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.547877 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-credential-socket" pod "876007f4-ecc5-469f-addd-8e76a84257e5" (UID: "876007f4-ecc5-469f-addd-8e76a84257e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:52.548032 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.547923 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-istio-data" pod "876007f4-ecc5-469f-addd-8e76a84257e5" (UID: "876007f4-ecc5-469f-addd-8e76a84257e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:52.548214 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.548185 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-workload-socket" pod "876007f4-ecc5-469f-addd-8e76a84257e5" (UID: "876007f4-ecc5-469f-addd-8e76a84257e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:52.548214 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.548202 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/876007f4-ecc5-469f-addd-8e76a84257e5-istiod-ca-cert" pod "876007f4-ecc5-469f-addd-8e76a84257e5" (UID: "876007f4-ecc5-469f-addd-8e76a84257e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:14:52.548397 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.548378 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:52.548489 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.548405 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:52.548489 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.548421 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:52.548489 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.548436 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/876007f4-ecc5-469f-addd-8e76a84257e5-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:52.548489 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.548451 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:52.549807 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.549778 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/876007f4-ecc5-469f-addd-8e76a84257e5-istio-token" pod "876007f4-ecc5-469f-addd-8e76a84257e5" (UID: "876007f4-ecc5-469f-addd-8e76a84257e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:52.550077 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.550058 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-istio-envoy" pod "876007f4-ecc5-469f-addd-8e76a84257e5" (UID: "876007f4-ecc5-469f-addd-8e76a84257e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:52.550151 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.550077 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/876007f4-ecc5-469f-addd-8e76a84257e5-istio-podinfo" pod "876007f4-ecc5-469f-addd-8e76a84257e5" (UID: "876007f4-ecc5-469f-addd-8e76a84257e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:14:52.550262 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.550245 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/876007f4-ecc5-469f-addd-8e76a84257e5-kube-api-access-zf64q" pod "876007f4-ecc5-469f-addd-8e76a84257e5" (UID: "876007f4-ecc5-469f-addd-8e76a84257e5"). InnerVolumeSpecName "kube-api-access-zf64q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:52.650097 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.650061 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/876007f4-ecc5-469f-addd-8e76a84257e5-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:52.650097 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.650097 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zf64q\" (UniqueName: \"kubernetes.io/projected/876007f4-ecc5-469f-addd-8e76a84257e5-kube-api-access-zf64q\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:52.650357 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.650111 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/876007f4-ecc5-469f-addd-8e76a84257e5-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:52.650357 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:52.650124 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/876007f4-ecc5-469f-addd-8e76a84257e5-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:53.025114 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:53.025026 5821 generic.go:356] "Generic (PLEG): container finished" podID="876007f4-ecc5-469f-addd-8e76a84257e5" containerID="19f4f5c7516a21ac62dfc7cf52f2e301b0645069dd8a1852a85cd257c517299e" exitCode=0 Oct 31 01:14:53.025114 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:53.025079 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" Oct 31 01:14:53.025337 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:53.025110 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" event={"ID":"876007f4-ecc5-469f-addd-8e76a84257e5","Type":"ContainerDied","Data":"19f4f5c7516a21ac62dfc7cf52f2e301b0645069dd8a1852a85cd257c517299e"} Oct 31 01:14:53.025337 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:53.025172 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9" event={"ID":"876007f4-ecc5-469f-addd-8e76a84257e5","Type":"ContainerDied","Data":"3d436faee7b9183ea16cdfb4af8f5cf590e79994db78b5af3952dbcb2d88705a"} Oct 31 01:14:53.025337 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:53.025196 5821 scope.go:122] "RemoveContainer" containerID="19f4f5c7516a21ac62dfc7cf52f2e301b0645069dd8a1852a85cd257c517299e" Oct 31 01:14:53.036661 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:53.036641 5821 scope.go:122] "RemoveContainer" containerID="19f4f5c7516a21ac62dfc7cf52f2e301b0645069dd8a1852a85cd257c517299e" Oct 31 01:14:53.036957 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:14:53.036937 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19f4f5c7516a21ac62dfc7cf52f2e301b0645069dd8a1852a85cd257c517299e\": container with ID starting with 19f4f5c7516a21ac62dfc7cf52f2e301b0645069dd8a1852a85cd257c517299e not found: ID does not exist" containerID="19f4f5c7516a21ac62dfc7cf52f2e301b0645069dd8a1852a85cd257c517299e" Oct 31 01:14:53.037031 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:53.036966 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f4f5c7516a21ac62dfc7cf52f2e301b0645069dd8a1852a85cd257c517299e"} err="failed to get container status \"19f4f5c7516a21ac62dfc7cf52f2e301b0645069dd8a1852a85cd257c517299e\": rpc error: code = NotFound desc = could not find container \"19f4f5c7516a21ac62dfc7cf52f2e301b0645069dd8a1852a85cd257c517299e\": container with ID starting with 19f4f5c7516a21ac62dfc7cf52f2e301b0645069dd8a1852a85cd257c517299e not found: ID does not exist" Oct 31 01:14:53.052951 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:53.052919 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9"] Oct 31 01:14:53.055821 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:53.055783 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-8499c8-openshift-default-8587968855-7stj9"] Oct 31 01:14:53.567232 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:53.567194 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="74944bd5-3fcb-48a6-a208-6f17f70df82b" path="/var/lib/kubelet/pods/74944bd5-3fcb-48a6-a208-6f17f70df82b/volumes" Oct 31 01:14:53.567720 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:53.567704 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="876007f4-ecc5-469f-addd-8e76a84257e5" path="/var/lib/kubelet/pods/876007f4-ecc5-469f-addd-8e76a84257e5/volumes" Oct 31 01:14:53.568129 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:53.568112 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" path="/var/lib/kubelet/pods/960b5acc-9378-42e7-b0d9-ef5d3f79e1cc/volumes" Oct 31 01:14:55.069575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.068855 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb"] Oct 31 01:14:55.069575 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.069142 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" podUID="8900532b-edb2-4cf6-bc7c-d6f60473221c" containerName="istio-proxy" containerID="cri-o://27e9305822b5a40b110b196f034c861d4c9dce5fd290440c043f12a50165c05c" gracePeriod=30 Oct 31 01:14:55.077437 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.077403 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x"] Oct 31 01:14:55.077692 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.077660 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" podUID="280e663b-1387-450a-8d9a-7e9f5d574bb9" containerName="istio-proxy" containerID="cri-o://e582aba58db70f5085493c0477ebf4a33d179c2fe4e4027cc9962bff8a8998cd" gracePeriod=30 Oct 31 01:14:55.083506 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.081933 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69"] Oct 31 01:14:55.083506 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.082721 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" podUID="c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" containerName="istio-proxy" containerID="cri-o://04bbb849a5d031b6b4e1dcb65da292c97eea3c10239d32b40151beba3c6b7896" gracePeriod=30 Oct 31 01:14:55.467917 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.467870 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" containerID="cri-o://a30ef63011715ea299c4ce6f3179a17c5beb5a1d3eaedd86c2d4916762399af3" gracePeriod=45 Oct 31 01:14:55.474648 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.474615 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": dial tcp 10.132.0.70:8000: connect: connection refused" Oct 31 01:14:55.565605 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.565122 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" containerID="cri-o://7a75fd0b689e27aec66b2a92390c07510d452e1d550622d8a6ba8d9561dc3d6c" gracePeriod=45 Oct 31 01:14:55.827795 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.827357 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:14:55.934098 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.934065 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-model-cache\") pod \"185a60e1-d259-4509-8dd7-885be5c00ae1\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " Oct 31 01:14:55.934098 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.934104 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-dshm\" (UniqueName: \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-dshm\") pod \"185a60e1-d259-4509-8dd7-885be5c00ae1\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " Oct 31 01:14:55.934341 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.934205 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-home\" (UniqueName: \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-home\") pod \"185a60e1-d259-4509-8dd7-885be5c00ae1\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " Oct 31 01:14:55.934341 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.934288 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-tmp-dir\") pod \"185a60e1-d259-4509-8dd7-885be5c00ae1\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " Oct 31 01:14:55.934467 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.934353 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/185a60e1-d259-4509-8dd7-885be5c00ae1-tls-certs\" (UniqueName: \"kubernetes.io/secret/185a60e1-d259-4509-8dd7-885be5c00ae1-tls-certs\") pod \"185a60e1-d259-4509-8dd7-885be5c00ae1\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " Oct 31 01:14:55.934467 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.934373 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-model-cache" pod "185a60e1-d259-4509-8dd7-885be5c00ae1" (UID: "185a60e1-d259-4509-8dd7-885be5c00ae1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:55.934467 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.934419 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/185a60e1-d259-4509-8dd7-885be5c00ae1-kube-api-access-k4gvc\" (UniqueName: \"kubernetes.io/projected/185a60e1-d259-4509-8dd7-885be5c00ae1-kube-api-access-k4gvc\") pod \"185a60e1-d259-4509-8dd7-885be5c00ae1\" (UID: \"185a60e1-d259-4509-8dd7-885be5c00ae1\") " Oct 31 01:14:55.934657 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.934633 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-tmp-dir" pod "185a60e1-d259-4509-8dd7-885be5c00ae1" (UID: "185a60e1-d259-4509-8dd7-885be5c00ae1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:55.934880 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.934850 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-home" pod "185a60e1-d259-4509-8dd7-885be5c00ae1" (UID: "185a60e1-d259-4509-8dd7-885be5c00ae1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:55.935146 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.935043 5821 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-model-cache\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:55.935146 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.935067 5821 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-home\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:55.935146 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.935083 5821 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-tmp-dir\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:55.937205 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.937044 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-dshm" pod "185a60e1-d259-4509-8dd7-885be5c00ae1" (UID: "185a60e1-d259-4509-8dd7-885be5c00ae1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:55.937205 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.937163 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/185a60e1-d259-4509-8dd7-885be5c00ae1-tls-certs" pod "185a60e1-d259-4509-8dd7-885be5c00ae1" (UID: "185a60e1-d259-4509-8dd7-885be5c00ae1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:14:55.937205 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.937173 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/185a60e1-d259-4509-8dd7-885be5c00ae1-kube-api-access-k4gvc" pod "185a60e1-d259-4509-8dd7-885be5c00ae1" (UID: "185a60e1-d259-4509-8dd7-885be5c00ae1"). InnerVolumeSpecName "kube-api-access-k4gvc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:55.971567 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:55.971531 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:14:56.062672 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.061851 5821 generic.go:356] "Generic (PLEG): container finished" podID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerID="a30ef63011715ea299c4ce6f3179a17c5beb5a1d3eaedd86c2d4916762399af3" exitCode=0 Oct 31 01:14:56.062672 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.062000 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" event={"ID":"185a60e1-d259-4509-8dd7-885be5c00ae1","Type":"ContainerDied","Data":"a30ef63011715ea299c4ce6f3179a17c5beb5a1d3eaedd86c2d4916762399af3"} Oct 31 01:14:56.062672 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.062050 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" event={"ID":"185a60e1-d259-4509-8dd7-885be5c00ae1","Type":"ContainerDied","Data":"41774bbfd299e9e578ff04e09a668aec72c640c5bff69184079631fda812e6b2"} Oct 31 01:14:56.062672 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.062074 5821 scope.go:122] "RemoveContainer" containerID="a30ef63011715ea299c4ce6f3179a17c5beb5a1d3eaedd86c2d4916762399af3" Oct 31 01:14:56.062672 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.062201 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h" Oct 31 01:14:56.064244 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.063675 5821 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/185a60e1-d259-4509-8dd7-885be5c00ae1-tls-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:56.064244 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.063705 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4gvc\" (UniqueName: \"kubernetes.io/projected/185a60e1-d259-4509-8dd7-885be5c00ae1-kube-api-access-k4gvc\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:56.064244 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.063721 5821 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/185a60e1-d259-4509-8dd7-885be5c00ae1-dshm\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:56.079738 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.079621 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l"] Oct 31 01:14:56.080909 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.080880 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" podUID="34724cef-6f8d-4da1-9312-7b85f4814d52" containerName="istio-proxy" containerID="cri-o://4e18bdafaf8d8b2fee4107bbbaa926f5bf8f266f77ada4473979f98fb05f1978" gracePeriod=30 Oct 31 01:14:56.087910 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.087450 5821 generic.go:356] "Generic (PLEG): container finished" podID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerID="7a75fd0b689e27aec66b2a92390c07510d452e1d550622d8a6ba8d9561dc3d6c" exitCode=0 Oct 31 01:14:56.087910 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.087515 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" event={"ID":"02c8c54d-f688-4166-a0fb-9144876ceba8","Type":"ContainerDied","Data":"7a75fd0b689e27aec66b2a92390c07510d452e1d550622d8a6ba8d9561dc3d6c"} Oct 31 01:14:56.087910 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.087567 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" event={"ID":"02c8c54d-f688-4166-a0fb-9144876ceba8","Type":"ContainerDied","Data":"582bd08f47773a4622893213a941c6c77e014e7a75781f706145b4027749a450"} Oct 31 01:14:56.087910 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.087641 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj" Oct 31 01:14:56.095113 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.094006 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh"] Oct 31 01:14:56.095113 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.094391 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" podUID="bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" containerName="istio-proxy" containerID="cri-o://85b4611fb17f474bacad76a19fc0c764c9836c0708c1c57eb99e9861bea8cf98" gracePeriod=30 Oct 31 01:14:56.098526 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.098510 5821 scope.go:122] "RemoveContainer" containerID="a30ef63011715ea299c4ce6f3179a17c5beb5a1d3eaedd86c2d4916762399af3" Oct 31 01:14:56.098965 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:14:56.098944 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a30ef63011715ea299c4ce6f3179a17c5beb5a1d3eaedd86c2d4916762399af3\": container with ID starting with a30ef63011715ea299c4ce6f3179a17c5beb5a1d3eaedd86c2d4916762399af3 not found: ID does not exist" containerID="a30ef63011715ea299c4ce6f3179a17c5beb5a1d3eaedd86c2d4916762399af3" Oct 31 01:14:56.099072 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.098972 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a30ef63011715ea299c4ce6f3179a17c5beb5a1d3eaedd86c2d4916762399af3"} err="failed to get container status \"a30ef63011715ea299c4ce6f3179a17c5beb5a1d3eaedd86c2d4916762399af3\": rpc error: code = NotFound desc = could not find container \"a30ef63011715ea299c4ce6f3179a17c5beb5a1d3eaedd86c2d4916762399af3\": container with ID starting with a30ef63011715ea299c4ce6f3179a17c5beb5a1d3eaedd86c2d4916762399af3 not found: ID does not exist" Oct 31 01:14:56.099072 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.098991 5821 scope.go:122] "RemoveContainer" containerID="7a75fd0b689e27aec66b2a92390c07510d452e1d550622d8a6ba8d9561dc3d6c" Oct 31 01:14:56.099072 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.099053 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp"] Oct 31 01:14:56.099259 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.099235 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" podUID="2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" containerName="istio-proxy" containerID="cri-o://2eddd3e2ed0dd3830b7cc3442058a3ea3a81af6b1d247d0c51657a1fc96d17f2" gracePeriod=30 Oct 31 01:14:56.103211 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.103186 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz"] Oct 31 01:14:56.103928 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.103903 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" podUID="6106bf2d-96d6-4452-a356-dd23d3de4087" containerName="istio-proxy" containerID="cri-o://b446f47f03bbe640da3a67cf48a3882144c63746fe2742b30a5dfcb0a677d591" gracePeriod=30 Oct 31 01:14:56.114195 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.114175 5821 scope.go:122] "RemoveContainer" containerID="7a75fd0b689e27aec66b2a92390c07510d452e1d550622d8a6ba8d9561dc3d6c" Oct 31 01:14:56.114599 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:14:56.114562 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a75fd0b689e27aec66b2a92390c07510d452e1d550622d8a6ba8d9561dc3d6c\": container with ID starting with 7a75fd0b689e27aec66b2a92390c07510d452e1d550622d8a6ba8d9561dc3d6c not found: ID does not exist" containerID="7a75fd0b689e27aec66b2a92390c07510d452e1d550622d8a6ba8d9561dc3d6c" Oct 31 01:14:56.114685 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.114592 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a75fd0b689e27aec66b2a92390c07510d452e1d550622d8a6ba8d9561dc3d6c"} err="failed to get container status \"7a75fd0b689e27aec66b2a92390c07510d452e1d550622d8a6ba8d9561dc3d6c\": rpc error: code = NotFound desc = could not find container \"7a75fd0b689e27aec66b2a92390c07510d452e1d550622d8a6ba8d9561dc3d6c\": container with ID starting with 7a75fd0b689e27aec66b2a92390c07510d452e1d550622d8a6ba8d9561dc3d6c not found: ID does not exist" Oct 31 01:14:56.155539 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.155502 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h"] Oct 31 01:14:56.162280 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.162249 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-acdaed/distinct-2-w0-acdaed-kserve-59c46c5668-v8l5h"] Oct 31 01:14:56.167016 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.166980 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/02c8c54d-f688-4166-a0fb-9144876ceba8-kube-api-access-8jvbq\" (UniqueName: \"kubernetes.io/projected/02c8c54d-f688-4166-a0fb-9144876ceba8-kube-api-access-8jvbq\") pod \"02c8c54d-f688-4166-a0fb-9144876ceba8\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " Oct 31 01:14:56.167178 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.167080 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-home\" (UniqueName: \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-home\") pod \"02c8c54d-f688-4166-a0fb-9144876ceba8\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " Oct 31 01:14:56.167178 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.167125 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-model-cache\") pod \"02c8c54d-f688-4166-a0fb-9144876ceba8\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " Oct 31 01:14:56.167295 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.167199 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-tmp-dir\") pod \"02c8c54d-f688-4166-a0fb-9144876ceba8\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " Oct 31 01:14:56.167347 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.167330 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/02c8c54d-f688-4166-a0fb-9144876ceba8-tls-certs\" (UniqueName: \"kubernetes.io/secret/02c8c54d-f688-4166-a0fb-9144876ceba8-tls-certs\") pod \"02c8c54d-f688-4166-a0fb-9144876ceba8\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " Oct 31 01:14:56.167937 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.167402 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-dshm\" (UniqueName: \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-dshm\") pod \"02c8c54d-f688-4166-a0fb-9144876ceba8\" (UID: \"02c8c54d-f688-4166-a0fb-9144876ceba8\") " Oct 31 01:14:56.167937 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.167472 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-home" pod "02c8c54d-f688-4166-a0fb-9144876ceba8" (UID: "02c8c54d-f688-4166-a0fb-9144876ceba8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:56.167937 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.167487 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-model-cache" pod "02c8c54d-f688-4166-a0fb-9144876ceba8" (UID: "02c8c54d-f688-4166-a0fb-9144876ceba8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:56.167937 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.167714 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-tmp-dir" pod "02c8c54d-f688-4166-a0fb-9144876ceba8" (UID: "02c8c54d-f688-4166-a0fb-9144876ceba8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:56.167937 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.167876 5821 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-model-cache\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:56.167937 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.167896 5821 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-tmp-dir\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:56.167937 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.167911 5821 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-home\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:56.170149 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.170113 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02c8c54d-f688-4166-a0fb-9144876ceba8-kube-api-access-8jvbq" pod "02c8c54d-f688-4166-a0fb-9144876ceba8" (UID: "02c8c54d-f688-4166-a0fb-9144876ceba8"). InnerVolumeSpecName "kube-api-access-8jvbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:14:56.170374 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.170347 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-dshm" pod "02c8c54d-f688-4166-a0fb-9144876ceba8" (UID: "02c8c54d-f688-4166-a0fb-9144876ceba8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:14:56.171314 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.171289 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02c8c54d-f688-4166-a0fb-9144876ceba8-tls-certs" pod "02c8c54d-f688-4166-a0fb-9144876ceba8" (UID: "02c8c54d-f688-4166-a0fb-9144876ceba8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:14:56.282586 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.279323 5821 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02c8c54d-f688-4166-a0fb-9144876ceba8-tls-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:56.282586 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.279356 5821 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02c8c54d-f688-4166-a0fb-9144876ceba8-dshm\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:56.282586 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.279372 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jvbq\" (UniqueName: \"kubernetes.io/projected/02c8c54d-f688-4166-a0fb-9144876ceba8-kube-api-access-8jvbq\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:14:56.412520 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.412481 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj"] Oct 31 01:14:56.421240 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:56.421206 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-acdaed/simulator-w0-acdaed-kserve-dbb64c577-lk7zj"] Oct 31 01:14:57.566463 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:57.566425 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" path="/var/lib/kubelet/pods/02c8c54d-f688-4166-a0fb-9144876ceba8/volumes" Oct 31 01:14:57.566903 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:57.566888 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" path="/var/lib/kubelet/pods/185a60e1-d259-4509-8dd7-885be5c00ae1/volumes" Oct 31 01:14:59.717568 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:59.717515 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r"] Oct 31 01:14:59.719398 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:14:59.719368 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-acdaed-7957r"] Oct 31 01:15:00.086478 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.086392 5821 patch_prober.go:29] interesting pod/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 31 01:15:00.086478 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.086453 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" podUID="8900532b-edb2-4cf6-bc7c-d6f60473221c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:15:00.384357 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.384286 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:15:00.437489 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.437460 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:15:00.440819 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.440784 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:15:00.448747 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.448712 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-podinfo\") pod \"8900532b-edb2-4cf6-bc7c-d6f60473221c\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " Oct 31 01:15:00.448928 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.448781 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-token\" (UniqueName: \"kubernetes.io/projected/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-token\") pod \"8900532b-edb2-4cf6-bc7c-d6f60473221c\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " Oct 31 01:15:00.448928 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.448821 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-workload-certs\") pod \"8900532b-edb2-4cf6-bc7c-d6f60473221c\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " Oct 31 01:15:00.448928 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.448871 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-workload-socket\") pod \"8900532b-edb2-4cf6-bc7c-d6f60473221c\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " Oct 31 01:15:00.449108 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.448970 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8900532b-edb2-4cf6-bc7c-d6f60473221c-kube-api-access-fpgrm\" (UniqueName: \"kubernetes.io/projected/8900532b-edb2-4cf6-bc7c-d6f60473221c-kube-api-access-fpgrm\") pod \"8900532b-edb2-4cf6-bc7c-d6f60473221c\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " Oct 31 01:15:00.449108 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.449004 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8900532b-edb2-4cf6-bc7c-d6f60473221c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8900532b-edb2-4cf6-bc7c-d6f60473221c-istiod-ca-cert\") pod \"8900532b-edb2-4cf6-bc7c-d6f60473221c\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " Oct 31 01:15:00.449108 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.449061 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-credential-socket\") pod \"8900532b-edb2-4cf6-bc7c-d6f60473221c\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " Oct 31 01:15:00.449267 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.449183 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-envoy\") pod \"8900532b-edb2-4cf6-bc7c-d6f60473221c\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " Oct 31 01:15:00.449267 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.449227 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-data\") pod \"8900532b-edb2-4cf6-bc7c-d6f60473221c\" (UID: \"8900532b-edb2-4cf6-bc7c-d6f60473221c\") " Oct 31 01:15:00.449982 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.449953 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-data" pod "8900532b-edb2-4cf6-bc7c-d6f60473221c" (UID: "8900532b-edb2-4cf6-bc7c-d6f60473221c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:00.450631 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.450599 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-workload-certs" pod "8900532b-edb2-4cf6-bc7c-d6f60473221c" (UID: "8900532b-edb2-4cf6-bc7c-d6f60473221c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:00.451273 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.451235 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8900532b-edb2-4cf6-bc7c-d6f60473221c-istiod-ca-cert" pod "8900532b-edb2-4cf6-bc7c-d6f60473221c" (UID: "8900532b-edb2-4cf6-bc7c-d6f60473221c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:15:00.452081 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.451939 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-workload-socket" pod "8900532b-edb2-4cf6-bc7c-d6f60473221c" (UID: "8900532b-edb2-4cf6-bc7c-d6f60473221c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:00.452692 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.452656 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-podinfo" pod "8900532b-edb2-4cf6-bc7c-d6f60473221c" (UID: "8900532b-edb2-4cf6-bc7c-d6f60473221c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:15:00.453255 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.453230 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-credential-socket" pod "8900532b-edb2-4cf6-bc7c-d6f60473221c" (UID: "8900532b-edb2-4cf6-bc7c-d6f60473221c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:00.454781 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.454745 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-envoy" pod "8900532b-edb2-4cf6-bc7c-d6f60473221c" (UID: "8900532b-edb2-4cf6-bc7c-d6f60473221c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:00.456177 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.456059 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8900532b-edb2-4cf6-bc7c-d6f60473221c-kube-api-access-fpgrm" pod "8900532b-edb2-4cf6-bc7c-d6f60473221c" (UID: "8900532b-edb2-4cf6-bc7c-d6f60473221c"). InnerVolumeSpecName "kube-api-access-fpgrm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:00.459344 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.459310 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-token" pod "8900532b-edb2-4cf6-bc7c-d6f60473221c" (UID: "8900532b-edb2-4cf6-bc7c-d6f60473221c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:00.551139 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.551095 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-credential-socket\") pod \"280e663b-1387-450a-8d9a-7e9f5d574bb9\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " Oct 31 01:15:00.551446 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.551153 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istiod-ca-cert\") pod \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " Oct 31 01:15:00.551446 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.551212 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-envoy\") pod \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " Oct 31 01:15:00.551446 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.551242 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-data\") pod \"280e663b-1387-450a-8d9a-7e9f5d574bb9\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " Oct 31 01:15:00.551446 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.551295 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/280e663b-1387-450a-8d9a-7e9f5d574bb9-kube-api-access-hgwkq\" (UniqueName: \"kubernetes.io/projected/280e663b-1387-450a-8d9a-7e9f5d574bb9-kube-api-access-hgwkq\") pod \"280e663b-1387-450a-8d9a-7e9f5d574bb9\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " Oct 31 01:15:00.551446 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.551326 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-workload-socket\") pod \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " Oct 31 01:15:00.551446 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.551443 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-kube-api-access-kc894\" (UniqueName: \"kubernetes.io/projected/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-kube-api-access-kc894\") pod \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " Oct 31 01:15:00.551832 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.551441 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-credential-socket" pod "280e663b-1387-450a-8d9a-7e9f5d574bb9" (UID: "280e663b-1387-450a-8d9a-7e9f5d574bb9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:00.551832 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.551527 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-envoy\") pod \"280e663b-1387-450a-8d9a-7e9f5d574bb9\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " Oct 31 01:15:00.551832 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.551531 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istiod-ca-cert" pod "c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" (UID: "c29fdd2e-0a34-44ed-ad24-0b0cf72db33a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:15:00.551832 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.551581 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-workload-socket\") pod \"280e663b-1387-450a-8d9a-7e9f5d574bb9\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " Oct 31 01:15:00.552055 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.551843 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-workload-socket" pod "280e663b-1387-450a-8d9a-7e9f5d574bb9" (UID: "280e663b-1387-450a-8d9a-7e9f5d574bb9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:00.552055 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.551851 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-token\" (UniqueName: \"kubernetes.io/projected/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-token\") pod \"280e663b-1387-450a-8d9a-7e9f5d574bb9\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " Oct 31 01:15:00.552055 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.551902 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-podinfo\") pod \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " Oct 31 01:15:00.552055 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.551933 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-data\") pod \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " Oct 31 01:15:00.552055 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.551982 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-podinfo\") pod \"280e663b-1387-450a-8d9a-7e9f5d574bb9\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " Oct 31 01:15:00.552055 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.552045 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-credential-socket\") pod \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " Oct 31 01:15:00.552370 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.552083 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-workload-certs\") pod \"280e663b-1387-450a-8d9a-7e9f5d574bb9\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " Oct 31 01:15:00.552370 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.552113 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/280e663b-1387-450a-8d9a-7e9f5d574bb9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/280e663b-1387-450a-8d9a-7e9f5d574bb9-istiod-ca-cert\") pod \"280e663b-1387-450a-8d9a-7e9f5d574bb9\" (UID: \"280e663b-1387-450a-8d9a-7e9f5d574bb9\") " Oct 31 01:15:00.552370 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.552196 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-token\" (UniqueName: \"kubernetes.io/projected/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-token\") pod \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " Oct 31 01:15:00.552370 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.552224 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-workload-certs\") pod \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\" (UID: \"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a\") " Oct 31 01:15:00.552596 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.552433 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-data" pod "280e663b-1387-450a-8d9a-7e9f5d574bb9" (UID: "280e663b-1387-450a-8d9a-7e9f5d574bb9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:00.552701 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.552677 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-workload-certs" pod "c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" (UID: "c29fdd2e-0a34-44ed-ad24-0b0cf72db33a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:00.553181 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.552854 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-workload-certs" pod "280e663b-1387-450a-8d9a-7e9f5d574bb9" (UID: "280e663b-1387-450a-8d9a-7e9f5d574bb9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:00.553181 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.552977 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-data" pod "c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" (UID: "c29fdd2e-0a34-44ed-ad24-0b0cf72db33a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:00.553181 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.553144 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/280e663b-1387-450a-8d9a-7e9f5d574bb9-istiod-ca-cert" pod "280e663b-1387-450a-8d9a-7e9f5d574bb9" (UID: "280e663b-1387-450a-8d9a-7e9f5d574bb9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:15:00.553426 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.553251 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-credential-socket" pod "c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" (UID: "c29fdd2e-0a34-44ed-ad24-0b0cf72db33a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:00.553997 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.553771 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.553997 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.553798 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.553997 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.553816 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.553997 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.553831 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.553997 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.553846 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.553997 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.553860 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.553997 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.553875 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpgrm\" (UniqueName: \"kubernetes.io/projected/8900532b-edb2-4cf6-bc7c-d6f60473221c-kube-api-access-fpgrm\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.553997 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.553891 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8900532b-edb2-4cf6-bc7c-d6f60473221c-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.553997 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.553906 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.553997 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.553921 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.553997 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.553935 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.553997 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.553949 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/280e663b-1387-450a-8d9a-7e9f5d574bb9-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.553997 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.553961 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.553997 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.553973 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.553997 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.553985 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.553997 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.553999 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.555196 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.554012 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8900532b-edb2-4cf6-bc7c-d6f60473221c-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.555196 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.554025 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.555196 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.554073 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/280e663b-1387-450a-8d9a-7e9f5d574bb9-kube-api-access-hgwkq" pod "280e663b-1387-450a-8d9a-7e9f5d574bb9" (UID: "280e663b-1387-450a-8d9a-7e9f5d574bb9"). InnerVolumeSpecName "kube-api-access-hgwkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:00.555196 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.554345 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-workload-socket" pod "c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" (UID: "c29fdd2e-0a34-44ed-ad24-0b0cf72db33a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:00.555410 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.555260 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-envoy" pod "280e663b-1387-450a-8d9a-7e9f5d574bb9" (UID: "280e663b-1387-450a-8d9a-7e9f5d574bb9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:00.555620 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.555584 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-envoy" pod "c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" (UID: "c29fdd2e-0a34-44ed-ad24-0b0cf72db33a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:00.555719 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.555635 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-token" pod "280e663b-1387-450a-8d9a-7e9f5d574bb9" (UID: "280e663b-1387-450a-8d9a-7e9f5d574bb9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:00.555884 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.555858 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-podinfo" pod "280e663b-1387-450a-8d9a-7e9f5d574bb9" (UID: "280e663b-1387-450a-8d9a-7e9f5d574bb9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:15:00.556532 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.556512 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-kube-api-access-kc894" pod "c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" (UID: "c29fdd2e-0a34-44ed-ad24-0b0cf72db33a"). InnerVolumeSpecName "kube-api-access-kc894". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:00.556638 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.556531 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-podinfo" pod "c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" (UID: "c29fdd2e-0a34-44ed-ad24-0b0cf72db33a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:15:00.556929 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.556909 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-token" pod "c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" (UID: "c29fdd2e-0a34-44ed-ad24-0b0cf72db33a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:00.655712 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.655679 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.655712 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.655709 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgwkq\" (UniqueName: \"kubernetes.io/projected/280e663b-1387-450a-8d9a-7e9f5d574bb9-kube-api-access-hgwkq\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.655712 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.655721 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.655958 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.655730 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kc894\" (UniqueName: \"kubernetes.io/projected/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-kube-api-access-kc894\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.655958 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.655741 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.655958 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.655749 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.655958 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.655757 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.655958 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.655766 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/280e663b-1387-450a-8d9a-7e9f5d574bb9-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.655958 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.655774 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:00.666435 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.666402 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 31 01:15:00.666599 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.666458 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" podUID="34724cef-6f8d-4da1-9312-7b85f4814d52" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:15:00.753228 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.753179 5821 patch_prober.go:29] interesting pod/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 31 01:15:00.753742 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:00.753269 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" podUID="6106bf2d-96d6-4452-a356-dd23d3de4087" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:15:01.125786 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.125751 5821 generic.go:356] "Generic (PLEG): container finished" podID="8900532b-edb2-4cf6-bc7c-d6f60473221c" containerID="27e9305822b5a40b110b196f034c861d4c9dce5fd290440c043f12a50165c05c" exitCode=0 Oct 31 01:15:01.125953 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.125848 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" event={"ID":"8900532b-edb2-4cf6-bc7c-d6f60473221c","Type":"ContainerDied","Data":"27e9305822b5a40b110b196f034c861d4c9dce5fd290440c043f12a50165c05c"} Oct 31 01:15:01.125953 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.125904 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" event={"ID":"8900532b-edb2-4cf6-bc7c-d6f60473221c","Type":"ContainerDied","Data":"d89244582d40d72812402f4ca5f161b4d778aaaf4e77064fb28a2990b68692ac"} Oct 31 01:15:01.125953 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.125933 5821 scope.go:122] "RemoveContainer" containerID="27e9305822b5a40b110b196f034c861d4c9dce5fd290440c043f12a50165c05c" Oct 31 01:15:01.126147 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.126082 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb" Oct 31 01:15:01.135063 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.135036 5821 generic.go:356] "Generic (PLEG): container finished" podID="280e663b-1387-450a-8d9a-7e9f5d574bb9" containerID="e582aba58db70f5085493c0477ebf4a33d179c2fe4e4027cc9962bff8a8998cd" exitCode=0 Oct 31 01:15:01.135181 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.135084 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" Oct 31 01:15:01.135181 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.135114 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" event={"ID":"280e663b-1387-450a-8d9a-7e9f5d574bb9","Type":"ContainerDied","Data":"e582aba58db70f5085493c0477ebf4a33d179c2fe4e4027cc9962bff8a8998cd"} Oct 31 01:15:01.135181 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.135164 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x" event={"ID":"280e663b-1387-450a-8d9a-7e9f5d574bb9","Type":"ContainerDied","Data":"bbd46bf4b4fcb24ecfb0d518e9ebeb286c7b3b9fe1cce591faa8bed9407b9698"} Oct 31 01:15:01.136757 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.136732 5821 generic.go:356] "Generic (PLEG): container finished" podID="c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" containerID="04bbb849a5d031b6b4e1dcb65da292c97eea3c10239d32b40151beba3c6b7896" exitCode=0 Oct 31 01:15:01.136949 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.136925 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" event={"ID":"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a","Type":"ContainerDied","Data":"04bbb849a5d031b6b4e1dcb65da292c97eea3c10239d32b40151beba3c6b7896"} Oct 31 01:15:01.137020 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.136979 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" event={"ID":"c29fdd2e-0a34-44ed-ad24-0b0cf72db33a","Type":"ContainerDied","Data":"32005af02b1f5074e563b5da11c2d59d00250d288b96a08e6f89eb078427649a"} Oct 31 01:15:01.137020 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.136987 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69" Oct 31 01:15:01.335988 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.335821 5821 scope.go:122] "RemoveContainer" containerID="27e9305822b5a40b110b196f034c861d4c9dce5fd290440c043f12a50165c05c" Oct 31 01:15:01.337705 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:15:01.336210 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27e9305822b5a40b110b196f034c861d4c9dce5fd290440c043f12a50165c05c\": container with ID starting with 27e9305822b5a40b110b196f034c861d4c9dce5fd290440c043f12a50165c05c not found: ID does not exist" containerID="27e9305822b5a40b110b196f034c861d4c9dce5fd290440c043f12a50165c05c" Oct 31 01:15:01.337705 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.336244 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27e9305822b5a40b110b196f034c861d4c9dce5fd290440c043f12a50165c05c"} err="failed to get container status \"27e9305822b5a40b110b196f034c861d4c9dce5fd290440c043f12a50165c05c\": rpc error: code = NotFound desc = could not find container \"27e9305822b5a40b110b196f034c861d4c9dce5fd290440c043f12a50165c05c\": container with ID starting with 27e9305822b5a40b110b196f034c861d4c9dce5fd290440c043f12a50165c05c not found: ID does not exist" Oct 31 01:15:01.337705 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.336265 5821 scope.go:122] "RemoveContainer" containerID="e582aba58db70f5085493c0477ebf4a33d179c2fe4e4027cc9962bff8a8998cd" Oct 31 01:15:01.349604 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.349008 5821 scope.go:122] "RemoveContainer" containerID="e582aba58db70f5085493c0477ebf4a33d179c2fe4e4027cc9962bff8a8998cd" Oct 31 01:15:01.349604 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:15:01.349368 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e582aba58db70f5085493c0477ebf4a33d179c2fe4e4027cc9962bff8a8998cd\": container with ID starting with e582aba58db70f5085493c0477ebf4a33d179c2fe4e4027cc9962bff8a8998cd not found: ID does not exist" containerID="e582aba58db70f5085493c0477ebf4a33d179c2fe4e4027cc9962bff8a8998cd" Oct 31 01:15:01.349604 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.349397 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e582aba58db70f5085493c0477ebf4a33d179c2fe4e4027cc9962bff8a8998cd"} err="failed to get container status \"e582aba58db70f5085493c0477ebf4a33d179c2fe4e4027cc9962bff8a8998cd\": rpc error: code = NotFound desc = could not find container \"e582aba58db70f5085493c0477ebf4a33d179c2fe4e4027cc9962bff8a8998cd\": container with ID starting with e582aba58db70f5085493c0477ebf4a33d179c2fe4e4027cc9962bff8a8998cd not found: ID does not exist" Oct 31 01:15:01.349604 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.349419 5821 scope.go:122] "RemoveContainer" containerID="04bbb849a5d031b6b4e1dcb65da292c97eea3c10239d32b40151beba3c6b7896" Oct 31 01:15:01.355127 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.355049 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb"] Oct 31 01:15:01.366602 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.364567 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-tcfcb"] Oct 31 01:15:01.369412 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.369381 5821 scope.go:122] "RemoveContainer" containerID="04bbb849a5d031b6b4e1dcb65da292c97eea3c10239d32b40151beba3c6b7896" Oct 31 01:15:01.369979 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:15:01.369933 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04bbb849a5d031b6b4e1dcb65da292c97eea3c10239d32b40151beba3c6b7896\": container with ID starting with 04bbb849a5d031b6b4e1dcb65da292c97eea3c10239d32b40151beba3c6b7896 not found: ID does not exist" containerID="04bbb849a5d031b6b4e1dcb65da292c97eea3c10239d32b40151beba3c6b7896" Oct 31 01:15:01.370152 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.369974 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04bbb849a5d031b6b4e1dcb65da292c97eea3c10239d32b40151beba3c6b7896"} err="failed to get container status \"04bbb849a5d031b6b4e1dcb65da292c97eea3c10239d32b40151beba3c6b7896\": rpc error: code = NotFound desc = could not find container \"04bbb849a5d031b6b4e1dcb65da292c97eea3c10239d32b40151beba3c6b7896\": container with ID starting with 04bbb849a5d031b6b4e1dcb65da292c97eea3c10239d32b40151beba3c6b7896 not found: ID does not exist" Oct 31 01:15:01.398469 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.398432 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x"] Oct 31 01:15:01.401893 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.401862 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-f6l7x"] Oct 31 01:15:01.411311 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.411272 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69"] Oct 31 01:15:01.415963 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.415937 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f6d1e-openshift-default-67d6894945-bfv69"] Oct 31 01:15:01.427338 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.427311 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:15:01.429896 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.429872 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:15:01.471162 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.471122 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-workload-socket\") pod \"34724cef-6f8d-4da1-9312-7b85f4814d52\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " Oct 31 01:15:01.471412 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.471390 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-workload-certs\") pod \"34724cef-6f8d-4da1-9312-7b85f4814d52\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " Oct 31 01:15:01.471505 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.471453 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-token\" (UniqueName: \"kubernetes.io/projected/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-token\") pod \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " Oct 31 01:15:01.471593 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.471504 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-envoy\") pod \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " Oct 31 01:15:01.471593 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.471583 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/34724cef-6f8d-4da1-9312-7b85f4814d52-kube-api-access-kwbdw\" (UniqueName: \"kubernetes.io/projected/34724cef-6f8d-4da1-9312-7b85f4814d52-kube-api-access-kwbdw\") pod \"34724cef-6f8d-4da1-9312-7b85f4814d52\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " Oct 31 01:15:01.471712 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.471648 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-credential-socket\") pod \"34724cef-6f8d-4da1-9312-7b85f4814d52\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " Oct 31 01:15:01.471712 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.471692 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-data\") pod \"34724cef-6f8d-4da1-9312-7b85f4814d52\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " Oct 31 01:15:01.471811 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.471782 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-workload-certs\") pod \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " Oct 31 01:15:01.471860 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.471821 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-kube-api-access-cdmzs\" (UniqueName: \"kubernetes.io/projected/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-kube-api-access-cdmzs\") pod \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " Oct 31 01:15:01.471917 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.471892 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istiod-ca-cert\") pod \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " Oct 31 01:15:01.472255 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.472228 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-credential-socket\") pod \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " Oct 31 01:15:01.473903 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.473877 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-podinfo\") pod \"34724cef-6f8d-4da1-9312-7b85f4814d52\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " Oct 31 01:15:01.474137 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.474091 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-workload-socket\") pod \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " Oct 31 01:15:01.474262 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.474245 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/34724cef-6f8d-4da1-9312-7b85f4814d52-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34724cef-6f8d-4da1-9312-7b85f4814d52-istiod-ca-cert\") pod \"34724cef-6f8d-4da1-9312-7b85f4814d52\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " Oct 31 01:15:01.474425 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.474404 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-podinfo\") pod \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " Oct 31 01:15:01.474659 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.474453 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-token\" (UniqueName: \"kubernetes.io/projected/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-token\") pod \"34724cef-6f8d-4da1-9312-7b85f4814d52\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " Oct 31 01:15:01.475226 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.473316 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-workload-certs" pod "34724cef-6f8d-4da1-9312-7b85f4814d52" (UID: "34724cef-6f8d-4da1-9312-7b85f4814d52"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:01.475373 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.473654 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-workload-socket" pod "34724cef-6f8d-4da1-9312-7b85f4814d52" (UID: "34724cef-6f8d-4da1-9312-7b85f4814d52"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:01.475373 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.474502 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istiod-ca-cert" pod "2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" (UID: "2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:15:01.475373 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.474874 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-workload-certs" pod "2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" (UID: "2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:01.475373 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.475049 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-workload-socket" pod "2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" (UID: "2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:01.475373 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.475198 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-credential-socket" pod "2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" (UID: "2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:01.489223 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.475570 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-data" pod "34724cef-6f8d-4da1-9312-7b85f4814d52" (UID: "34724cef-6f8d-4da1-9312-7b85f4814d52"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:01.497993 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.497943 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-credential-socket" pod "34724cef-6f8d-4da1-9312-7b85f4814d52" (UID: "34724cef-6f8d-4da1-9312-7b85f4814d52"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:01.500630 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.500547 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-data" pod "2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" (UID: "2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:01.515206 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.474508 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-data\") pod \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\" (UID: \"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6\") " Oct 31 01:15:01.515206 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.512449 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-envoy\") pod \"34724cef-6f8d-4da1-9312-7b85f4814d52\" (UID: \"34724cef-6f8d-4da1-9312-7b85f4814d52\") " Oct 31 01:15:01.515206 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.513023 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.515206 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.513049 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.515206 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.513063 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.515206 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.513077 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.515206 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.513091 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.515206 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.513104 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.515206 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.513120 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.515206 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.513133 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.515206 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.513147 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.515206 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.513078 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34724cef-6f8d-4da1-9312-7b85f4814d52-istiod-ca-cert" pod "34724cef-6f8d-4da1-9312-7b85f4814d52" (UID: "34724cef-6f8d-4da1-9312-7b85f4814d52"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:15:01.535008 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.533320 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-token" pod "34724cef-6f8d-4da1-9312-7b85f4814d52" (UID: "34724cef-6f8d-4da1-9312-7b85f4814d52"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:01.554778 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.554738 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-podinfo" pod "2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" (UID: "2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:15:01.555007 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.554738 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-envoy" pod "2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" (UID: "2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:01.555007 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.554748 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-envoy" pod "34724cef-6f8d-4da1-9312-7b85f4814d52" (UID: "34724cef-6f8d-4da1-9312-7b85f4814d52"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:01.555138 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.554779 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-token" pod "2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" (UID: "2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:01.555138 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.554795 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34724cef-6f8d-4da1-9312-7b85f4814d52-kube-api-access-kwbdw" pod "34724cef-6f8d-4da1-9312-7b85f4814d52" (UID: "34724cef-6f8d-4da1-9312-7b85f4814d52"). InnerVolumeSpecName "kube-api-access-kwbdw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:01.555138 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.554798 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-podinfo" pod "34724cef-6f8d-4da1-9312-7b85f4814d52" (UID: "34724cef-6f8d-4da1-9312-7b85f4814d52"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:15:01.555138 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.554806 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-kube-api-access-cdmzs" pod "2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" (UID: "2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6"). InnerVolumeSpecName "kube-api-access-cdmzs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:01.573721 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.573694 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:15:01.581113 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.581079 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="243c8dfb-7210-4abc-987d-fdcc3ab9cc9c" path="/var/lib/kubelet/pods/243c8dfb-7210-4abc-987d-fdcc3ab9cc9c/volumes" Oct 31 01:15:01.581314 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.581294 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:15:01.581641 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.581623 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="280e663b-1387-450a-8d9a-7e9f5d574bb9" path="/var/lib/kubelet/pods/280e663b-1387-450a-8d9a-7e9f5d574bb9/volumes" Oct 31 01:15:01.582114 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.582100 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8900532b-edb2-4cf6-bc7c-d6f60473221c" path="/var/lib/kubelet/pods/8900532b-edb2-4cf6-bc7c-d6f60473221c/volumes" Oct 31 01:15:01.582977 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.582958 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" path="/var/lib/kubelet/pods/c29fdd2e-0a34-44ed-ad24-0b0cf72db33a/volumes" Oct 31 01:15:01.614870 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.614837 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdmzs\" (UniqueName: \"kubernetes.io/projected/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-kube-api-access-cdmzs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.614870 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.614865 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.614870 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.614879 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34724cef-6f8d-4da1-9312-7b85f4814d52-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.615171 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.614888 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.615171 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.614897 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.615171 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.614904 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34724cef-6f8d-4da1-9312-7b85f4814d52-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.615171 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.614912 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.615171 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.614921 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.615171 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.614955 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwbdw\" (UniqueName: \"kubernetes.io/projected/34724cef-6f8d-4da1-9312-7b85f4814d52-kube-api-access-kwbdw\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.716009 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.715967 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-data\") pod \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " Oct 31 01:15:01.716183 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.716033 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-workload-socket\") pod \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " Oct 31 01:15:01.716183 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.716076 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-workload-certs\") pod \"6106bf2d-96d6-4452-a356-dd23d3de4087\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " Oct 31 01:15:01.716183 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.716153 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-token\" (UniqueName: \"kubernetes.io/projected/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-token\") pod \"6106bf2d-96d6-4452-a356-dd23d3de4087\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " Oct 31 01:15:01.716364 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.716191 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-data\") pod \"6106bf2d-96d6-4452-a356-dd23d3de4087\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " Oct 31 01:15:01.716364 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.716239 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-token\" (UniqueName: \"kubernetes.io/projected/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-token\") pod \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " Oct 31 01:15:01.716364 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.716261 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6106bf2d-96d6-4452-a356-dd23d3de4087-kube-api-access-4h9zd\" (UniqueName: \"kubernetes.io/projected/6106bf2d-96d6-4452-a356-dd23d3de4087-kube-api-access-4h9zd\") pod \"6106bf2d-96d6-4452-a356-dd23d3de4087\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " Oct 31 01:15:01.716364 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.716286 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-kube-api-access-j9cc4\" (UniqueName: \"kubernetes.io/projected/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-kube-api-access-j9cc4\") pod \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " Oct 31 01:15:01.716603 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.716420 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-data" pod "bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" (UID: "bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:01.716603 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.716506 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-workload-socket\") pod \"6106bf2d-96d6-4452-a356-dd23d3de4087\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " Oct 31 01:15:01.716717 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.716598 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-workload-certs" pod "6106bf2d-96d6-4452-a356-dd23d3de4087" (UID: "6106bf2d-96d6-4452-a356-dd23d3de4087"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:01.716717 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.716675 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-workload-socket" pod "bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" (UID: "bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:01.716717 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.716682 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-data" pod "6106bf2d-96d6-4452-a356-dd23d3de4087" (UID: "6106bf2d-96d6-4452-a356-dd23d3de4087"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:01.716874 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.716756 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-envoy\") pod \"6106bf2d-96d6-4452-a356-dd23d3de4087\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " Oct 31 01:15:01.716874 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.716813 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-workload-certs\") pod \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " Oct 31 01:15:01.716874 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.716848 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-podinfo\") pod \"6106bf2d-96d6-4452-a356-dd23d3de4087\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " Oct 31 01:15:01.717025 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.717001 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-workload-socket" pod "6106bf2d-96d6-4452-a356-dd23d3de4087" (UID: "6106bf2d-96d6-4452-a356-dd23d3de4087"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:01.717151 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.717122 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-podinfo\") pod \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " Oct 31 01:15:01.718564 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.717475 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-credential-socket\") pod \"6106bf2d-96d6-4452-a356-dd23d3de4087\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " Oct 31 01:15:01.718564 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.717515 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-envoy\") pod \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " Oct 31 01:15:01.718564 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.717624 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6106bf2d-96d6-4452-a356-dd23d3de4087-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6106bf2d-96d6-4452-a356-dd23d3de4087-istiod-ca-cert\") pod \"6106bf2d-96d6-4452-a356-dd23d3de4087\" (UID: \"6106bf2d-96d6-4452-a356-dd23d3de4087\") " Oct 31 01:15:01.718564 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.717675 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-credential-socket\") pod \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " Oct 31 01:15:01.718564 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.717726 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istiod-ca-cert\") pod \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\" (UID: \"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f\") " Oct 31 01:15:01.718564 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.718238 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.718564 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.718259 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.718564 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.718273 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.718564 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.718292 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.718564 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.718305 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.719936 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.717198 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-workload-certs" pod "bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" (UID: "bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:01.719936 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.719283 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-kube-api-access-j9cc4" pod "bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" (UID: "bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f"). InnerVolumeSpecName "kube-api-access-j9cc4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:01.719936 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.719069 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6106bf2d-96d6-4452-a356-dd23d3de4087-istiod-ca-cert" pod "6106bf2d-96d6-4452-a356-dd23d3de4087" (UID: "6106bf2d-96d6-4452-a356-dd23d3de4087"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:15:01.719936 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.719302 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-token" pod "6106bf2d-96d6-4452-a356-dd23d3de4087" (UID: "6106bf2d-96d6-4452-a356-dd23d3de4087"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:01.719936 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.719313 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6106bf2d-96d6-4452-a356-dd23d3de4087-kube-api-access-4h9zd" pod "6106bf2d-96d6-4452-a356-dd23d3de4087" (UID: "6106bf2d-96d6-4452-a356-dd23d3de4087"). InnerVolumeSpecName "kube-api-access-4h9zd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:01.719936 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.719327 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-credential-socket" pod "bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" (UID: "bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:01.719936 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.719469 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-credential-socket" pod "6106bf2d-96d6-4452-a356-dd23d3de4087" (UID: "6106bf2d-96d6-4452-a356-dd23d3de4087"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:01.719936 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.719727 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-envoy" pod "6106bf2d-96d6-4452-a356-dd23d3de4087" (UID: "6106bf2d-96d6-4452-a356-dd23d3de4087"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:01.719936 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.719923 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-podinfo" pod "bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" (UID: "bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:15:01.720364 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.720343 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-token" pod "bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" (UID: "bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:01.720436 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.720417 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-podinfo" pod "6106bf2d-96d6-4452-a356-dd23d3de4087" (UID: "6106bf2d-96d6-4452-a356-dd23d3de4087"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:15:01.720469 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.720434 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istiod-ca-cert" pod "bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" (UID: "bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:15:01.721077 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.721061 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-envoy" pod "bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" (UID: "bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:01.819373 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.819332 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.819373 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.819372 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.819856 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.819387 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h9zd\" (UniqueName: \"kubernetes.io/projected/6106bf2d-96d6-4452-a356-dd23d3de4087-kube-api-access-4h9zd\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.819856 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.819403 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9cc4\" (UniqueName: \"kubernetes.io/projected/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-kube-api-access-j9cc4\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.819856 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.819416 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.819856 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.819431 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.819856 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.819445 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6106bf2d-96d6-4452-a356-dd23d3de4087-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.819856 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.819457 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.819856 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.819468 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6106bf2d-96d6-4452-a356-dd23d3de4087-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.819856 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.819481 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.819856 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.819494 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6106bf2d-96d6-4452-a356-dd23d3de4087-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.819856 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.819507 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:01.819856 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:01.819518 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:02.148231 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.148192 5821 generic.go:356] "Generic (PLEG): container finished" podID="34724cef-6f8d-4da1-9312-7b85f4814d52" containerID="4e18bdafaf8d8b2fee4107bbbaa926f5bf8f266f77ada4473979f98fb05f1978" exitCode=0 Oct 31 01:15:02.148231 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.148243 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" Oct 31 01:15:02.148508 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.148297 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" event={"ID":"34724cef-6f8d-4da1-9312-7b85f4814d52","Type":"ContainerDied","Data":"4e18bdafaf8d8b2fee4107bbbaa926f5bf8f266f77ada4473979f98fb05f1978"} Oct 31 01:15:02.148508 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.148376 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l" event={"ID":"34724cef-6f8d-4da1-9312-7b85f4814d52","Type":"ContainerDied","Data":"c417ed7712c382b7f5d26d0653e79d6c3a1d7c7479b6464138a04a3eb4353495"} Oct 31 01:15:02.148508 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.148410 5821 scope.go:122] "RemoveContainer" containerID="4e18bdafaf8d8b2fee4107bbbaa926f5bf8f266f77ada4473979f98fb05f1978" Oct 31 01:15:02.149801 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.149777 5821 generic.go:356] "Generic (PLEG): container finished" podID="bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" containerID="85b4611fb17f474bacad76a19fc0c764c9836c0708c1c57eb99e9861bea8cf98" exitCode=0 Oct 31 01:15:02.149918 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.149822 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" Oct 31 01:15:02.149918 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.149856 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" event={"ID":"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f","Type":"ContainerDied","Data":"85b4611fb17f474bacad76a19fc0c764c9836c0708c1c57eb99e9861bea8cf98"} Oct 31 01:15:02.149918 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.149910 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh" event={"ID":"bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f","Type":"ContainerDied","Data":"59cce3802eea0503d9f78739ee5615dd8698b12cf2200c5c09b34ed5a981883d"} Oct 31 01:15:02.151473 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.151445 5821 generic.go:356] "Generic (PLEG): container finished" podID="2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" containerID="2eddd3e2ed0dd3830b7cc3442058a3ea3a81af6b1d247d0c51657a1fc96d17f2" exitCode=0 Oct 31 01:15:02.151625 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.151542 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" Oct 31 01:15:02.151625 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.151595 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" event={"ID":"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6","Type":"ContainerDied","Data":"2eddd3e2ed0dd3830b7cc3442058a3ea3a81af6b1d247d0c51657a1fc96d17f2"} Oct 31 01:15:02.151734 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.151642 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp" event={"ID":"2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6","Type":"ContainerDied","Data":"54b7f3c770b533c1149a596373d83966000bbbdf5448589da97004c7339ede90"} Oct 31 01:15:02.153277 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.153244 5821 generic.go:356] "Generic (PLEG): container finished" podID="6106bf2d-96d6-4452-a356-dd23d3de4087" containerID="b446f47f03bbe640da3a67cf48a3882144c63746fe2742b30a5dfcb0a677d591" exitCode=0 Oct 31 01:15:02.153379 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.153334 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" event={"ID":"6106bf2d-96d6-4452-a356-dd23d3de4087","Type":"ContainerDied","Data":"b446f47f03bbe640da3a67cf48a3882144c63746fe2742b30a5dfcb0a677d591"} Oct 31 01:15:02.153379 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.153373 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" event={"ID":"6106bf2d-96d6-4452-a356-dd23d3de4087","Type":"ContainerDied","Data":"deb1fc7588669fb291e373707eb97f6cc8bdf47778ea6012fbfe988fe337f316"} Oct 31 01:15:02.153483 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.153441 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz" Oct 31 01:15:02.159588 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.159534 5821 scope.go:122] "RemoveContainer" containerID="4e18bdafaf8d8b2fee4107bbbaa926f5bf8f266f77ada4473979f98fb05f1978" Oct 31 01:15:02.159981 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:15:02.159946 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e18bdafaf8d8b2fee4107bbbaa926f5bf8f266f77ada4473979f98fb05f1978\": container with ID starting with 4e18bdafaf8d8b2fee4107bbbaa926f5bf8f266f77ada4473979f98fb05f1978 not found: ID does not exist" containerID="4e18bdafaf8d8b2fee4107bbbaa926f5bf8f266f77ada4473979f98fb05f1978" Oct 31 01:15:02.160070 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.159991 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e18bdafaf8d8b2fee4107bbbaa926f5bf8f266f77ada4473979f98fb05f1978"} err="failed to get container status \"4e18bdafaf8d8b2fee4107bbbaa926f5bf8f266f77ada4473979f98fb05f1978\": rpc error: code = NotFound desc = could not find container \"4e18bdafaf8d8b2fee4107bbbaa926f5bf8f266f77ada4473979f98fb05f1978\": container with ID starting with 4e18bdafaf8d8b2fee4107bbbaa926f5bf8f266f77ada4473979f98fb05f1978 not found: ID does not exist" Oct 31 01:15:02.160070 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.160011 5821 scope.go:122] "RemoveContainer" containerID="85b4611fb17f474bacad76a19fc0c764c9836c0708c1c57eb99e9861bea8cf98" Oct 31 01:15:02.172787 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.172764 5821 scope.go:122] "RemoveContainer" containerID="85b4611fb17f474bacad76a19fc0c764c9836c0708c1c57eb99e9861bea8cf98" Oct 31 01:15:02.173310 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:15:02.173259 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85b4611fb17f474bacad76a19fc0c764c9836c0708c1c57eb99e9861bea8cf98\": container with ID starting with 85b4611fb17f474bacad76a19fc0c764c9836c0708c1c57eb99e9861bea8cf98 not found: ID does not exist" containerID="85b4611fb17f474bacad76a19fc0c764c9836c0708c1c57eb99e9861bea8cf98" Oct 31 01:15:02.173422 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.173313 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85b4611fb17f474bacad76a19fc0c764c9836c0708c1c57eb99e9861bea8cf98"} err="failed to get container status \"85b4611fb17f474bacad76a19fc0c764c9836c0708c1c57eb99e9861bea8cf98\": rpc error: code = NotFound desc = could not find container \"85b4611fb17f474bacad76a19fc0c764c9836c0708c1c57eb99e9861bea8cf98\": container with ID starting with 85b4611fb17f474bacad76a19fc0c764c9836c0708c1c57eb99e9861bea8cf98 not found: ID does not exist" Oct 31 01:15:02.173422 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.173378 5821 scope.go:122] "RemoveContainer" containerID="2eddd3e2ed0dd3830b7cc3442058a3ea3a81af6b1d247d0c51657a1fc96d17f2" Oct 31 01:15:02.175104 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.175064 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l"] Oct 31 01:15:02.182260 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.182234 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-m6s7l"] Oct 31 01:15:02.185918 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.185898 5821 scope.go:122] "RemoveContainer" containerID="2eddd3e2ed0dd3830b7cc3442058a3ea3a81af6b1d247d0c51657a1fc96d17f2" Oct 31 01:15:02.186274 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:15:02.186249 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eddd3e2ed0dd3830b7cc3442058a3ea3a81af6b1d247d0c51657a1fc96d17f2\": container with ID starting with 2eddd3e2ed0dd3830b7cc3442058a3ea3a81af6b1d247d0c51657a1fc96d17f2 not found: ID does not exist" containerID="2eddd3e2ed0dd3830b7cc3442058a3ea3a81af6b1d247d0c51657a1fc96d17f2" Oct 31 01:15:02.186363 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.186282 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eddd3e2ed0dd3830b7cc3442058a3ea3a81af6b1d247d0c51657a1fc96d17f2"} err="failed to get container status \"2eddd3e2ed0dd3830b7cc3442058a3ea3a81af6b1d247d0c51657a1fc96d17f2\": rpc error: code = NotFound desc = could not find container \"2eddd3e2ed0dd3830b7cc3442058a3ea3a81af6b1d247d0c51657a1fc96d17f2\": container with ID starting with 2eddd3e2ed0dd3830b7cc3442058a3ea3a81af6b1d247d0c51657a1fc96d17f2 not found: ID does not exist" Oct 31 01:15:02.186363 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.186301 5821 scope.go:122] "RemoveContainer" containerID="b446f47f03bbe640da3a67cf48a3882144c63746fe2742b30a5dfcb0a677d591" Oct 31 01:15:02.195995 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.195972 5821 scope.go:122] "RemoveContainer" containerID="b446f47f03bbe640da3a67cf48a3882144c63746fe2742b30a5dfcb0a677d591" Oct 31 01:15:02.196283 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:15:02.196261 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b446f47f03bbe640da3a67cf48a3882144c63746fe2742b30a5dfcb0a677d591\": container with ID starting with b446f47f03bbe640da3a67cf48a3882144c63746fe2742b30a5dfcb0a677d591 not found: ID does not exist" containerID="b446f47f03bbe640da3a67cf48a3882144c63746fe2742b30a5dfcb0a677d591" Oct 31 01:15:02.196353 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.196295 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b446f47f03bbe640da3a67cf48a3882144c63746fe2742b30a5dfcb0a677d591"} err="failed to get container status \"b446f47f03bbe640da3a67cf48a3882144c63746fe2742b30a5dfcb0a677d591\": rpc error: code = NotFound desc = could not find container \"b446f47f03bbe640da3a67cf48a3882144c63746fe2742b30a5dfcb0a677d591\": container with ID starting with b446f47f03bbe640da3a67cf48a3882144c63746fe2742b30a5dfcb0a677d591 not found: ID does not exist" Oct 31 01:15:02.197521 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.197502 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp"] Oct 31 01:15:02.206247 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.206213 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4xbvp"] Oct 31 01:15:02.255578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.247600 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh"] Oct 31 01:15:02.277470 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.259399 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-4shkh"] Oct 31 01:15:02.337195 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.337088 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz"] Oct 31 01:15:02.337495 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:02.337474 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-28ff08-openshift-default-7c95bbc97f-445cz"] Oct 31 01:15:03.437338 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:03.437300 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg"] Oct 31 01:15:03.466755 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:03.466722 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8"] Oct 31 01:15:03.565740 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:03.565708 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" path="/var/lib/kubelet/pods/2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6/volumes" Oct 31 01:15:03.566314 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:03.566297 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="34724cef-6f8d-4da1-9312-7b85f4814d52" path="/var/lib/kubelet/pods/34724cef-6f8d-4da1-9312-7b85f4814d52/volumes" Oct 31 01:15:03.566732 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:03.566719 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6106bf2d-96d6-4452-a356-dd23d3de4087" path="/var/lib/kubelet/pods/6106bf2d-96d6-4452-a356-dd23d3de4087/volumes" Oct 31 01:15:03.567446 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:03.567432 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" path="/var/lib/kubelet/pods/bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f/volumes" Oct 31 01:15:06.841183 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:06.841148 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9"] Oct 31 01:15:06.841669 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:06.841397 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" podUID="53e0539d-33d9-4c6c-afb8-0e67e95e18d5" containerName="istio-proxy" containerID="cri-o://32244b9756e687f2d6d0541d1bfa95ef4c11ab1dfb4c9d29225bdd7f33778231" gracePeriod=30 Oct 31 01:15:06.859147 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:06.859103 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds"] Oct 31 01:15:06.859336 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:06.859306 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" podUID="97628062-0839-49a3-ac40-e0b13d862da6" containerName="istio-proxy" containerID="cri-o://8e463b77ea6b26bdf2371fe95f6a3bcbfa792ae686167eadc203cd3fad6a43c7" gracePeriod=30 Oct 31 01:15:06.876132 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:06.876093 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh"] Oct 31 01:15:06.876337 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:06.876311 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" podUID="fc1e8160-8f4e-4be3-96a9-b2d5b339959b" containerName="istio-proxy" containerID="cri-o://e7dd2e7b862601adadca9e595a9b1f139b294897143402e6a541e07cfc1496a1" gracePeriod=30 Oct 31 01:15:12.136408 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.136374 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:15:12.183700 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.183406 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:15:12.213737 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.213698 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:15:12.230221 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.230185 5821 generic.go:356] "Generic (PLEG): container finished" podID="53e0539d-33d9-4c6c-afb8-0e67e95e18d5" containerID="32244b9756e687f2d6d0541d1bfa95ef4c11ab1dfb4c9d29225bdd7f33778231" exitCode=0 Oct 31 01:15:12.230221 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.230224 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" Oct 31 01:15:12.230478 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.230270 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" event={"ID":"53e0539d-33d9-4c6c-afb8-0e67e95e18d5","Type":"ContainerDied","Data":"32244b9756e687f2d6d0541d1bfa95ef4c11ab1dfb4c9d29225bdd7f33778231"} Oct 31 01:15:12.230478 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.230350 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9" event={"ID":"53e0539d-33d9-4c6c-afb8-0e67e95e18d5","Type":"ContainerDied","Data":"d01ed1588a3c88b48d868969d30e875a31c5580ee62c2d1d64494169c07a9716"} Oct 31 01:15:12.230478 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.230394 5821 scope.go:122] "RemoveContainer" containerID="32244b9756e687f2d6d0541d1bfa95ef4c11ab1dfb4c9d29225bdd7f33778231" Oct 31 01:15:12.232054 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.232026 5821 generic.go:356] "Generic (PLEG): container finished" podID="fc1e8160-8f4e-4be3-96a9-b2d5b339959b" containerID="e7dd2e7b862601adadca9e595a9b1f139b294897143402e6a541e07cfc1496a1" exitCode=0 Oct 31 01:15:12.232179 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.232070 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" Oct 31 01:15:12.232179 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.232103 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" event={"ID":"fc1e8160-8f4e-4be3-96a9-b2d5b339959b","Type":"ContainerDied","Data":"e7dd2e7b862601adadca9e595a9b1f139b294897143402e6a541e07cfc1496a1"} Oct 31 01:15:12.232291 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.232181 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh" event={"ID":"fc1e8160-8f4e-4be3-96a9-b2d5b339959b","Type":"ContainerDied","Data":"52585a6f1ca91199b8a38f9ba2f8673820ccb78ca526574a2b12e9ea947931ce"} Oct 31 01:15:12.233712 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.233692 5821 generic.go:356] "Generic (PLEG): container finished" podID="97628062-0839-49a3-ac40-e0b13d862da6" containerID="8e463b77ea6b26bdf2371fe95f6a3bcbfa792ae686167eadc203cd3fad6a43c7" exitCode=0 Oct 31 01:15:12.233812 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.233742 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" event={"ID":"97628062-0839-49a3-ac40-e0b13d862da6","Type":"ContainerDied","Data":"8e463b77ea6b26bdf2371fe95f6a3bcbfa792ae686167eadc203cd3fad6a43c7"} Oct 31 01:15:12.233812 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.233754 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" Oct 31 01:15:12.233812 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.233773 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds" event={"ID":"97628062-0839-49a3-ac40-e0b13d862da6","Type":"ContainerDied","Data":"5ef43f65df71d11f7103807401e78bdc960362107e1a61309d089dd3c22f0081"} Oct 31 01:15:12.240795 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.240771 5821 scope.go:122] "RemoveContainer" containerID="32244b9756e687f2d6d0541d1bfa95ef4c11ab1dfb4c9d29225bdd7f33778231" Oct 31 01:15:12.241140 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:15:12.241111 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32244b9756e687f2d6d0541d1bfa95ef4c11ab1dfb4c9d29225bdd7f33778231\": container with ID starting with 32244b9756e687f2d6d0541d1bfa95ef4c11ab1dfb4c9d29225bdd7f33778231 not found: ID does not exist" containerID="32244b9756e687f2d6d0541d1bfa95ef4c11ab1dfb4c9d29225bdd7f33778231" Oct 31 01:15:12.241233 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.241143 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32244b9756e687f2d6d0541d1bfa95ef4c11ab1dfb4c9d29225bdd7f33778231"} err="failed to get container status \"32244b9756e687f2d6d0541d1bfa95ef4c11ab1dfb4c9d29225bdd7f33778231\": rpc error: code = NotFound desc = could not find container \"32244b9756e687f2d6d0541d1bfa95ef4c11ab1dfb4c9d29225bdd7f33778231\": container with ID starting with 32244b9756e687f2d6d0541d1bfa95ef4c11ab1dfb4c9d29225bdd7f33778231 not found: ID does not exist" Oct 31 01:15:12.241233 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.241172 5821 scope.go:122] "RemoveContainer" containerID="e7dd2e7b862601adadca9e595a9b1f139b294897143402e6a541e07cfc1496a1" Oct 31 01:15:12.256898 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.256870 5821 scope.go:122] "RemoveContainer" containerID="e7dd2e7b862601adadca9e595a9b1f139b294897143402e6a541e07cfc1496a1" Oct 31 01:15:12.257240 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:15:12.257214 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7dd2e7b862601adadca9e595a9b1f139b294897143402e6a541e07cfc1496a1\": container with ID starting with e7dd2e7b862601adadca9e595a9b1f139b294897143402e6a541e07cfc1496a1 not found: ID does not exist" containerID="e7dd2e7b862601adadca9e595a9b1f139b294897143402e6a541e07cfc1496a1" Oct 31 01:15:12.257355 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.257255 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7dd2e7b862601adadca9e595a9b1f139b294897143402e6a541e07cfc1496a1"} err="failed to get container status \"e7dd2e7b862601adadca9e595a9b1f139b294897143402e6a541e07cfc1496a1\": rpc error: code = NotFound desc = could not find container \"e7dd2e7b862601adadca9e595a9b1f139b294897143402e6a541e07cfc1496a1\": container with ID starting with e7dd2e7b862601adadca9e595a9b1f139b294897143402e6a541e07cfc1496a1 not found: ID does not exist" Oct 31 01:15:12.257355 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.257280 5821 scope.go:122] "RemoveContainer" containerID="8e463b77ea6b26bdf2371fe95f6a3bcbfa792ae686167eadc203cd3fad6a43c7" Oct 31 01:15:12.269764 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.269737 5821 scope.go:122] "RemoveContainer" containerID="8e463b77ea6b26bdf2371fe95f6a3bcbfa792ae686167eadc203cd3fad6a43c7" Oct 31 01:15:12.270176 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:15:12.270150 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e463b77ea6b26bdf2371fe95f6a3bcbfa792ae686167eadc203cd3fad6a43c7\": container with ID starting with 8e463b77ea6b26bdf2371fe95f6a3bcbfa792ae686167eadc203cd3fad6a43c7 not found: ID does not exist" containerID="8e463b77ea6b26bdf2371fe95f6a3bcbfa792ae686167eadc203cd3fad6a43c7" Oct 31 01:15:12.270301 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.270181 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e463b77ea6b26bdf2371fe95f6a3bcbfa792ae686167eadc203cd3fad6a43c7"} err="failed to get container status \"8e463b77ea6b26bdf2371fe95f6a3bcbfa792ae686167eadc203cd3fad6a43c7\": rpc error: code = NotFound desc = could not find container \"8e463b77ea6b26bdf2371fe95f6a3bcbfa792ae686167eadc203cd3fad6a43c7\": container with ID starting with 8e463b77ea6b26bdf2371fe95f6a3bcbfa792ae686167eadc203cd3fad6a43c7 not found: ID does not exist" Oct 31 01:15:12.275637 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.275610 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-istio-envoy\") pod \"97628062-0839-49a3-ac40-e0b13d862da6\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " Oct 31 01:15:12.275735 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.275657 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-data\") pod \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " Oct 31 01:15:12.275735 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.275689 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-credential-socket\") pod \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " Oct 31 01:15:12.275735 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.275719 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-kube-api-access-v65dg\" (UniqueName: \"kubernetes.io/projected/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-kube-api-access-v65dg\") pod \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " Oct 31 01:15:12.275885 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.275749 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-istio-data\") pod \"97628062-0839-49a3-ac40-e0b13d862da6\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " Oct 31 01:15:12.275885 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.275797 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-workload-socket\") pod \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " Oct 31 01:15:12.275885 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.275831 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-workload-certs\") pod \"97628062-0839-49a3-ac40-e0b13d862da6\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " Oct 31 01:15:12.275885 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.275864 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-envoy\") pod \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " Oct 31 01:15:12.276084 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.275899 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-envoy\") pod \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " Oct 31 01:15:12.276084 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.275933 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/97628062-0839-49a3-ac40-e0b13d862da6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97628062-0839-49a3-ac40-e0b13d862da6-istiod-ca-cert\") pod \"97628062-0839-49a3-ac40-e0b13d862da6\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " Oct 31 01:15:12.276084 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.275963 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-kube-api-access-jtgm9\" (UniqueName: \"kubernetes.io/projected/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-kube-api-access-jtgm9\") pod \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " Oct 31 01:15:12.276084 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.275989 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-token\" (UniqueName: \"kubernetes.io/projected/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-token\") pod \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " Oct 31 01:15:12.276084 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.276042 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-credential-socket" pod "fc1e8160-8f4e-4be3-96a9-b2d5b339959b" (UID: "fc1e8160-8f4e-4be3-96a9-b2d5b339959b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:12.277000 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.276315 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-workload-socket" pod "fc1e8160-8f4e-4be3-96a9-b2d5b339959b" (UID: "fc1e8160-8f4e-4be3-96a9-b2d5b339959b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:12.277000 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.276414 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-data" pod "fc1e8160-8f4e-4be3-96a9-b2d5b339959b" (UID: "fc1e8160-8f4e-4be3-96a9-b2d5b339959b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:12.277000 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.276429 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-credential-socket\") pod \"97628062-0839-49a3-ac40-e0b13d862da6\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " Oct 31 01:15:12.277000 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.276407 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-workload-certs" pod "97628062-0839-49a3-ac40-e0b13d862da6" (UID: "97628062-0839-49a3-ac40-e0b13d862da6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:12.277000 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.276483 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-workload-certs\") pod \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " Oct 31 01:15:12.277000 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.276518 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97628062-0839-49a3-ac40-e0b13d862da6-istiod-ca-cert" pod "97628062-0839-49a3-ac40-e0b13d862da6" (UID: "97628062-0839-49a3-ac40-e0b13d862da6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:15:12.277000 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.276524 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-data\") pod \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " Oct 31 01:15:12.277000 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.276600 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-credential-socket\") pod \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " Oct 31 01:15:12.277000 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.276641 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istiod-ca-cert\") pod \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " Oct 31 01:15:12.277000 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.276741 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-istio-data" pod "97628062-0839-49a3-ac40-e0b13d862da6" (UID: "97628062-0839-49a3-ac40-e0b13d862da6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:12.277000 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.276802 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/97628062-0839-49a3-ac40-e0b13d862da6-istio-token\" (UniqueName: \"kubernetes.io/projected/97628062-0839-49a3-ac40-e0b13d862da6-istio-token\") pod \"97628062-0839-49a3-ac40-e0b13d862da6\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " Oct 31 01:15:12.277000 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.276856 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-workload-socket\") pod \"97628062-0839-49a3-ac40-e0b13d862da6\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " Oct 31 01:15:12.277000 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.276912 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/97628062-0839-49a3-ac40-e0b13d862da6-kube-api-access-fgldr\" (UniqueName: \"kubernetes.io/projected/97628062-0839-49a3-ac40-e0b13d862da6-kube-api-access-fgldr\") pod \"97628062-0839-49a3-ac40-e0b13d862da6\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " Oct 31 01:15:12.277000 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.276954 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-podinfo\") pod \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " Oct 31 01:15:12.277000 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.276986 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-workload-certs" pod "53e0539d-33d9-4c6c-afb8-0e67e95e18d5" (UID: "53e0539d-33d9-4c6c-afb8-0e67e95e18d5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:12.277000 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.277003 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-credential-socket" pod "97628062-0839-49a3-ac40-e0b13d862da6" (UID: "97628062-0839-49a3-ac40-e0b13d862da6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:12.277960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.277009 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-workload-socket\") pod \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " Oct 31 01:15:12.277960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.277083 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istiod-ca-cert\") pod \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " Oct 31 01:15:12.277960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.277117 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-workload-certs\") pod \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " Oct 31 01:15:12.277960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.277172 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-workload-socket" pod "53e0539d-33d9-4c6c-afb8-0e67e95e18d5" (UID: "53e0539d-33d9-4c6c-afb8-0e67e95e18d5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:12.277960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.277179 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-workload-socket" pod "97628062-0839-49a3-ac40-e0b13d862da6" (UID: "97628062-0839-49a3-ac40-e0b13d862da6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:12.277960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.277205 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istiod-ca-cert" pod "fc1e8160-8f4e-4be3-96a9-b2d5b339959b" (UID: "fc1e8160-8f4e-4be3-96a9-b2d5b339959b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:15:12.277960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.277462 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-credential-socket" pod "53e0539d-33d9-4c6c-afb8-0e67e95e18d5" (UID: "53e0539d-33d9-4c6c-afb8-0e67e95e18d5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:12.277960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.277705 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-workload-certs" pod "fc1e8160-8f4e-4be3-96a9-b2d5b339959b" (UID: "fc1e8160-8f4e-4be3-96a9-b2d5b339959b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:12.277960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.277714 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-token\" (UniqueName: \"kubernetes.io/projected/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-token\") pod \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\" (UID: \"53e0539d-33d9-4c6c-afb8-0e67e95e18d5\") " Oct 31 01:15:12.277960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.277758 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-podinfo\") pod \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\" (UID: \"fc1e8160-8f4e-4be3-96a9-b2d5b339959b\") " Oct 31 01:15:12.277960 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.277816 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/97628062-0839-49a3-ac40-e0b13d862da6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97628062-0839-49a3-ac40-e0b13d862da6-istio-podinfo\") pod \"97628062-0839-49a3-ac40-e0b13d862da6\" (UID: \"97628062-0839-49a3-ac40-e0b13d862da6\") " Oct 31 01:15:12.278529 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.278043 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istiod-ca-cert" pod "53e0539d-33d9-4c6c-afb8-0e67e95e18d5" (UID: "53e0539d-33d9-4c6c-afb8-0e67e95e18d5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:15:12.278529 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.278291 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.278529 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.278321 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.278529 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.278338 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.278529 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.278352 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.278529 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.278366 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.278529 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.278379 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97628062-0839-49a3-ac40-e0b13d862da6-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.278529 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.278393 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.278529 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.278408 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.278529 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.278421 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.278529 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.278437 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.278529 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.278451 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.278529 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.278464 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.278529 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.278478 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.278529 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.278492 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.279310 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.278541 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-data" pod "53e0539d-33d9-4c6c-afb8-0e67e95e18d5" (UID: "53e0539d-33d9-4c6c-afb8-0e67e95e18d5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:12.281182 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.281156 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-token" pod "53e0539d-33d9-4c6c-afb8-0e67e95e18d5" (UID: "53e0539d-33d9-4c6c-afb8-0e67e95e18d5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:12.281350 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.281326 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97628062-0839-49a3-ac40-e0b13d862da6-istio-token" pod "97628062-0839-49a3-ac40-e0b13d862da6" (UID: "97628062-0839-49a3-ac40-e0b13d862da6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:12.281350 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.281333 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97628062-0839-49a3-ac40-e0b13d862da6-kube-api-access-fgldr" pod "97628062-0839-49a3-ac40-e0b13d862da6" (UID: "97628062-0839-49a3-ac40-e0b13d862da6"). InnerVolumeSpecName "kube-api-access-fgldr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:12.281515 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.281438 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-token" pod "fc1e8160-8f4e-4be3-96a9-b2d5b339959b" (UID: "fc1e8160-8f4e-4be3-96a9-b2d5b339959b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:12.281630 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.281537 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-kube-api-access-jtgm9" pod "fc1e8160-8f4e-4be3-96a9-b2d5b339959b" (UID: "fc1e8160-8f4e-4be3-96a9-b2d5b339959b"). InnerVolumeSpecName "kube-api-access-jtgm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:12.281912 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.281888 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/97628062-0839-49a3-ac40-e0b13d862da6-istio-podinfo" pod "97628062-0839-49a3-ac40-e0b13d862da6" (UID: "97628062-0839-49a3-ac40-e0b13d862da6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:15:12.282180 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.282161 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-podinfo" pod "fc1e8160-8f4e-4be3-96a9-b2d5b339959b" (UID: "fc1e8160-8f4e-4be3-96a9-b2d5b339959b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:15:12.282876 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.282837 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-envoy" pod "53e0539d-33d9-4c6c-afb8-0e67e95e18d5" (UID: "53e0539d-33d9-4c6c-afb8-0e67e95e18d5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:12.282876 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.282845 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-istio-envoy" pod "97628062-0839-49a3-ac40-e0b13d862da6" (UID: "97628062-0839-49a3-ac40-e0b13d862da6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:12.282876 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.282852 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-kube-api-access-v65dg" pod "53e0539d-33d9-4c6c-afb8-0e67e95e18d5" (UID: "53e0539d-33d9-4c6c-afb8-0e67e95e18d5"). InnerVolumeSpecName "kube-api-access-v65dg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:12.283358 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.283339 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-podinfo" pod "53e0539d-33d9-4c6c-afb8-0e67e95e18d5" (UID: "53e0539d-33d9-4c6c-afb8-0e67e95e18d5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:15:12.284003 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.283973 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-envoy" pod "fc1e8160-8f4e-4be3-96a9-b2d5b339959b" (UID: "fc1e8160-8f4e-4be3-96a9-b2d5b339959b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:12.379332 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.379246 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.379332 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.379279 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97628062-0839-49a3-ac40-e0b13d862da6-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.379332 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.379291 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgldr\" (UniqueName: \"kubernetes.io/projected/97628062-0839-49a3-ac40-e0b13d862da6-kube-api-access-fgldr\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.379332 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.379302 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.379332 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.379311 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.379332 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.379319 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.379332 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.379328 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97628062-0839-49a3-ac40-e0b13d862da6-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.379332 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.379336 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97628062-0839-49a3-ac40-e0b13d862da6-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.379726 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.379345 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v65dg\" (UniqueName: \"kubernetes.io/projected/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-kube-api-access-v65dg\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.379726 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.379353 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.379726 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.379362 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53e0539d-33d9-4c6c-afb8-0e67e95e18d5-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.379726 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.379370 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtgm9\" (UniqueName: \"kubernetes.io/projected/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-kube-api-access-jtgm9\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.379726 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.379378 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc1e8160-8f4e-4be3-96a9-b2d5b339959b-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:12.559652 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.559618 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9"] Oct 31 01:15:12.564962 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.564931 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-45pm9"] Oct 31 01:15:12.577303 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.577269 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh"] Oct 31 01:15:12.580805 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.580775 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-vd5zh"] Oct 31 01:15:12.591624 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.591594 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds"] Oct 31 01:15:12.595478 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:12.595454 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-acdaed-openshift-default-fd4ccfb57-6h8ds"] Oct 31 01:15:13.564886 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:13.564850 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="53e0539d-33d9-4c6c-afb8-0e67e95e18d5" path="/var/lib/kubelet/pods/53e0539d-33d9-4c6c-afb8-0e67e95e18d5/volumes" Oct 31 01:15:13.565371 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:13.565355 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="97628062-0839-49a3-ac40-e0b13d862da6" path="/var/lib/kubelet/pods/97628062-0839-49a3-ac40-e0b13d862da6/volumes" Oct 31 01:15:13.565837 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:13.565821 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fc1e8160-8f4e-4be3-96a9-b2d5b339959b" path="/var/lib/kubelet/pods/fc1e8160-8f4e-4be3-96a9-b2d5b339959b/volumes" Oct 31 01:15:17.199391 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:15:17.199355 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:15:18.458182 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.458116 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" containerID="cri-o://e7aa2ca74339c8d1d60895725b9f2f7b952ff4ad9f4b4840aba145cd56804b51" gracePeriod=45 Oct 31 01:15:18.487509 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.487459 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" containerID="cri-o://81c0a674bc3f450478620be89f0a7ff02c657939651e0471b8070f41aa7fde22" gracePeriod=45 Oct 31 01:15:18.518299 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.518261 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": dial tcp 10.132.0.50:8000: connect: connection refused" Oct 31 01:15:18.758884 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.758854 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:15:18.803230 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.803197 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:15:18.847887 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.847855 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-home\" (UniqueName: \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-home\") pod \"2a0744c2-7736-4e75-8ed6-62b0099604f4\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " Oct 31 01:15:18.848087 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.847937 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-tmp-dir\") pod \"2a0744c2-7736-4e75-8ed6-62b0099604f4\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " Oct 31 01:15:18.848087 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.847972 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-dshm\") pod \"2a0744c2-7736-4e75-8ed6-62b0099604f4\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " Oct 31 01:15:18.848204 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.848181 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-home" pod "2a0744c2-7736-4e75-8ed6-62b0099604f4" (UID: "2a0744c2-7736-4e75-8ed6-62b0099604f4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:18.848267 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.848188 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-tmp-dir" pod "2a0744c2-7736-4e75-8ed6-62b0099604f4" (UID: "2a0744c2-7736-4e75-8ed6-62b0099604f4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:18.849334 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.848546 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2a0744c2-7736-4e75-8ed6-62b0099604f4-tls-certs\" (UniqueName: \"kubernetes.io/secret/2a0744c2-7736-4e75-8ed6-62b0099604f4-tls-certs\") pod \"2a0744c2-7736-4e75-8ed6-62b0099604f4\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " Oct 31 01:15:18.849334 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.848662 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2a0744c2-7736-4e75-8ed6-62b0099604f4-kube-api-access-hbdnk\" (UniqueName: \"kubernetes.io/projected/2a0744c2-7736-4e75-8ed6-62b0099604f4-kube-api-access-hbdnk\") pod \"2a0744c2-7736-4e75-8ed6-62b0099604f4\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " Oct 31 01:15:18.849334 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.848748 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-model-cache\") pod \"2a0744c2-7736-4e75-8ed6-62b0099604f4\" (UID: \"2a0744c2-7736-4e75-8ed6-62b0099604f4\") " Oct 31 01:15:18.849334 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.849174 5821 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-home\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:18.849334 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.849196 5821 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-tmp-dir\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:18.849738 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.849452 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-model-cache" pod "2a0744c2-7736-4e75-8ed6-62b0099604f4" (UID: "2a0744c2-7736-4e75-8ed6-62b0099604f4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:18.850760 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.850735 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-dshm" pod "2a0744c2-7736-4e75-8ed6-62b0099604f4" (UID: "2a0744c2-7736-4e75-8ed6-62b0099604f4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:18.850891 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.850873 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a0744c2-7736-4e75-8ed6-62b0099604f4-tls-certs" pod "2a0744c2-7736-4e75-8ed6-62b0099604f4" (UID: "2a0744c2-7736-4e75-8ed6-62b0099604f4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:15:18.851090 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.851072 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a0744c2-7736-4e75-8ed6-62b0099604f4-kube-api-access-hbdnk" pod "2a0744c2-7736-4e75-8ed6-62b0099604f4" (UID: "2a0744c2-7736-4e75-8ed6-62b0099604f4"). InnerVolumeSpecName "kube-api-access-hbdnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:18.950255 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.950217 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-model-cache\") pod \"985b0b16-7abe-4c8b-b3c1-44616902cef7\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " Oct 31 01:15:18.950434 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.950296 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/985b0b16-7abe-4c8b-b3c1-44616902cef7-tls-certs\" (UniqueName: \"kubernetes.io/secret/985b0b16-7abe-4c8b-b3c1-44616902cef7-tls-certs\") pod \"985b0b16-7abe-4c8b-b3c1-44616902cef7\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " Oct 31 01:15:18.950434 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.950330 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-home\" (UniqueName: \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-home\") pod \"985b0b16-7abe-4c8b-b3c1-44616902cef7\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " Oct 31 01:15:18.950434 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.950363 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/985b0b16-7abe-4c8b-b3c1-44616902cef7-kube-api-access-fz6gz\" (UniqueName: \"kubernetes.io/projected/985b0b16-7abe-4c8b-b3c1-44616902cef7-kube-api-access-fz6gz\") pod \"985b0b16-7abe-4c8b-b3c1-44616902cef7\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " Oct 31 01:15:18.950434 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.950394 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-dshm\" (UniqueName: \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-dshm\") pod \"985b0b16-7abe-4c8b-b3c1-44616902cef7\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " Oct 31 01:15:18.950714 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.950515 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-tmp-dir\") pod \"985b0b16-7abe-4c8b-b3c1-44616902cef7\" (UID: \"985b0b16-7abe-4c8b-b3c1-44616902cef7\") " Oct 31 01:15:18.950714 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.950581 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-model-cache" pod "985b0b16-7abe-4c8b-b3c1-44616902cef7" (UID: "985b0b16-7abe-4c8b-b3c1-44616902cef7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:18.950714 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.950632 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-home" pod "985b0b16-7abe-4c8b-b3c1-44616902cef7" (UID: "985b0b16-7abe-4c8b-b3c1-44616902cef7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:18.950856 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.950779 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-tmp-dir" pod "985b0b16-7abe-4c8b-b3c1-44616902cef7" (UID: "985b0b16-7abe-4c8b-b3c1-44616902cef7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:18.950941 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.950926 5821 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-model-cache\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:18.951002 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.950947 5821 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-model-cache\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:18.951002 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.950959 5821 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-home\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:18.951002 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.950968 5821 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a0744c2-7736-4e75-8ed6-62b0099604f4-dshm\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:18.951002 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.950975 5821 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-tmp-dir\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:18.951002 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.950985 5821 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a0744c2-7736-4e75-8ed6-62b0099604f4-tls-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:18.951002 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.950993 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbdnk\" (UniqueName: \"kubernetes.io/projected/2a0744c2-7736-4e75-8ed6-62b0099604f4-kube-api-access-hbdnk\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:18.952540 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.952510 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/985b0b16-7abe-4c8b-b3c1-44616902cef7-tls-certs" pod "985b0b16-7abe-4c8b-b3c1-44616902cef7" (UID: "985b0b16-7abe-4c8b-b3c1-44616902cef7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:15:18.952540 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.952523 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-dshm" pod "985b0b16-7abe-4c8b-b3c1-44616902cef7" (UID: "985b0b16-7abe-4c8b-b3c1-44616902cef7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:18.952540 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:18.952515 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/985b0b16-7abe-4c8b-b3c1-44616902cef7-kube-api-access-fz6gz" pod "985b0b16-7abe-4c8b-b3c1-44616902cef7" (UID: "985b0b16-7abe-4c8b-b3c1-44616902cef7"). InnerVolumeSpecName "kube-api-access-fz6gz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:19.052319 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.052235 5821 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/985b0b16-7abe-4c8b-b3c1-44616902cef7-tls-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:19.052319 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.052268 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fz6gz\" (UniqueName: \"kubernetes.io/projected/985b0b16-7abe-4c8b-b3c1-44616902cef7-kube-api-access-fz6gz\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:19.052319 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.052279 5821 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/985b0b16-7abe-4c8b-b3c1-44616902cef7-dshm\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:19.279992 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.279952 5821 generic.go:356] "Generic (PLEG): container finished" podID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerID="81c0a674bc3f450478620be89f0a7ff02c657939651e0471b8070f41aa7fde22" exitCode=0 Oct 31 01:15:19.280182 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.280011 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" Oct 31 01:15:19.280182 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.280042 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" event={"ID":"985b0b16-7abe-4c8b-b3c1-44616902cef7","Type":"ContainerDied","Data":"81c0a674bc3f450478620be89f0a7ff02c657939651e0471b8070f41aa7fde22"} Oct 31 01:15:19.280182 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.280087 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8" event={"ID":"985b0b16-7abe-4c8b-b3c1-44616902cef7","Type":"ContainerDied","Data":"b3c251a23b2a0e876a0ace92b750e2c958eef8b6c221a7a7bdf2c1a05760989e"} Oct 31 01:15:19.280182 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.280109 5821 scope.go:122] "RemoveContainer" containerID="81c0a674bc3f450478620be89f0a7ff02c657939651e0471b8070f41aa7fde22" Oct 31 01:15:19.285842 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.285814 5821 generic.go:356] "Generic (PLEG): container finished" podID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerID="e7aa2ca74339c8d1d60895725b9f2f7b952ff4ad9f4b4840aba145cd56804b51" exitCode=0 Oct 31 01:15:19.285974 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.285857 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" Oct 31 01:15:19.285974 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.285862 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" event={"ID":"2a0744c2-7736-4e75-8ed6-62b0099604f4","Type":"ContainerDied","Data":"e7aa2ca74339c8d1d60895725b9f2f7b952ff4ad9f4b4840aba145cd56804b51"} Oct 31 01:15:19.285974 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.285891 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" event={"ID":"2a0744c2-7736-4e75-8ed6-62b0099604f4","Type":"ContainerDied","Data":"62af009013e4a7e8d31dd37700438b7cc0da450331612b9110aa11871618bf14"} Oct 31 01:15:19.294105 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.293953 5821 scope.go:122] "RemoveContainer" containerID="81c0a674bc3f450478620be89f0a7ff02c657939651e0471b8070f41aa7fde22" Oct 31 01:15:19.294321 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:15:19.294300 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81c0a674bc3f450478620be89f0a7ff02c657939651e0471b8070f41aa7fde22\": container with ID starting with 81c0a674bc3f450478620be89f0a7ff02c657939651e0471b8070f41aa7fde22 not found: ID does not exist" containerID="81c0a674bc3f450478620be89f0a7ff02c657939651e0471b8070f41aa7fde22" Oct 31 01:15:19.294378 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.294331 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81c0a674bc3f450478620be89f0a7ff02c657939651e0471b8070f41aa7fde22"} err="failed to get container status \"81c0a674bc3f450478620be89f0a7ff02c657939651e0471b8070f41aa7fde22\": rpc error: code = NotFound desc = could not find container \"81c0a674bc3f450478620be89f0a7ff02c657939651e0471b8070f41aa7fde22\": container with ID starting with 81c0a674bc3f450478620be89f0a7ff02c657939651e0471b8070f41aa7fde22 not found: ID does not exist" Oct 31 01:15:19.294378 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.294347 5821 scope.go:122] "RemoveContainer" containerID="e7aa2ca74339c8d1d60895725b9f2f7b952ff4ad9f4b4840aba145cd56804b51" Oct 31 01:15:19.303465 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.303441 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8"] Oct 31 01:15:19.303589 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.303574 5821 scope.go:122] "RemoveContainer" containerID="e7aa2ca74339c8d1d60895725b9f2f7b952ff4ad9f4b4840aba145cd56804b51" Oct 31 01:15:19.303847 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:15:19.303826 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7aa2ca74339c8d1d60895725b9f2f7b952ff4ad9f4b4840aba145cd56804b51\": container with ID starting with e7aa2ca74339c8d1d60895725b9f2f7b952ff4ad9f4b4840aba145cd56804b51 not found: ID does not exist" containerID="e7aa2ca74339c8d1d60895725b9f2f7b952ff4ad9f4b4840aba145cd56804b51" Oct 31 01:15:19.303910 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.303855 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7aa2ca74339c8d1d60895725b9f2f7b952ff4ad9f4b4840aba145cd56804b51"} err="failed to get container status \"e7aa2ca74339c8d1d60895725b9f2f7b952ff4ad9f4b4840aba145cd56804b51\": rpc error: code = NotFound desc = could not find container \"e7aa2ca74339c8d1d60895725b9f2f7b952ff4ad9f4b4840aba145cd56804b51\": container with ID starting with e7aa2ca74339c8d1d60895725b9f2f7b952ff4ad9f4b4840aba145cd56804b51 not found: ID does not exist" Oct 31 01:15:19.306845 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.306821 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-487a6c/premium-w3-487a6c-kserve-5fd57db894-df7n8"] Oct 31 01:15:19.318005 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.317979 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg"] Oct 31 01:15:19.321385 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.321360 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg"] Oct 31 01:15:19.567473 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.567377 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" path="/var/lib/kubelet/pods/2a0744c2-7736-4e75-8ed6-62b0099604f4/volumes" Oct 31 01:15:19.568029 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.568007 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" path="/var/lib/kubelet/pods/985b0b16-7abe-4c8b-b3c1-44616902cef7/volumes" Oct 31 01:15:19.684650 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:19.684606 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-487a6c/distinct-2-w3-487a6c-kserve-744b5b6bdb-j4ftg" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 31 01:15:24.690577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:24.689778 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd"] Oct 31 01:15:24.690577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:24.690106 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" podUID="25d5f84e-a306-477b-9de3-3c049e941ad4" containerName="maas-api" containerID="cri-o://069450ff1153860eb84ff5e313a3b17b693f5fbe20bc1bb2f24a06abe36e04e8" gracePeriod=30 Oct 31 01:15:26.011965 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.011935 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" Oct 31 01:15:26.090529 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.090447 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/25d5f84e-a306-477b-9de3-3c049e941ad4-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25d5f84e-a306-477b-9de3-3c049e941ad4-openshift-service-ca\") pod \"25d5f84e-a306-477b-9de3-3c049e941ad4\" (UID: \"25d5f84e-a306-477b-9de3-3c049e941ad4\") " Oct 31 01:15:26.090529 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.090510 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/25d5f84e-a306-477b-9de3-3c049e941ad4-metrics-certs\" (UniqueName: \"kubernetes.io/secret/25d5f84e-a306-477b-9de3-3c049e941ad4-metrics-certs\") pod \"25d5f84e-a306-477b-9de3-3c049e941ad4\" (UID: \"25d5f84e-a306-477b-9de3-3c049e941ad4\") " Oct 31 01:15:26.090806 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.090575 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/25d5f84e-a306-477b-9de3-3c049e941ad4-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25d5f84e-a306-477b-9de3-3c049e941ad4-maas-api-tls\") pod \"25d5f84e-a306-477b-9de3-3c049e941ad4\" (UID: \"25d5f84e-a306-477b-9de3-3c049e941ad4\") " Oct 31 01:15:26.090806 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.090596 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25d5f84e-a306-477b-9de3-3c049e941ad4-kube-api-access-5pb85\" (UniqueName: \"kubernetes.io/projected/25d5f84e-a306-477b-9de3-3c049e941ad4-kube-api-access-5pb85\") pod \"25d5f84e-a306-477b-9de3-3c049e941ad4\" (UID: \"25d5f84e-a306-477b-9de3-3c049e941ad4\") " Oct 31 01:15:26.090912 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.090889 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25d5f84e-a306-477b-9de3-3c049e941ad4-openshift-service-ca" pod "25d5f84e-a306-477b-9de3-3c049e941ad4" (UID: "25d5f84e-a306-477b-9de3-3c049e941ad4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:15:26.092833 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.092800 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25d5f84e-a306-477b-9de3-3c049e941ad4-metrics-certs" pod "25d5f84e-a306-477b-9de3-3c049e941ad4" (UID: "25d5f84e-a306-477b-9de3-3c049e941ad4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:15:26.092833 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.092822 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25d5f84e-a306-477b-9de3-3c049e941ad4-maas-api-tls" pod "25d5f84e-a306-477b-9de3-3c049e941ad4" (UID: "25d5f84e-a306-477b-9de3-3c049e941ad4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:15:26.092971 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.092841 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25d5f84e-a306-477b-9de3-3c049e941ad4-kube-api-access-5pb85" pod "25d5f84e-a306-477b-9de3-3c049e941ad4" (UID: "25d5f84e-a306-477b-9de3-3c049e941ad4"). InnerVolumeSpecName "kube-api-access-5pb85". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:26.191492 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.191451 5821 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25d5f84e-a306-477b-9de3-3c049e941ad4-openshift-service-ca\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:26.191492 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.191483 5821 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25d5f84e-a306-477b-9de3-3c049e941ad4-metrics-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:26.191492 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.191494 5821 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25d5f84e-a306-477b-9de3-3c049e941ad4-maas-api-tls\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:26.191492 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.191503 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pb85\" (UniqueName: \"kubernetes.io/projected/25d5f84e-a306-477b-9de3-3c049e941ad4-kube-api-access-5pb85\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:26.353712 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.353616 5821 generic.go:356] "Generic (PLEG): container finished" podID="25d5f84e-a306-477b-9de3-3c049e941ad4" containerID="069450ff1153860eb84ff5e313a3b17b693f5fbe20bc1bb2f24a06abe36e04e8" exitCode=0 Oct 31 01:15:26.353712 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.353667 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" Oct 31 01:15:26.353712 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.353695 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" event={"ID":"25d5f84e-a306-477b-9de3-3c049e941ad4","Type":"ContainerDied","Data":"069450ff1153860eb84ff5e313a3b17b693f5fbe20bc1bb2f24a06abe36e04e8"} Oct 31 01:15:26.353999 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.353750 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd" event={"ID":"25d5f84e-a306-477b-9de3-3c049e941ad4","Type":"ContainerDied","Data":"68574b8dad670a2ffeb2892a1cd4df187ecb08c9ec18874f1d8c2a20f88200cf"} Oct 31 01:15:26.353999 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.353772 5821 scope.go:122] "RemoveContainer" containerID="069450ff1153860eb84ff5e313a3b17b693f5fbe20bc1bb2f24a06abe36e04e8" Oct 31 01:15:26.364262 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.364241 5821 scope.go:122] "RemoveContainer" containerID="069450ff1153860eb84ff5e313a3b17b693f5fbe20bc1bb2f24a06abe36e04e8" Oct 31 01:15:26.364538 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:15:26.364516 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"069450ff1153860eb84ff5e313a3b17b693f5fbe20bc1bb2f24a06abe36e04e8\": container with ID starting with 069450ff1153860eb84ff5e313a3b17b693f5fbe20bc1bb2f24a06abe36e04e8 not found: ID does not exist" containerID="069450ff1153860eb84ff5e313a3b17b693f5fbe20bc1bb2f24a06abe36e04e8" Oct 31 01:15:26.364615 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.364548 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"069450ff1153860eb84ff5e313a3b17b693f5fbe20bc1bb2f24a06abe36e04e8"} err="failed to get container status \"069450ff1153860eb84ff5e313a3b17b693f5fbe20bc1bb2f24a06abe36e04e8\": rpc error: code = NotFound desc = could not find container \"069450ff1153860eb84ff5e313a3b17b693f5fbe20bc1bb2f24a06abe36e04e8\": container with ID starting with 069450ff1153860eb84ff5e313a3b17b693f5fbe20bc1bb2f24a06abe36e04e8 not found: ID does not exist" Oct 31 01:15:26.377541 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.377514 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd"] Oct 31 01:15:26.383558 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:26.383526 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-487a6c-6fcfb5bb49-dt7kd"] Oct 31 01:15:27.567585 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:27.567519 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="25d5f84e-a306-477b-9de3-3c049e941ad4" path="/var/lib/kubelet/pods/25d5f84e-a306-477b-9de3-3c049e941ad4/volumes" Oct 31 01:15:32.146466 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:32.146432 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w"] Oct 31 01:15:32.147117 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:32.146864 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" podUID="6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" containerName="istio-proxy" containerID="cri-o://12917baeb3ff77da93ff1021286823823584650a68c1f711a23daeb32210bed8" gracePeriod=30 Oct 31 01:15:32.159188 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:32.159152 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7"] Oct 31 01:15:32.159680 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:32.159646 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" podUID="dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" containerName="istio-proxy" containerID="cri-o://af3991e2d05fa1ff2fa5e4e62b19eea9c81aed56334fef2a13fee7fe6578bd7c" gracePeriod=30 Oct 31 01:15:32.167806 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:32.167778 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm"] Oct 31 01:15:32.168023 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:32.168002 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" podUID="b1d931c4-c812-4646-94a2-d7469b0ca856" containerName="istio-proxy" containerID="cri-o://90d2ee6cf472989af77ce0596d44b8557cbe39186b90f5cfaeae085290bdbc87" gracePeriod=30 Oct 31 01:15:34.713510 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:34.713463 5821 patch_prober.go:29] interesting pod/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 31 01:15:34.713935 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:34.713530 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" podUID="b1d931c4-c812-4646-94a2-d7469b0ca856" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 31 01:15:34.832372 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:34.832336 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dc84dbdd5-9n7zf"] Oct 31 01:15:34.832587 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:34.832547 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" podUID="c1e051a8-bd2b-424e-8e0b-7819391b4673" containerName="manager" containerID="cri-o://ef3649904c2756f5145209aa9806c72757ef64992c7758c96bbca2338baa0031" gracePeriod=30 Oct 31 01:15:35.087632 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.087605 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" Oct 31 01:15:35.180767 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.180736 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c1e051a8-bd2b-424e-8e0b-7819391b4673-kube-api-access-d9xwm\" (UniqueName: \"kubernetes.io/projected/c1e051a8-bd2b-424e-8e0b-7819391b4673-kube-api-access-d9xwm\") pod \"c1e051a8-bd2b-424e-8e0b-7819391b4673\" (UID: \"c1e051a8-bd2b-424e-8e0b-7819391b4673\") " Oct 31 01:15:35.180964 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.180794 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c1e051a8-bd2b-424e-8e0b-7819391b4673-metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e051a8-bd2b-424e-8e0b-7819391b4673-metrics-certs\") pod \"c1e051a8-bd2b-424e-8e0b-7819391b4673\" (UID: \"c1e051a8-bd2b-424e-8e0b-7819391b4673\") " Oct 31 01:15:35.180964 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.180826 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c1e051a8-bd2b-424e-8e0b-7819391b4673-webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1e051a8-bd2b-424e-8e0b-7819391b4673-webhook-cert\") pod \"c1e051a8-bd2b-424e-8e0b-7819391b4673\" (UID: \"c1e051a8-bd2b-424e-8e0b-7819391b4673\") " Oct 31 01:15:35.182863 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.182833 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1e051a8-bd2b-424e-8e0b-7819391b4673-metrics-certs" pod "c1e051a8-bd2b-424e-8e0b-7819391b4673" (UID: "c1e051a8-bd2b-424e-8e0b-7819391b4673"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:15:35.182991 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.182883 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1e051a8-bd2b-424e-8e0b-7819391b4673-webhook-cert" pod "c1e051a8-bd2b-424e-8e0b-7819391b4673" (UID: "c1e051a8-bd2b-424e-8e0b-7819391b4673"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:15:35.182991 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.182923 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1e051a8-bd2b-424e-8e0b-7819391b4673-kube-api-access-d9xwm" pod "c1e051a8-bd2b-424e-8e0b-7819391b4673" (UID: "c1e051a8-bd2b-424e-8e0b-7819391b4673"). InnerVolumeSpecName "kube-api-access-d9xwm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:35.281700 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.281618 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9xwm\" (UniqueName: \"kubernetes.io/projected/c1e051a8-bd2b-424e-8e0b-7819391b4673-kube-api-access-d9xwm\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:35.281700 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.281649 5821 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e051a8-bd2b-424e-8e0b-7819391b4673-metrics-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:35.281700 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.281661 5821 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1e051a8-bd2b-424e-8e0b-7819391b4673-webhook-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:35.399171 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.399128 5821 generic.go:356] "Generic (PLEG): container finished" podID="c1e051a8-bd2b-424e-8e0b-7819391b4673" containerID="ef3649904c2756f5145209aa9806c72757ef64992c7758c96bbca2338baa0031" exitCode=0 Oct 31 01:15:35.399344 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.399182 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" Oct 31 01:15:35.399344 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.399210 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" event={"ID":"c1e051a8-bd2b-424e-8e0b-7819391b4673","Type":"ContainerDied","Data":"ef3649904c2756f5145209aa9806c72757ef64992c7758c96bbca2338baa0031"} Oct 31 01:15:35.399344 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.399265 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc84dbdd5-9n7zf" event={"ID":"c1e051a8-bd2b-424e-8e0b-7819391b4673","Type":"ContainerDied","Data":"df21f6d3fcdf60802dfafdcc31a81b5bfe2dd90d1411c7cdadf8c9bd13652f00"} Oct 31 01:15:35.399344 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.399288 5821 scope.go:122] "RemoveContainer" containerID="ef3649904c2756f5145209aa9806c72757ef64992c7758c96bbca2338baa0031" Oct 31 01:15:35.412255 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.412233 5821 scope.go:122] "RemoveContainer" containerID="f973df21685b5ff56ab05dcaa2d83a338269e75dd15e655bad0c4fa8a75c9601" Oct 31 01:15:35.420365 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.420346 5821 scope.go:122] "RemoveContainer" containerID="ef3649904c2756f5145209aa9806c72757ef64992c7758c96bbca2338baa0031" Oct 31 01:15:35.420663 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:15:35.420640 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef3649904c2756f5145209aa9806c72757ef64992c7758c96bbca2338baa0031\": container with ID starting with ef3649904c2756f5145209aa9806c72757ef64992c7758c96bbca2338baa0031 not found: ID does not exist" containerID="ef3649904c2756f5145209aa9806c72757ef64992c7758c96bbca2338baa0031" Oct 31 01:15:35.420760 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.420670 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef3649904c2756f5145209aa9806c72757ef64992c7758c96bbca2338baa0031"} err="failed to get container status \"ef3649904c2756f5145209aa9806c72757ef64992c7758c96bbca2338baa0031\": rpc error: code = NotFound desc = could not find container \"ef3649904c2756f5145209aa9806c72757ef64992c7758c96bbca2338baa0031\": container with ID starting with ef3649904c2756f5145209aa9806c72757ef64992c7758c96bbca2338baa0031 not found: ID does not exist" Oct 31 01:15:35.420760 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.420687 5821 scope.go:122] "RemoveContainer" containerID="f973df21685b5ff56ab05dcaa2d83a338269e75dd15e655bad0c4fa8a75c9601" Oct 31 01:15:35.420944 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:15:35.420924 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f973df21685b5ff56ab05dcaa2d83a338269e75dd15e655bad0c4fa8a75c9601\": container with ID starting with f973df21685b5ff56ab05dcaa2d83a338269e75dd15e655bad0c4fa8a75c9601 not found: ID does not exist" containerID="f973df21685b5ff56ab05dcaa2d83a338269e75dd15e655bad0c4fa8a75c9601" Oct 31 01:15:35.421003 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.420955 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f973df21685b5ff56ab05dcaa2d83a338269e75dd15e655bad0c4fa8a75c9601"} err="failed to get container status \"f973df21685b5ff56ab05dcaa2d83a338269e75dd15e655bad0c4fa8a75c9601\": rpc error: code = NotFound desc = could not find container \"f973df21685b5ff56ab05dcaa2d83a338269e75dd15e655bad0c4fa8a75c9601\": container with ID starting with f973df21685b5ff56ab05dcaa2d83a338269e75dd15e655bad0c4fa8a75c9601 not found: ID does not exist" Oct 31 01:15:35.424164 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.424143 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dc84dbdd5-9n7zf"] Oct 31 01:15:35.429985 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.429963 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-dc84dbdd5-9n7zf"] Oct 31 01:15:35.565393 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:35.565314 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c1e051a8-bd2b-424e-8e0b-7819391b4673" path="/var/lib/kubelet/pods/c1e051a8-bd2b-424e-8e0b-7819391b4673/volumes" Oct 31 01:15:36.103409 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.103362 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dc84dbdd5-jss6g"] Oct 31 01:15:36.103985 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.103963 5821 cpu_manager.go:414] "containerMap: removing container" podUID="c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" containerName="istio-proxy" Oct 31 01:15:36.104061 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.103988 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" containerName="istio-proxy" Oct 31 01:15:36.104061 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104005 5821 cpu_manager.go:414] "containerMap: removing container" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" Oct 31 01:15:36.104061 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104013 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" Oct 31 01:15:36.104061 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104026 5821 cpu_manager.go:414] "containerMap: removing container" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" Oct 31 01:15:36.104061 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104035 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" Oct 31 01:15:36.104061 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104046 5821 cpu_manager.go:414] "containerMap: removing container" podUID="6106bf2d-96d6-4452-a356-dd23d3de4087" containerName="istio-proxy" Oct 31 01:15:36.104061 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104054 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6106bf2d-96d6-4452-a356-dd23d3de4087" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104066 5821 cpu_manager.go:414] "containerMap: removing container" podUID="c1e051a8-bd2b-424e-8e0b-7819391b4673" containerName="manager" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104073 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c1e051a8-bd2b-424e-8e0b-7819391b4673" containerName="manager" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104084 5821 cpu_manager.go:414] "containerMap: removing container" podUID="c1e051a8-bd2b-424e-8e0b-7819391b4673" containerName="manager" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104094 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c1e051a8-bd2b-424e-8e0b-7819391b4673" containerName="manager" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104103 5821 cpu_manager.go:414] "containerMap: removing container" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104111 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104122 5821 cpu_manager.go:414] "containerMap: removing container" podUID="280e663b-1387-450a-8d9a-7e9f5d574bb9" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104129 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="280e663b-1387-450a-8d9a-7e9f5d574bb9" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104144 5821 cpu_manager.go:414] "containerMap: removing container" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104151 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104168 5821 cpu_manager.go:414] "containerMap: removing container" podUID="d6149144-2988-41aa-99d2-01a7205486c0" containerName="maas-api" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104174 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d6149144-2988-41aa-99d2-01a7205486c0" containerName="maas-api" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104188 5821 cpu_manager.go:414] "containerMap: removing container" podUID="74944bd5-3fcb-48a6-a208-6f17f70df82b" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104195 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="74944bd5-3fcb-48a6-a208-6f17f70df82b" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104206 5821 cpu_manager.go:414] "containerMap: removing container" podUID="876007f4-ecc5-469f-addd-8e76a84257e5" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104213 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="876007f4-ecc5-469f-addd-8e76a84257e5" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104222 5821 cpu_manager.go:414] "containerMap: removing container" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104229 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104240 5821 cpu_manager.go:414] "containerMap: removing container" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104247 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104257 5821 cpu_manager.go:414] "containerMap: removing container" podUID="2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104264 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104274 5821 cpu_manager.go:414] "containerMap: removing container" podUID="243c8dfb-7210-4abc-987d-fdcc3ab9cc9c" containerName="revoke-keys" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104282 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="243c8dfb-7210-4abc-987d-fdcc3ab9cc9c" containerName="revoke-keys" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104297 5821 cpu_manager.go:414] "containerMap: removing container" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104304 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104315 5821 cpu_manager.go:414] "containerMap: removing container" podUID="8900532b-edb2-4cf6-bc7c-d6f60473221c" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104322 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8900532b-edb2-4cf6-bc7c-d6f60473221c" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104337 5821 cpu_manager.go:414] "containerMap: removing container" podUID="34724cef-6f8d-4da1-9312-7b85f4814d52" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104344 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="34724cef-6f8d-4da1-9312-7b85f4814d52" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104356 5821 cpu_manager.go:414] "containerMap: removing container" podUID="97628062-0839-49a3-ac40-e0b13d862da6" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104363 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="97628062-0839-49a3-ac40-e0b13d862da6" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104375 5821 cpu_manager.go:414] "containerMap: removing container" podUID="bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104383 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104398 5821 cpu_manager.go:414] "containerMap: removing container" podUID="53e0539d-33d9-4c6c-afb8-0e67e95e18d5" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104406 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="53e0539d-33d9-4c6c-afb8-0e67e95e18d5" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104423 5821 cpu_manager.go:414] "containerMap: removing container" podUID="fc1e8160-8f4e-4be3-96a9-b2d5b339959b" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104430 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fc1e8160-8f4e-4be3-96a9-b2d5b339959b" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104444 5821 cpu_manager.go:414] "containerMap: removing container" podUID="960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104453 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" containerName="istio-proxy" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104467 5821 cpu_manager.go:414] "containerMap: removing container" podUID="25d5f84e-a306-477b-9de3-3c049e941ad4" containerName="maas-api" Oct 31 01:15:36.104450 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104474 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="25d5f84e-a306-477b-9de3-3c049e941ad4" containerName="maas-api" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104594 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="2a0744c2-7736-4e75-8ed6-62b0099604f4" containerName="main" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104607 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="6106bf2d-96d6-4452-a356-dd23d3de4087" containerName="istio-proxy" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104616 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="c1e051a8-bd2b-424e-8e0b-7819391b4673" containerName="manager" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104624 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="c1e051a8-bd2b-424e-8e0b-7819391b4673" containerName="manager" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104634 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="0f7caf26-a0d2-4b14-8d6e-a03e759df90a" containerName="main" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104642 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="280e663b-1387-450a-8d9a-7e9f5d574bb9" containerName="istio-proxy" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104651 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="185a60e1-d259-4509-8dd7-885be5c00ae1" containerName="main" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104660 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="d6149144-2988-41aa-99d2-01a7205486c0" containerName="maas-api" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104671 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="74944bd5-3fcb-48a6-a208-6f17f70df82b" containerName="istio-proxy" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104679 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="876007f4-ecc5-469f-addd-8e76a84257e5" containerName="istio-proxy" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104687 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="8647a1e0-bcd2-4045-a01e-497bdb3d460f" containerName="main" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104695 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="02c8c54d-f688-4166-a0fb-9144876ceba8" containerName="main" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104702 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e6b02d6-9bb9-417f-ba16-6b2cc964cdc6" containerName="istio-proxy" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104710 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="243c8dfb-7210-4abc-987d-fdcc3ab9cc9c" containerName="revoke-keys" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104718 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="b6e4116b-9c40-4bf8-96f8-21f0bbcbbc3c" containerName="main" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104727 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="8900532b-edb2-4cf6-bc7c-d6f60473221c" containerName="istio-proxy" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104736 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="34724cef-6f8d-4da1-9312-7b85f4814d52" containerName="istio-proxy" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104745 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="97628062-0839-49a3-ac40-e0b13d862da6" containerName="istio-proxy" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104752 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="bed3e81b-9c9a-4bf2-b609-5d8b122a4e6f" containerName="istio-proxy" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104761 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="53e0539d-33d9-4c6c-afb8-0e67e95e18d5" containerName="istio-proxy" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104771 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="fc1e8160-8f4e-4be3-96a9-b2d5b339959b" containerName="istio-proxy" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104779 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="960b5acc-9378-42e7-b0d9-ef5d3f79e1cc" containerName="istio-proxy" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104788 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="25d5f84e-a306-477b-9de3-3c049e941ad4" containerName="maas-api" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104796 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="c29fdd2e-0a34-44ed-ad24-0b0cf72db33a" containerName="istio-proxy" Oct 31 01:15:36.106642 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.104804 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="985b0b16-7abe-4c8b-b3c1-44616902cef7" containerName="main" Oct 31 01:15:36.110152 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.110121 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc84dbdd5-jss6g" Oct 31 01:15:36.119006 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.118977 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dc84dbdd5-jss6g"] Oct 31 01:15:36.119320 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.119299 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hbl9k\"" Oct 31 01:15:36.119469 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.119453 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Oct 31 01:15:36.119590 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.119529 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Oct 31 01:15:36.123829 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.123785 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Oct 31 01:15:36.189865 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.189824 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a52de73a-adf1-4e49-affa-1108b8b71e44-metrics-certs\") pod \"maas-controller-dc84dbdd5-jss6g\" (UID: \"a52de73a-adf1-4e49-affa-1108b8b71e44\") " pod="opendatahub/maas-controller-dc84dbdd5-jss6g" Oct 31 01:15:36.190068 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.189971 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c8xk\" (UniqueName: \"kubernetes.io/projected/a52de73a-adf1-4e49-affa-1108b8b71e44-kube-api-access-2c8xk\") pod \"maas-controller-dc84dbdd5-jss6g\" (UID: \"a52de73a-adf1-4e49-affa-1108b8b71e44\") " pod="opendatahub/maas-controller-dc84dbdd5-jss6g" Oct 31 01:15:36.190068 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.190029 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a52de73a-adf1-4e49-affa-1108b8b71e44-webhook-cert\") pod \"maas-controller-dc84dbdd5-jss6g\" (UID: \"a52de73a-adf1-4e49-affa-1108b8b71e44\") " pod="opendatahub/maas-controller-dc84dbdd5-jss6g" Oct 31 01:15:36.291359 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.291316 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a52de73a-adf1-4e49-affa-1108b8b71e44-metrics-certs\") pod \"maas-controller-dc84dbdd5-jss6g\" (UID: \"a52de73a-adf1-4e49-affa-1108b8b71e44\") " pod="opendatahub/maas-controller-dc84dbdd5-jss6g" Oct 31 01:15:36.291596 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.291375 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c8xk\" (UniqueName: \"kubernetes.io/projected/a52de73a-adf1-4e49-affa-1108b8b71e44-kube-api-access-2c8xk\") pod \"maas-controller-dc84dbdd5-jss6g\" (UID: \"a52de73a-adf1-4e49-affa-1108b8b71e44\") " pod="opendatahub/maas-controller-dc84dbdd5-jss6g" Oct 31 01:15:36.291596 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.291413 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a52de73a-adf1-4e49-affa-1108b8b71e44-webhook-cert\") pod \"maas-controller-dc84dbdd5-jss6g\" (UID: \"a52de73a-adf1-4e49-affa-1108b8b71e44\") " pod="opendatahub/maas-controller-dc84dbdd5-jss6g" Oct 31 01:15:36.294700 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.294670 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a52de73a-adf1-4e49-affa-1108b8b71e44-webhook-cert\") pod \"maas-controller-dc84dbdd5-jss6g\" (UID: \"a52de73a-adf1-4e49-affa-1108b8b71e44\") " pod="opendatahub/maas-controller-dc84dbdd5-jss6g" Oct 31 01:15:36.295183 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.295160 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a52de73a-adf1-4e49-affa-1108b8b71e44-metrics-certs\") pod \"maas-controller-dc84dbdd5-jss6g\" (UID: \"a52de73a-adf1-4e49-affa-1108b8b71e44\") " pod="opendatahub/maas-controller-dc84dbdd5-jss6g" Oct 31 01:15:36.300179 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.300151 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c8xk\" (UniqueName: \"kubernetes.io/projected/a52de73a-adf1-4e49-affa-1108b8b71e44-kube-api-access-2c8xk\") pod \"maas-controller-dc84dbdd5-jss6g\" (UID: \"a52de73a-adf1-4e49-affa-1108b8b71e44\") " pod="opendatahub/maas-controller-dc84dbdd5-jss6g" Oct 31 01:15:36.428935 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.428896 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc84dbdd5-jss6g" Oct 31 01:15:36.718430 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:36.718390 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dc84dbdd5-jss6g"] Oct 31 01:15:36.720780 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:15:36.720751 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda52de73a_adf1_4e49_affa_1108b8b71e44.slice/crio-5aa1bd4a2554c0241162fdcd9c9b3c3db39ba2dbd74bcf54e48d9fb760b7f6ec WatchSource:0}: Error finding container 5aa1bd4a2554c0241162fdcd9c9b3c3db39ba2dbd74bcf54e48d9fb760b7f6ec: Status 404 returned error can't find the container with id 5aa1bd4a2554c0241162fdcd9c9b3c3db39ba2dbd74bcf54e48d9fb760b7f6ec Oct 31 01:15:37.466796 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:37.466472 5821 generic.go:356] "Generic (PLEG): container finished" podID="6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" containerID="12917baeb3ff77da93ff1021286823823584650a68c1f711a23daeb32210bed8" exitCode=0 Oct 31 01:15:37.466796 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:37.466648 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" event={"ID":"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d","Type":"ContainerDied","Data":"12917baeb3ff77da93ff1021286823823584650a68c1f711a23daeb32210bed8"} Oct 31 01:15:37.486107 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:37.469309 5821 generic.go:356] "Generic (PLEG): container finished" podID="b1d931c4-c812-4646-94a2-d7469b0ca856" containerID="90d2ee6cf472989af77ce0596d44b8557cbe39186b90f5cfaeae085290bdbc87" exitCode=0 Oct 31 01:15:37.486107 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:37.469413 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" event={"ID":"b1d931c4-c812-4646-94a2-d7469b0ca856","Type":"ContainerDied","Data":"90d2ee6cf472989af77ce0596d44b8557cbe39186b90f5cfaeae085290bdbc87"} Oct 31 01:15:37.505354 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:37.505159 5821 generic.go:356] "Generic (PLEG): container finished" podID="dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" containerID="af3991e2d05fa1ff2fa5e4e62b19eea9c81aed56334fef2a13fee7fe6578bd7c" exitCode=0 Oct 31 01:15:37.505354 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:37.505269 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" event={"ID":"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b","Type":"ContainerDied","Data":"af3991e2d05fa1ff2fa5e4e62b19eea9c81aed56334fef2a13fee7fe6578bd7c"} Oct 31 01:15:37.512654 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:37.512544 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc84dbdd5-jss6g" event={"ID":"a52de73a-adf1-4e49-affa-1108b8b71e44","Type":"ContainerStarted","Data":"5aa1bd4a2554c0241162fdcd9c9b3c3db39ba2dbd74bcf54e48d9fb760b7f6ec"} Oct 31 01:15:37.940772 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:37.940743 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:15:38.037800 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.037774 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:15:38.081632 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.048825 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:15:38.134693 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.134661 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b1d931c4-c812-4646-94a2-d7469b0ca856-kube-api-access-xpbrq\" (UniqueName: \"kubernetes.io/projected/b1d931c4-c812-4646-94a2-d7469b0ca856-kube-api-access-xpbrq\") pod \"b1d931c4-c812-4646-94a2-d7469b0ca856\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " Oct 31 01:15:38.134883 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.134724 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-credential-socket\") pod \"b1d931c4-c812-4646-94a2-d7469b0ca856\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " Oct 31 01:15:38.134883 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.134753 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istiod-ca-cert\") pod \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " Oct 31 01:15:38.134883 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.134795 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-workload-socket\") pod \"b1d931c4-c812-4646-94a2-d7469b0ca856\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " Oct 31 01:15:38.134883 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.134831 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istiod-ca-cert\") pod \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " Oct 31 01:15:38.134883 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.134859 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-token\" (UniqueName: \"kubernetes.io/projected/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-token\") pod \"b1d931c4-c812-4646-94a2-d7469b0ca856\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " Oct 31 01:15:38.135175 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.134894 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-data\") pod \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " Oct 31 01:15:38.135175 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.134931 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-token\" (UniqueName: \"kubernetes.io/projected/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-token\") pod \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " Oct 31 01:15:38.135175 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.134957 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-envoy\") pod \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " Oct 31 01:15:38.135175 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.134990 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-envoy\") pod \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " Oct 31 01:15:38.135175 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.135029 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-kube-api-access-6zxks\" (UniqueName: \"kubernetes.io/projected/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-kube-api-access-6zxks\") pod \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " Oct 31 01:15:38.135175 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.135058 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-envoy\") pod \"b1d931c4-c812-4646-94a2-d7469b0ca856\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " Oct 31 01:15:38.135175 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.135086 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-kube-api-access-4r99l\" (UniqueName: \"kubernetes.io/projected/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-kube-api-access-4r99l\") pod \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " Oct 31 01:15:38.135175 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.135116 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-workload-socket\") pod \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " Oct 31 01:15:38.135175 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.135145 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-podinfo\") pod \"b1d931c4-c812-4646-94a2-d7469b0ca856\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " Oct 31 01:15:38.135683 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.135212 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-podinfo\") pod \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " Oct 31 01:15:38.135683 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.135246 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-podinfo\") pod \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " Oct 31 01:15:38.135683 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.135279 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-data\") pod \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " Oct 31 01:15:38.135683 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.135314 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-credential-socket\") pod \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " Oct 31 01:15:38.135683 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.135353 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b1d931c4-c812-4646-94a2-d7469b0ca856-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1d931c4-c812-4646-94a2-d7469b0ca856-istiod-ca-cert\") pod \"b1d931c4-c812-4646-94a2-d7469b0ca856\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " Oct 31 01:15:38.135683 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.135409 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-token\" (UniqueName: \"kubernetes.io/projected/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-token\") pod \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " Oct 31 01:15:38.135683 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.135441 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-workload-certs\") pod \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " Oct 31 01:15:38.135683 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.135471 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-credential-socket\") pod \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " Oct 31 01:15:38.135683 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.135504 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-workload-certs\") pod \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\" (UID: \"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b\") " Oct 31 01:15:38.135683 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.135533 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-workload-certs\") pod \"b1d931c4-c812-4646-94a2-d7469b0ca856\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " Oct 31 01:15:38.135683 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.135601 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-data\") pod \"b1d931c4-c812-4646-94a2-d7469b0ca856\" (UID: \"b1d931c4-c812-4646-94a2-d7469b0ca856\") " Oct 31 01:15:38.135683 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.135643 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-workload-socket\") pod \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\" (UID: \"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d\") " Oct 31 01:15:38.136340 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.135914 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-data" pod "dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" (UID: "dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:38.136340 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.136006 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.136340 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.136111 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-workload-socket" pod "6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" (UID: "6cd2d2b1-7a55-44b9-b8a0-171e9af4587d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:38.136340 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.136205 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-credential-socket" pod "b1d931c4-c812-4646-94a2-d7469b0ca856" (UID: "b1d931c4-c812-4646-94a2-d7469b0ca856"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:38.136577 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.136498 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istiod-ca-cert" pod "dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" (UID: "dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:15:38.137027 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.136759 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-workload-socket" pod "b1d931c4-c812-4646-94a2-d7469b0ca856" (UID: "b1d931c4-c812-4646-94a2-d7469b0ca856"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:38.137027 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.137012 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istiod-ca-cert" pod "6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" (UID: "6cd2d2b1-7a55-44b9-b8a0-171e9af4587d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:15:38.138801 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.138457 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-podinfo" pod "b1d931c4-c812-4646-94a2-d7469b0ca856" (UID: "b1d931c4-c812-4646-94a2-d7469b0ca856"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:15:38.139798 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.139268 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-envoy" pod "b1d931c4-c812-4646-94a2-d7469b0ca856" (UID: "b1d931c4-c812-4646-94a2-d7469b0ca856"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:38.140696 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.140328 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-token" pod "dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" (UID: "dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:38.140696 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.140499 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-token" pod "b1d931c4-c812-4646-94a2-d7469b0ca856" (UID: "b1d931c4-c812-4646-94a2-d7469b0ca856"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:38.140696 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.140637 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-credential-socket" pod "6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" (UID: "6cd2d2b1-7a55-44b9-b8a0-171e9af4587d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:38.140970 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.140949 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-data" pod "6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" (UID: "6cd2d2b1-7a55-44b9-b8a0-171e9af4587d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:38.141134 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.141111 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-token" pod "6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" (UID: "6cd2d2b1-7a55-44b9-b8a0-171e9af4587d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:38.141511 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.141487 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-workload-certs" pod "dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" (UID: "dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:38.162589 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.155671 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-workload-certs" pod "b1d931c4-c812-4646-94a2-d7469b0ca856" (UID: "b1d931c4-c812-4646-94a2-d7469b0ca856"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:38.162589 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.160636 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-workload-socket" pod "dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" (UID: "dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:38.187719 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.163787 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1d931c4-c812-4646-94a2-d7469b0ca856-istiod-ca-cert" pod "b1d931c4-c812-4646-94a2-d7469b0ca856" (UID: "b1d931c4-c812-4646-94a2-d7469b0ca856"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:15:38.187719 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.171678 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-data" pod "b1d931c4-c812-4646-94a2-d7469b0ca856" (UID: "b1d931c4-c812-4646-94a2-d7469b0ca856"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:38.187719 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.187657 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-credential-socket" pod "dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" (UID: "dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:38.201740 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.201680 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-workload-certs" pod "6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" (UID: "6cd2d2b1-7a55-44b9-b8a0-171e9af4587d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:38.202092 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.202051 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-kube-api-access-4r99l" pod "dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" (UID: "dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b"). InnerVolumeSpecName "kube-api-access-4r99l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:38.216985 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.216934 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-podinfo" pod "6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" (UID: "6cd2d2b1-7a55-44b9-b8a0-171e9af4587d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:15:38.225787 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.225751 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-envoy" pod "6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" (UID: "6cd2d2b1-7a55-44b9-b8a0-171e9af4587d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:38.230604 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.228109 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-podinfo" pod "dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" (UID: "dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 31 01:15:38.230604 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.228114 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-envoy" pod "dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" (UID: "dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 31 01:15:38.230604 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.228284 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-kube-api-access-6zxks" pod "6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" (UID: "6cd2d2b1-7a55-44b9-b8a0-171e9af4587d"). InnerVolumeSpecName "kube-api-access-6zxks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:38.230604 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.228356 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1d931c4-c812-4646-94a2-d7469b0ca856-kube-api-access-xpbrq" pod "b1d931c4-c812-4646-94a2-d7469b0ca856" (UID: "b1d931c4-c812-4646-94a2-d7469b0ca856"). InnerVolumeSpecName "kube-api-access-xpbrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:15:38.237315 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237278 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.237315 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237316 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.237510 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237332 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.237510 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237347 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.237510 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237361 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.237510 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237373 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.237510 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237388 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.237510 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237401 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.237510 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237415 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zxks\" (UniqueName: \"kubernetes.io/projected/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-kube-api-access-6zxks\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.237510 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237430 5821 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-envoy\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.237510 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237444 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4r99l\" (UniqueName: \"kubernetes.io/projected/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-kube-api-access-4r99l\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.237510 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237458 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.237510 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237471 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.237510 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237484 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.237510 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237498 5821 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-podinfo\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.237510 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237510 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.238232 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237523 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.238232 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237538 5821 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1d931c4-c812-4646-94a2-d7469b0ca856-istiod-ca-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.238232 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237565 5821 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-istio-token\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.238232 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237580 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.238232 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237593 5821 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-credential-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.238232 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237607 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.238232 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237622 5821 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-workload-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.238232 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237636 5821 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1d931c4-c812-4646-94a2-d7469b0ca856-istio-data\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.238232 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237650 5821 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d-workload-socket\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.238232 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.237664 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpbrq\" (UniqueName: \"kubernetes.io/projected/b1d931c4-c812-4646-94a2-d7469b0ca856-kube-api-access-xpbrq\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:15:38.522352 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.521718 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" event={"ID":"6cd2d2b1-7a55-44b9-b8a0-171e9af4587d","Type":"ContainerDied","Data":"e4879cac1010b25c83462832e06e05cd1769d37590dddb5825ba82a59ab39de0"} Oct 31 01:15:38.522352 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.521777 5821 scope.go:122] "RemoveContainer" containerID="12917baeb3ff77da93ff1021286823823584650a68c1f711a23daeb32210bed8" Oct 31 01:15:38.522352 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.521883 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w" Oct 31 01:15:38.524672 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.524586 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" event={"ID":"b1d931c4-c812-4646-94a2-d7469b0ca856","Type":"ContainerDied","Data":"8fab7e5f90aab61c06eb3c71ec9af98312d8120307de53db6833d49d747278c9"} Oct 31 01:15:38.524750 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.524679 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm" Oct 31 01:15:38.528851 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.528822 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" event={"ID":"dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b","Type":"ContainerDied","Data":"fe5881f4a07c88df2d2495c4ac22c6cf7bf18965dc7ed5c564a16a8b5df4ae51"} Oct 31 01:15:38.528994 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.528914 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7" Oct 31 01:15:38.535660 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.534839 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc84dbdd5-jss6g" event={"ID":"a52de73a-adf1-4e49-affa-1108b8b71e44","Type":"ContainerStarted","Data":"c5f57d3281e60cb8aba2a4a1f668e9a1361293bdcdbc6a8a3420346be040dec5"} Oct 31 01:15:38.535660 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.535406 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dc84dbdd5-jss6g" Oct 31 01:15:38.537189 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.537062 5821 scope.go:122] "RemoveContainer" containerID="90d2ee6cf472989af77ce0596d44b8557cbe39186b90f5cfaeae085290bdbc87" Oct 31 01:15:38.582057 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.575738 5821 scope.go:122] "RemoveContainer" containerID="af3991e2d05fa1ff2fa5e4e62b19eea9c81aed56334fef2a13fee7fe6578bd7c" Oct 31 01:15:38.582057 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.578278 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-dc84dbdd5-jss6g" podStartSLOduration=1.964683647 podStartE2EDuration="2.57824102s" totalImagesPullingTime="613.557373ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:15:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:15:38.576778358 +0000 UTC m=+1155.156192280" watchObservedRunningTime="2026-10-31 01:15:38.57824102 +0000 UTC m=+1155.157654932" Oct 31 01:15:38.609994 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.609956 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm"] Oct 31 01:15:38.621500 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.621462 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-k8nmm"] Oct 31 01:15:38.648209 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.648172 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w"] Oct 31 01:15:38.658114 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.658069 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-b4w9w"] Oct 31 01:15:38.674824 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.674787 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7"] Oct 31 01:15:38.681289 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:38.681256 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-487a6c-openshift-default-567f7cfc97-ptqt7"] Oct 31 01:15:39.563949 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:39.563915 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" path="/var/lib/kubelet/pods/6cd2d2b1-7a55-44b9-b8a0-171e9af4587d/volumes" Oct 31 01:15:39.564363 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:39.564348 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b1d931c4-c812-4646-94a2-d7469b0ca856" path="/var/lib/kubelet/pods/b1d931c4-c812-4646-94a2-d7469b0ca856/volumes" Oct 31 01:15:39.564810 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:39.564795 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" path="/var/lib/kubelet/pods/dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b/volumes" Oct 31 01:15:47.199392 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:15:47.199351 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:15:49.544502 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:15:49.544472 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dc84dbdd5-jss6g" Oct 31 01:16:08.063761 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:08.063673 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dc84dbdd5-jss6g"] Oct 31 01:16:08.064336 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:08.063893 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-dc84dbdd5-jss6g" podUID="a52de73a-adf1-4e49-affa-1108b8b71e44" containerName="manager" containerID="cri-o://c5f57d3281e60cb8aba2a4a1f668e9a1361293bdcdbc6a8a3420346be040dec5" gracePeriod=30 Oct 31 01:16:08.320721 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:08.320661 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc84dbdd5-jss6g" Oct 31 01:16:08.427145 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:08.427107 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a52de73a-adf1-4e49-affa-1108b8b71e44-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a52de73a-adf1-4e49-affa-1108b8b71e44-metrics-certs\") pod \"a52de73a-adf1-4e49-affa-1108b8b71e44\" (UID: \"a52de73a-adf1-4e49-affa-1108b8b71e44\") " Oct 31 01:16:08.427309 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:08.427293 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a52de73a-adf1-4e49-affa-1108b8b71e44-webhook-cert\" (UniqueName: \"kubernetes.io/secret/a52de73a-adf1-4e49-affa-1108b8b71e44-webhook-cert\") pod \"a52de73a-adf1-4e49-affa-1108b8b71e44\" (UID: \"a52de73a-adf1-4e49-affa-1108b8b71e44\") " Oct 31 01:16:08.427351 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:08.427342 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a52de73a-adf1-4e49-affa-1108b8b71e44-kube-api-access-2c8xk\" (UniqueName: \"kubernetes.io/projected/a52de73a-adf1-4e49-affa-1108b8b71e44-kube-api-access-2c8xk\") pod \"a52de73a-adf1-4e49-affa-1108b8b71e44\" (UID: \"a52de73a-adf1-4e49-affa-1108b8b71e44\") " Oct 31 01:16:08.429208 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:08.429175 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a52de73a-adf1-4e49-affa-1108b8b71e44-metrics-certs" pod "a52de73a-adf1-4e49-affa-1108b8b71e44" (UID: "a52de73a-adf1-4e49-affa-1108b8b71e44"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:16:08.429324 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:08.429304 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a52de73a-adf1-4e49-affa-1108b8b71e44-webhook-cert" pod "a52de73a-adf1-4e49-affa-1108b8b71e44" (UID: "a52de73a-adf1-4e49-affa-1108b8b71e44"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:16:08.429371 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:08.429309 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a52de73a-adf1-4e49-affa-1108b8b71e44-kube-api-access-2c8xk" pod "a52de73a-adf1-4e49-affa-1108b8b71e44" (UID: "a52de73a-adf1-4e49-affa-1108b8b71e44"). InnerVolumeSpecName "kube-api-access-2c8xk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:16:08.528260 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:08.528213 5821 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a52de73a-adf1-4e49-affa-1108b8b71e44-webhook-cert\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:16:08.528260 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:08.528259 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2c8xk\" (UniqueName: \"kubernetes.io/projected/a52de73a-adf1-4e49-affa-1108b8b71e44-kube-api-access-2c8xk\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:16:08.528260 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:08.528269 5821 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a52de73a-adf1-4e49-affa-1108b8b71e44-metrics-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:16:08.678293 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:08.678253 5821 generic.go:356] "Generic (PLEG): container finished" podID="a52de73a-adf1-4e49-affa-1108b8b71e44" containerID="c5f57d3281e60cb8aba2a4a1f668e9a1361293bdcdbc6a8a3420346be040dec5" exitCode=0 Oct 31 01:16:08.678477 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:08.678303 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc84dbdd5-jss6g" Oct 31 01:16:08.678477 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:08.678339 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc84dbdd5-jss6g" event={"ID":"a52de73a-adf1-4e49-affa-1108b8b71e44","Type":"ContainerDied","Data":"c5f57d3281e60cb8aba2a4a1f668e9a1361293bdcdbc6a8a3420346be040dec5"} Oct 31 01:16:08.678477 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:08.678403 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc84dbdd5-jss6g" event={"ID":"a52de73a-adf1-4e49-affa-1108b8b71e44","Type":"ContainerDied","Data":"5aa1bd4a2554c0241162fdcd9c9b3c3db39ba2dbd74bcf54e48d9fb760b7f6ec"} Oct 31 01:16:08.678477 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:08.678432 5821 scope.go:122] "RemoveContainer" containerID="c5f57d3281e60cb8aba2a4a1f668e9a1361293bdcdbc6a8a3420346be040dec5" Oct 31 01:16:08.687671 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:08.687651 5821 scope.go:122] "RemoveContainer" containerID="c5f57d3281e60cb8aba2a4a1f668e9a1361293bdcdbc6a8a3420346be040dec5" Oct 31 01:16:08.687968 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:16:08.687951 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5f57d3281e60cb8aba2a4a1f668e9a1361293bdcdbc6a8a3420346be040dec5\": container with ID starting with c5f57d3281e60cb8aba2a4a1f668e9a1361293bdcdbc6a8a3420346be040dec5 not found: ID does not exist" containerID="c5f57d3281e60cb8aba2a4a1f668e9a1361293bdcdbc6a8a3420346be040dec5" Oct 31 01:16:08.688020 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:08.687977 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5f57d3281e60cb8aba2a4a1f668e9a1361293bdcdbc6a8a3420346be040dec5"} err="failed to get container status \"c5f57d3281e60cb8aba2a4a1f668e9a1361293bdcdbc6a8a3420346be040dec5\": rpc error: code = NotFound desc = could not find container \"c5f57d3281e60cb8aba2a4a1f668e9a1361293bdcdbc6a8a3420346be040dec5\": container with ID starting with c5f57d3281e60cb8aba2a4a1f668e9a1361293bdcdbc6a8a3420346be040dec5 not found: ID does not exist" Oct 31 01:16:08.701426 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:08.701402 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dc84dbdd5-jss6g"] Oct 31 01:16:08.703694 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:08.703673 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-dc84dbdd5-jss6g"] Oct 31 01:16:09.565165 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:09.565133 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a52de73a-adf1-4e49-affa-1108b8b71e44" path="/var/lib/kubelet/pods/a52de73a-adf1-4e49-affa-1108b8b71e44/volumes" Oct 31 01:16:09.984661 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:09.984625 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dc84dbdd5-bt25k"] Oct 31 01:16:09.985025 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:09.985011 5821 cpu_manager.go:414] "containerMap: removing container" podUID="dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" containerName="istio-proxy" Oct 31 01:16:09.985075 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:09.985027 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" containerName="istio-proxy" Oct 31 01:16:09.985075 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:09.985050 5821 cpu_manager.go:414] "containerMap: removing container" podUID="6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" containerName="istio-proxy" Oct 31 01:16:09.985075 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:09.985055 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" containerName="istio-proxy" Oct 31 01:16:09.985075 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:09.985065 5821 cpu_manager.go:414] "containerMap: removing container" podUID="a52de73a-adf1-4e49-affa-1108b8b71e44" containerName="manager" Oct 31 01:16:09.985075 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:09.985071 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a52de73a-adf1-4e49-affa-1108b8b71e44" containerName="manager" Oct 31 01:16:09.985226 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:09.985078 5821 cpu_manager.go:414] "containerMap: removing container" podUID="b1d931c4-c812-4646-94a2-d7469b0ca856" containerName="istio-proxy" Oct 31 01:16:09.985226 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:09.985083 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1d931c4-c812-4646-94a2-d7469b0ca856" containerName="istio-proxy" Oct 31 01:16:09.985226 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:09.985144 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="dc40b2f0-2ac7-4ed3-9d00-7e116ad2b40b" containerName="istio-proxy" Oct 31 01:16:09.985226 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:09.985155 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="6cd2d2b1-7a55-44b9-b8a0-171e9af4587d" containerName="istio-proxy" Oct 31 01:16:09.985226 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:09.985162 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="a52de73a-adf1-4e49-affa-1108b8b71e44" containerName="manager" Oct 31 01:16:09.985226 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:09.985167 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="b1d931c4-c812-4646-94a2-d7469b0ca856" containerName="istio-proxy" Oct 31 01:16:09.989524 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:09.989494 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc84dbdd5-bt25k" Oct 31 01:16:09.997836 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:09.997748 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Oct 31 01:16:09.999204 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:09.999091 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Oct 31 01:16:09.999204 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:09.999170 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Oct 31 01:16:09.999387 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:09.999267 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hbl9k\"" Oct 31 01:16:09.999387 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:09.999349 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dc84dbdd5-bt25k"] Oct 31 01:16:10.144105 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:10.144072 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pjn5\" (UniqueName: \"kubernetes.io/projected/0bc5b184-05e2-4bd6-8d67-745ec24db023-kube-api-access-7pjn5\") pod \"maas-controller-dc84dbdd5-bt25k\" (UID: \"0bc5b184-05e2-4bd6-8d67-745ec24db023\") " pod="opendatahub/maas-controller-dc84dbdd5-bt25k" Oct 31 01:16:10.144295 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:10.144115 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0bc5b184-05e2-4bd6-8d67-745ec24db023-webhook-cert\") pod \"maas-controller-dc84dbdd5-bt25k\" (UID: \"0bc5b184-05e2-4bd6-8d67-745ec24db023\") " pod="opendatahub/maas-controller-dc84dbdd5-bt25k" Oct 31 01:16:10.144295 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:10.144240 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bc5b184-05e2-4bd6-8d67-745ec24db023-metrics-certs\") pod \"maas-controller-dc84dbdd5-bt25k\" (UID: \"0bc5b184-05e2-4bd6-8d67-745ec24db023\") " pod="opendatahub/maas-controller-dc84dbdd5-bt25k" Oct 31 01:16:10.244971 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:10.244880 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0bc5b184-05e2-4bd6-8d67-745ec24db023-webhook-cert\") pod \"maas-controller-dc84dbdd5-bt25k\" (UID: \"0bc5b184-05e2-4bd6-8d67-745ec24db023\") " pod="opendatahub/maas-controller-dc84dbdd5-bt25k" Oct 31 01:16:10.244971 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:10.244953 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bc5b184-05e2-4bd6-8d67-745ec24db023-metrics-certs\") pod \"maas-controller-dc84dbdd5-bt25k\" (UID: \"0bc5b184-05e2-4bd6-8d67-745ec24db023\") " pod="opendatahub/maas-controller-dc84dbdd5-bt25k" Oct 31 01:16:10.245219 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:10.244994 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pjn5\" (UniqueName: \"kubernetes.io/projected/0bc5b184-05e2-4bd6-8d67-745ec24db023-kube-api-access-7pjn5\") pod \"maas-controller-dc84dbdd5-bt25k\" (UID: \"0bc5b184-05e2-4bd6-8d67-745ec24db023\") " pod="opendatahub/maas-controller-dc84dbdd5-bt25k" Oct 31 01:16:10.247473 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:10.247445 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0bc5b184-05e2-4bd6-8d67-745ec24db023-webhook-cert\") pod \"maas-controller-dc84dbdd5-bt25k\" (UID: \"0bc5b184-05e2-4bd6-8d67-745ec24db023\") " pod="opendatahub/maas-controller-dc84dbdd5-bt25k" Oct 31 01:16:10.247598 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:10.247472 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bc5b184-05e2-4bd6-8d67-745ec24db023-metrics-certs\") pod \"maas-controller-dc84dbdd5-bt25k\" (UID: \"0bc5b184-05e2-4bd6-8d67-745ec24db023\") " pod="opendatahub/maas-controller-dc84dbdd5-bt25k" Oct 31 01:16:10.252691 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:10.252665 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pjn5\" (UniqueName: \"kubernetes.io/projected/0bc5b184-05e2-4bd6-8d67-745ec24db023-kube-api-access-7pjn5\") pod \"maas-controller-dc84dbdd5-bt25k\" (UID: \"0bc5b184-05e2-4bd6-8d67-745ec24db023\") " pod="opendatahub/maas-controller-dc84dbdd5-bt25k" Oct 31 01:16:10.302998 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:10.302965 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc84dbdd5-bt25k" Oct 31 01:16:10.573789 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:10.573763 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dc84dbdd5-bt25k"] Oct 31 01:16:10.576449 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:16:10.576423 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc5b184_05e2_4bd6_8d67_745ec24db023.slice/crio-c354975bc5f142a08b216952b17ed14a4341c4bcef731070a4ab9e16d9ce4819 WatchSource:0}: Error finding container c354975bc5f142a08b216952b17ed14a4341c4bcef731070a4ab9e16d9ce4819: Status 404 returned error can't find the container with id c354975bc5f142a08b216952b17ed14a4341c4bcef731070a4ab9e16d9ce4819 Oct 31 01:16:10.690753 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:10.690717 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc84dbdd5-bt25k" event={"ID":"0bc5b184-05e2-4bd6-8d67-745ec24db023","Type":"ContainerStarted","Data":"c354975bc5f142a08b216952b17ed14a4341c4bcef731070a4ab9e16d9ce4819"} Oct 31 01:16:11.703847 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:11.703801 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc84dbdd5-bt25k" event={"ID":"0bc5b184-05e2-4bd6-8d67-745ec24db023","Type":"ContainerStarted","Data":"25c66c871aa4b467ceb9c8e95c342e3f65e2fc0f94bab76a88624a26acafe4e4"} Oct 31 01:16:11.704329 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:11.704051 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dc84dbdd5-bt25k" Oct 31 01:16:11.723039 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:11.722981 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-dc84dbdd5-bt25k" podStartSLOduration=2.049473051 podStartE2EDuration="2.722966772s" totalImagesPullingTime="673.493721ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:16:11.721307773 +0000 UTC m=+1188.300721689" watchObservedRunningTime="2026-10-31 01:16:11.722966772 +0000 UTC m=+1188.302380677" Oct 31 01:16:17.199735 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:16:17.199694 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:16:22.711367 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:22.711327 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dc84dbdd5-bt25k" Oct 31 01:16:23.743904 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:23.743877 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/1.log" Oct 31 01:16:23.744334 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:16:23.743878 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/1.log" Oct 31 01:16:47.233525 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:16:47.233485 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:17:17.199381 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:17:17.199341 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:17:47.198959 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:17:47.198871 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:18:17.198899 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:18:17.198859 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:18:47.200286 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:18:47.200246 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:18:50.254873 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:18:50.254825 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-xrzzh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:18:50.255651 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:18:50.255606 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" podUID="60eebb39-7f6b-49cc-ba62-d7e82db53ec7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:19:17.200310 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:19:17.200219 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:19:35.258791 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:19:35.258727 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-xrzzh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:19:35.259648 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:19:35.259603 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-xrzzh" podUID="60eebb39-7f6b-49cc-ba62-d7e82db53ec7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:19:47.198906 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:19:47.198867 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:20:03.905722 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:20:03.905671 5821 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-855f9574cf-jl2rk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 31 01:20:03.906495 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:20:03.906458 5821 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-855f9574cf-jl2rk" podUID="4ea534a5-bd49-4cbd-b0ec-5b60c645546b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 31 01:20:17.199184 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:20:17.199144 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:20:47.238286 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:20:47.238208 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:21:17.200830 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:21:17.200782 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:21:23.776284 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:21:23.776252 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/1.log" Oct 31 01:21:23.777596 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:21:23.777543 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/1.log" Oct 31 01:21:24.056953 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:21:24.056867 5821 scope.go:122] "RemoveContainer" containerID="6237664f50dfd86d54b090d8d8879b632cfec305e4c9e98883cbcef568b0705f" Oct 31 01:21:47.199250 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:21:47.199205 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:22:17.199184 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:22:17.199102 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:22:47.199542 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:22:47.199505 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:23:17.199513 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:23:17.199471 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:23:47.201999 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:23:47.201909 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:24:17.199066 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:24:17.199029 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:24:47.199932 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:24:47.199895 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:25:17.199296 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:25:17.199260 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:25:47.198418 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:25:47.198376 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:26:17.199649 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:26:17.199607 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:26:23.806648 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:26:23.806617 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/1.log" Oct 31 01:26:23.807323 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:26:23.807306 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/1.log" Oct 31 01:26:47.199714 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:26:47.199631 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:27:17.198178 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:27:17.198133 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:27:22.369101 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:22.369060 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8"] Oct 31 01:27:22.372399 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:22.372378 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8" Oct 31 01:27:22.386274 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:22.386243 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8"] Oct 31 01:27:22.461286 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:22.461253 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfcvh\" (UniqueName: \"kubernetes.io/projected/04385ac8-4f56-4936-b665-293c110dba48-kube-api-access-hfcvh\") pod \"maas-api-7fbdfc6954-7ftz8\" (UID: \"04385ac8-4f56-4936-b665-293c110dba48\") " pod="odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8" Oct 31 01:27:22.461486 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:22.461307 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04385ac8-4f56-4936-b665-293c110dba48-metrics-certs\") pod \"maas-api-7fbdfc6954-7ftz8\" (UID: \"04385ac8-4f56-4936-b665-293c110dba48\") " pod="odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8" Oct 31 01:27:22.461486 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:22.461425 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04385ac8-4f56-4936-b665-293c110dba48-maas-api-tls\") pod \"maas-api-7fbdfc6954-7ftz8\" (UID: \"04385ac8-4f56-4936-b665-293c110dba48\") " pod="odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8" Oct 31 01:27:22.461486 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:22.461465 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04385ac8-4f56-4936-b665-293c110dba48-openshift-service-ca\") pod \"maas-api-7fbdfc6954-7ftz8\" (UID: \"04385ac8-4f56-4936-b665-293c110dba48\") " pod="odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8" Oct 31 01:27:22.563014 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:22.562978 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04385ac8-4f56-4936-b665-293c110dba48-maas-api-tls\") pod \"maas-api-7fbdfc6954-7ftz8\" (UID: \"04385ac8-4f56-4936-b665-293c110dba48\") " pod="odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8" Oct 31 01:27:22.563014 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:22.563020 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04385ac8-4f56-4936-b665-293c110dba48-openshift-service-ca\") pod \"maas-api-7fbdfc6954-7ftz8\" (UID: \"04385ac8-4f56-4936-b665-293c110dba48\") " pod="odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8" Oct 31 01:27:22.563266 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:22.563066 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfcvh\" (UniqueName: \"kubernetes.io/projected/04385ac8-4f56-4936-b665-293c110dba48-kube-api-access-hfcvh\") pod \"maas-api-7fbdfc6954-7ftz8\" (UID: \"04385ac8-4f56-4936-b665-293c110dba48\") " pod="odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8" Oct 31 01:27:22.563266 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:22.563103 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04385ac8-4f56-4936-b665-293c110dba48-metrics-certs\") pod \"maas-api-7fbdfc6954-7ftz8\" (UID: \"04385ac8-4f56-4936-b665-293c110dba48\") " pod="odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8" Oct 31 01:27:22.563791 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:22.563762 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04385ac8-4f56-4936-b665-293c110dba48-openshift-service-ca\") pod \"maas-api-7fbdfc6954-7ftz8\" (UID: \"04385ac8-4f56-4936-b665-293c110dba48\") " pod="odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8" Oct 31 01:27:22.565622 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:22.565599 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04385ac8-4f56-4936-b665-293c110dba48-metrics-certs\") pod \"maas-api-7fbdfc6954-7ftz8\" (UID: \"04385ac8-4f56-4936-b665-293c110dba48\") " pod="odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8" Oct 31 01:27:22.565729 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:22.565644 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04385ac8-4f56-4936-b665-293c110dba48-maas-api-tls\") pod \"maas-api-7fbdfc6954-7ftz8\" (UID: \"04385ac8-4f56-4936-b665-293c110dba48\") " pod="odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8" Oct 31 01:27:22.575343 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:22.575318 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfcvh\" (UniqueName: \"kubernetes.io/projected/04385ac8-4f56-4936-b665-293c110dba48-kube-api-access-hfcvh\") pod \"maas-api-7fbdfc6954-7ftz8\" (UID: \"04385ac8-4f56-4936-b665-293c110dba48\") " pod="odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8" Oct 31 01:27:22.685768 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:22.685678 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8" Oct 31 01:27:22.979910 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:22.979822 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8"] Oct 31 01:27:22.984355 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:27:22.984325 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04385ac8_4f56_4936_b665_293c110dba48.slice/crio-8d8d5b011bfe601591ee8384017b14c23c33fe5c7a246b24f6f424a74ff880d9 WatchSource:0}: Error finding container 8d8d5b011bfe601591ee8384017b14c23c33fe5c7a246b24f6f424a74ff880d9: Status 404 returned error can't find the container with id 8d8d5b011bfe601591ee8384017b14c23c33fe5c7a246b24f6f424a74ff880d9 Oct 31 01:27:22.985756 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:22.985735 5821 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 31 01:27:23.196617 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:23.196543 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8" event={"ID":"04385ac8-4f56-4936-b665-293c110dba48","Type":"ContainerStarted","Data":"8d8d5b011bfe601591ee8384017b14c23c33fe5c7a246b24f6f424a74ff880d9"} Oct 31 01:27:24.202087 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:24.202041 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8" event={"ID":"04385ac8-4f56-4936-b665-293c110dba48","Type":"ContainerStarted","Data":"33d3dcbc17b51dbf26ba0a29dbee6d9a06d47025745f4a27304af6bf40528977"} Oct 31 01:27:24.202528 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:24.202133 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8" Oct 31 01:27:24.230845 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:24.230797 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8" podStartSLOduration=1.822771923 podStartE2EDuration="2.230784923s" totalImagesPullingTime="408.013ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:27:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:27:24.22945727 +0000 UTC m=+1860.808871177" watchObservedRunningTime="2026-10-31 01:27:24.230784923 +0000 UTC m=+1860.810198830" Oct 31 01:27:30.212284 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:30.212254 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7fbdfc6954-7ftz8" Oct 31 01:27:30.262397 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:30.262345 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp"] Oct 31 01:27:30.262689 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:30.262664 5821 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" podUID="03b53883-1556-4d78-808d-c06211f42faa" containerName="maas-api" containerID="cri-o://e79cde48fbde459978ec636ee1426fc61f68ec4bc2c9dc558e295330ae70fa66" gracePeriod=30 Oct 31 01:27:31.523102 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:31.523075 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" Oct 31 01:27:31.661150 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:31.661112 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/03b53883-1556-4d78-808d-c06211f42faa-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03b53883-1556-4d78-808d-c06211f42faa-openshift-service-ca\") pod \"03b53883-1556-4d78-808d-c06211f42faa\" (UID: \"03b53883-1556-4d78-808d-c06211f42faa\") " Oct 31 01:27:31.661329 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:31.661159 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/03b53883-1556-4d78-808d-c06211f42faa-kube-api-access-mbgqp\" (UniqueName: \"kubernetes.io/projected/03b53883-1556-4d78-808d-c06211f42faa-kube-api-access-mbgqp\") pod \"03b53883-1556-4d78-808d-c06211f42faa\" (UID: \"03b53883-1556-4d78-808d-c06211f42faa\") " Oct 31 01:27:31.661329 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:31.661259 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/03b53883-1556-4d78-808d-c06211f42faa-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03b53883-1556-4d78-808d-c06211f42faa-maas-api-tls\") pod \"03b53883-1556-4d78-808d-c06211f42faa\" (UID: \"03b53883-1556-4d78-808d-c06211f42faa\") " Oct 31 01:27:31.661329 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:31.661284 5821 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/03b53883-1556-4d78-808d-c06211f42faa-metrics-certs\" (UniqueName: \"kubernetes.io/secret/03b53883-1556-4d78-808d-c06211f42faa-metrics-certs\") pod \"03b53883-1556-4d78-808d-c06211f42faa\" (UID: \"03b53883-1556-4d78-808d-c06211f42faa\") " Oct 31 01:27:31.661574 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:31.661531 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03b53883-1556-4d78-808d-c06211f42faa-openshift-service-ca" pod "03b53883-1556-4d78-808d-c06211f42faa" (UID: "03b53883-1556-4d78-808d-c06211f42faa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 31 01:27:31.663498 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:31.663469 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b53883-1556-4d78-808d-c06211f42faa-metrics-certs" pod "03b53883-1556-4d78-808d-c06211f42faa" (UID: "03b53883-1556-4d78-808d-c06211f42faa"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:27:31.663620 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:31.663521 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b53883-1556-4d78-808d-c06211f42faa-maas-api-tls" pod "03b53883-1556-4d78-808d-c06211f42faa" (UID: "03b53883-1556-4d78-808d-c06211f42faa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 31 01:27:31.663620 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:31.663568 5821 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03b53883-1556-4d78-808d-c06211f42faa-kube-api-access-mbgqp" pod "03b53883-1556-4d78-808d-c06211f42faa" (UID: "03b53883-1556-4d78-808d-c06211f42faa"). InnerVolumeSpecName "kube-api-access-mbgqp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 31 01:27:31.763019 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:31.762984 5821 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03b53883-1556-4d78-808d-c06211f42faa-maas-api-tls\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:27:31.763019 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:31.763019 5821 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03b53883-1556-4d78-808d-c06211f42faa-metrics-certs\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:27:31.763222 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:31.763034 5821 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03b53883-1556-4d78-808d-c06211f42faa-openshift-service-ca\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:27:31.763222 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:31.763049 5821 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbgqp\" (UniqueName: \"kubernetes.io/projected/03b53883-1556-4d78-808d-c06211f42faa-kube-api-access-mbgqp\") on node \"ip-10-0-132-179.us-east-2.compute.internal\" DevicePath \"\"" Oct 31 01:27:32.241146 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:32.241113 5821 generic.go:356] "Generic (PLEG): container finished" podID="03b53883-1556-4d78-808d-c06211f42faa" containerID="e79cde48fbde459978ec636ee1426fc61f68ec4bc2c9dc558e295330ae70fa66" exitCode=0 Oct 31 01:27:32.241354 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:32.241166 5821 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" Oct 31 01:27:32.241354 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:32.241202 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" event={"ID":"03b53883-1556-4d78-808d-c06211f42faa","Type":"ContainerDied","Data":"e79cde48fbde459978ec636ee1426fc61f68ec4bc2c9dc558e295330ae70fa66"} Oct 31 01:27:32.241354 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:32.241267 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp" event={"ID":"03b53883-1556-4d78-808d-c06211f42faa","Type":"ContainerDied","Data":"e181f11bff38904157f7c34c51a2273c53323dd15eb7235266e49c6509721165"} Oct 31 01:27:32.241354 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:32.241297 5821 scope.go:122] "RemoveContainer" containerID="e79cde48fbde459978ec636ee1426fc61f68ec4bc2c9dc558e295330ae70fa66" Oct 31 01:27:32.255771 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:32.255723 5821 scope.go:122] "RemoveContainer" containerID="e79cde48fbde459978ec636ee1426fc61f68ec4bc2c9dc558e295330ae70fa66" Oct 31 01:27:32.256084 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:27:32.256064 5821 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e79cde48fbde459978ec636ee1426fc61f68ec4bc2c9dc558e295330ae70fa66\": container with ID starting with e79cde48fbde459978ec636ee1426fc61f68ec4bc2c9dc558e295330ae70fa66 not found: ID does not exist" containerID="e79cde48fbde459978ec636ee1426fc61f68ec4bc2c9dc558e295330ae70fa66" Oct 31 01:27:32.256139 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:32.256093 5821 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e79cde48fbde459978ec636ee1426fc61f68ec4bc2c9dc558e295330ae70fa66"} err="failed to get container status \"e79cde48fbde459978ec636ee1426fc61f68ec4bc2c9dc558e295330ae70fa66\": rpc error: code = NotFound desc = could not find container \"e79cde48fbde459978ec636ee1426fc61f68ec4bc2c9dc558e295330ae70fa66\": container with ID starting with e79cde48fbde459978ec636ee1426fc61f68ec4bc2c9dc558e295330ae70fa66 not found: ID does not exist" Oct 31 01:27:32.271429 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:32.271405 5821 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp"] Oct 31 01:27:32.278488 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:32.278464 5821 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-74dcff9898-bcrbp"] Oct 31 01:27:33.565364 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:27:33.565331 5821 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="03b53883-1556-4d78-808d-c06211f42faa" path="/var/lib/kubelet/pods/03b53883-1556-4d78-808d-c06211f42faa/volumes" Oct 31 01:27:47.199573 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:27:47.199510 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:28:17.199012 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:28:17.198934 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:28:47.201251 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:28:47.201212 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:29:17.198385 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:29:17.198349 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:29:47.200664 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:29:47.200571 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:30:17.198813 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:30:17.198777 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:30:47.198424 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:30:47.198382 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:31:00.380509 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:00.380478 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-wssxm_1d976b58-6172-43d5-a1b9-f2df6c0f0a01/manager/0.log" Oct 31 01:31:00.771719 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:00.771639 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-kwpvb_76963baa-c132-4c79-97b9-5402f25d80af/manager/0.log" Oct 31 01:31:01.028090 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:01.027996 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-dc84dbdd5-bt25k_0bc5b184-05e2-4bd6-8d67-745ec24db023/manager/0.log" Oct 31 01:31:01.661310 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:01.661281 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-w7lk7_c2513372-48c8-4227-909d-aed579f5a7d3/proxy/0.log" Oct 31 01:31:02.423963 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:02.423917 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7fbdfc6954-7ftz8_04385ac8-4f56-4936-b665-293c110dba48/maas-api/0.log" Oct 31 01:31:03.911420 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:03.911341 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-bjtx2_83182bc7-dc7c-44b1-94ef-1084da38cc97/postgres/0.log" Oct 31 01:31:07.620154 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:07.620124 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-xqkhz_aec234d3-c4ae-46a2-8ee7-5f27b62be675/discovery/0.log" Oct 31 01:31:07.991879 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:07.991796 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-858778b8-kkgd8_b7d07e59-68ee-4dd5-82e5-f1c353915f63/kube-auth-proxy/0.log" Oct 31 01:31:08.577715 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:08.577682 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-855f9574cf-bvpfd_dd60c366-7aad-4b22-8e91-55da66289297/istio-proxy/0.log" Oct 31 01:31:08.743012 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:08.742981 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-855f9574cf-jl2rk_4ea534a5-bd49-4cbd-b0ec-5b60c645546b/istio-proxy/0.log" Oct 31 01:31:09.892077 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:09.892042 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-855f9574cf-xrzzh_60eebb39-7f6b-49cc-ba62-d7e82db53ec7/istio-proxy/0.log" Oct 31 01:31:10.673234 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:10.673207 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-788b97d875-vrvqf_e51caef4-2776-4216-9143-2c07435c062b/router/0.log" Oct 31 01:31:17.199486 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:31:17.199441 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:31:23.104140 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:23.104110 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-wssxm_1d976b58-6172-43d5-a1b9-f2df6c0f0a01/manager/0.log" Oct 31 01:31:23.494999 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:23.494966 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-kwpvb_76963baa-c132-4c79-97b9-5402f25d80af/manager/0.log" Oct 31 01:31:23.700904 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:23.700874 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-dc84dbdd5-bt25k_0bc5b184-05e2-4bd6-8d67-745ec24db023/manager/0.log" Oct 31 01:31:23.836340 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:23.836259 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/1.log" Oct 31 01:31:23.838332 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:23.838304 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/1.log" Oct 31 01:31:24.299148 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:24.299118 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-w7lk7_c2513372-48c8-4227-909d-aed579f5a7d3/proxy/0.log" Oct 31 01:31:24.832690 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:24.832659 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7fbdfc6954-7ftz8_04385ac8-4f56-4936-b665-293c110dba48/maas-api/0.log" Oct 31 01:31:26.323192 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:26.323156 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-bjtx2_83182bc7-dc7c-44b1-94ef-1084da38cc97/postgres/0.log" Oct 31 01:31:29.432231 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:29.432195 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-xqkhz_aec234d3-c4ae-46a2-8ee7-5f27b62be675/discovery/0.log" Oct 31 01:31:29.802613 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:29.802514 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-858778b8-kkgd8_b7d07e59-68ee-4dd5-82e5-f1c353915f63/kube-auth-proxy/0.log" Oct 31 01:31:30.343663 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:30.343630 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-855f9574cf-bvpfd_dd60c366-7aad-4b22-8e91-55da66289297/istio-proxy/0.log" Oct 31 01:31:30.529103 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:30.529069 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-855f9574cf-jl2rk_4ea534a5-bd49-4cbd-b0ec-5b60c645546b/istio-proxy/0.log" Oct 31 01:31:31.634972 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:31.634938 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-855f9574cf-xrzzh_60eebb39-7f6b-49cc-ba62-d7e82db53ec7/istio-proxy/0.log" Oct 31 01:31:32.336568 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:31:32.336532 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-788b97d875-vrvqf_e51caef4-2776-4216-9143-2c07435c062b/router/0.log" Oct 31 01:31:47.198811 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:31:47.198772 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:32:12.313572 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:32:12.313520 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-dc84dbdd5-bt25k_0bc5b184-05e2-4bd6-8d67-745ec24db023/manager/0.log" Oct 31 01:32:12.586255 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:32:12.586166 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-dc84dbdd5-bt25k_0bc5b184-05e2-4bd6-8d67-745ec24db023/manager/0.log" Oct 31 01:32:17.199351 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:32:17.199312 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:32:47.198974 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:32:47.198888 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:33:00.180901 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:00.180863 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-dc84dbdd5-bt25k_0bc5b184-05e2-4bd6-8d67-745ec24db023/manager/0.log" Oct 31 01:33:00.461594 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:00.461481 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-dc84dbdd5-bt25k_0bc5b184-05e2-4bd6-8d67-745ec24db023/manager/0.log" Oct 31 01:33:05.294716 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:05.294684 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wtcjv_6d207e59-c491-43cb-a331-5b89a78f470c/global-pull-secret-syncer/0.log" Oct 31 01:33:05.342029 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:05.341991 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-l8fz4_314bbfb5-1511-4a13-9a52-9bee729f1b2e/connection-checker/0.log" Oct 31 01:33:05.368264 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:05.368237 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-md87z_e4573d06-669b-4764-9609-9bdc204c419a/connection-checker/0.log" Oct 31 01:33:05.393225 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:05.393192 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-s8pvr_d050f2b3-1f51-4f94-8d13-075aa3288bd1/connection-checker/0.log" Oct 31 01:33:05.480205 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:05.480171 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fzjbb_33816f29-a274-4bbb-83d7-72820504fee3/konnectivity-agent/0.log" Oct 31 01:33:05.575104 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:05.575018 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-179.us-east-2.compute.internal_0222b47fe84780a8d4956385717c70a6/haproxy/0.log" Oct 31 01:33:14.802548 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:14.802511 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-znxnl_fe4d93b4-1929-4fbe-9bf3-834f03268472/cluster-monitoring-operator/0.log" Oct 31 01:33:15.072730 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.072646 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-86lqd_941502cf-4052-466b-bccd-6208772eb8c0/node-exporter/0.log" Oct 31 01:33:15.093608 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.093583 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-86lqd_941502cf-4052-466b-bccd-6208772eb8c0/kube-rbac-proxy/0.log" Oct 31 01:33:15.115918 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.115884 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-86lqd_941502cf-4052-466b-bccd-6208772eb8c0/init-textfile/0.log" Oct 31 01:33:15.699796 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.699762 5821 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z"] Oct 31 01:33:15.700146 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.700133 5821 cpu_manager.go:414] "containerMap: removing container" podUID="03b53883-1556-4d78-808d-c06211f42faa" containerName="maas-api" Oct 31 01:33:15.700192 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.700146 5821 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="03b53883-1556-4d78-808d-c06211f42faa" containerName="maas-api" Oct 31 01:33:15.700247 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.700238 5821 memory_manager.go:365] "RemoveStaleState removing state" podUID="03b53883-1556-4d78-808d-c06211f42faa" containerName="maas-api" Oct 31 01:33:15.703267 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.703244 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" Oct 31 01:33:15.711213 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.711188 5821 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fsd8j\"/\"default-dockercfg-mphnn\"" Oct 31 01:33:15.714134 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.714108 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fsd8j\"/\"openshift-service-ca.crt\"" Oct 31 01:33:15.714302 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.714144 5821 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fsd8j\"/\"kube-root-ca.crt\"" Oct 31 01:33:15.715053 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.715030 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z"] Oct 31 01:33:15.782657 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.782615 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ce588996-2b92-4dd1-b28d-e60f043d233a-podres\") pod \"perf-node-gather-daemonset-pj76z\" (UID: \"ce588996-2b92-4dd1-b28d-e60f043d233a\") " pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" Oct 31 01:33:15.782836 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.782676 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce588996-2b92-4dd1-b28d-e60f043d233a-sys\") pod \"perf-node-gather-daemonset-pj76z\" (UID: \"ce588996-2b92-4dd1-b28d-e60f043d233a\") " pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" Oct 31 01:33:15.782836 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.782746 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ce588996-2b92-4dd1-b28d-e60f043d233a-proc\") pod \"perf-node-gather-daemonset-pj76z\" (UID: \"ce588996-2b92-4dd1-b28d-e60f043d233a\") " pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" Oct 31 01:33:15.782836 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.782785 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv8gl\" (UniqueName: \"kubernetes.io/projected/ce588996-2b92-4dd1-b28d-e60f043d233a-kube-api-access-wv8gl\") pod \"perf-node-gather-daemonset-pj76z\" (UID: \"ce588996-2b92-4dd1-b28d-e60f043d233a\") " pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" Oct 31 01:33:15.782959 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.782845 5821 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce588996-2b92-4dd1-b28d-e60f043d233a-lib-modules\") pod \"perf-node-gather-daemonset-pj76z\" (UID: \"ce588996-2b92-4dd1-b28d-e60f043d233a\") " pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" Oct 31 01:33:15.883814 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.883776 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ce588996-2b92-4dd1-b28d-e60f043d233a-podres\") pod \"perf-node-gather-daemonset-pj76z\" (UID: \"ce588996-2b92-4dd1-b28d-e60f043d233a\") " pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" Oct 31 01:33:15.884239 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.883831 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce588996-2b92-4dd1-b28d-e60f043d233a-sys\") pod \"perf-node-gather-daemonset-pj76z\" (UID: \"ce588996-2b92-4dd1-b28d-e60f043d233a\") " pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" Oct 31 01:33:15.884239 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.883850 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ce588996-2b92-4dd1-b28d-e60f043d233a-proc\") pod \"perf-node-gather-daemonset-pj76z\" (UID: \"ce588996-2b92-4dd1-b28d-e60f043d233a\") " pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" Oct 31 01:33:15.884239 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.883876 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv8gl\" (UniqueName: \"kubernetes.io/projected/ce588996-2b92-4dd1-b28d-e60f043d233a-kube-api-access-wv8gl\") pod \"perf-node-gather-daemonset-pj76z\" (UID: \"ce588996-2b92-4dd1-b28d-e60f043d233a\") " pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" Oct 31 01:33:15.884239 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.883892 5821 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce588996-2b92-4dd1-b28d-e60f043d233a-lib-modules\") pod \"perf-node-gather-daemonset-pj76z\" (UID: \"ce588996-2b92-4dd1-b28d-e60f043d233a\") " pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" Oct 31 01:33:15.884239 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.883920 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ce588996-2b92-4dd1-b28d-e60f043d233a-podres\") pod \"perf-node-gather-daemonset-pj76z\" (UID: \"ce588996-2b92-4dd1-b28d-e60f043d233a\") " pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" Oct 31 01:33:15.884239 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.883963 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ce588996-2b92-4dd1-b28d-e60f043d233a-proc\") pod \"perf-node-gather-daemonset-pj76z\" (UID: \"ce588996-2b92-4dd1-b28d-e60f043d233a\") " pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" Oct 31 01:33:15.884239 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.883998 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce588996-2b92-4dd1-b28d-e60f043d233a-sys\") pod \"perf-node-gather-daemonset-pj76z\" (UID: \"ce588996-2b92-4dd1-b28d-e60f043d233a\") " pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" Oct 31 01:33:15.884239 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.884000 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce588996-2b92-4dd1-b28d-e60f043d233a-lib-modules\") pod \"perf-node-gather-daemonset-pj76z\" (UID: \"ce588996-2b92-4dd1-b28d-e60f043d233a\") " pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" Oct 31 01:33:15.892499 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:15.892476 5821 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv8gl\" (UniqueName: \"kubernetes.io/projected/ce588996-2b92-4dd1-b28d-e60f043d233a-kube-api-access-wv8gl\") pod \"perf-node-gather-daemonset-pj76z\" (UID: \"ce588996-2b92-4dd1-b28d-e60f043d233a\") " pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" Oct 31 01:33:16.016802 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:16.016718 5821 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" Oct 31 01:33:16.294754 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:16.294682 5821 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z"] Oct 31 01:33:16.298129 ip-10-0-132-179 kubenswrapper[5821]: W1031 01:33:16.298092 5821 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podce588996_2b92_4dd1_b28d_e60f043d233a.slice/crio-3d0e7300dec49be8e40fe42cdd4093a0fcbdf920bd6802633971bd9662249dfb WatchSource:0}: Error finding container 3d0e7300dec49be8e40fe42cdd4093a0fcbdf920bd6802633971bd9662249dfb: Status 404 returned error can't find the container with id 3d0e7300dec49be8e40fe42cdd4093a0fcbdf920bd6802633971bd9662249dfb Oct 31 01:33:16.860346 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:16.860307 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" event={"ID":"ce588996-2b92-4dd1-b28d-e60f043d233a","Type":"ContainerStarted","Data":"d197d5c3d81c0e6a404a4e736140779f595b69009bf1375d16957e819f26822d"} Oct 31 01:33:16.860569 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:16.860366 5821 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" event={"ID":"ce588996-2b92-4dd1-b28d-e60f043d233a","Type":"ContainerStarted","Data":"3d0e7300dec49be8e40fe42cdd4093a0fcbdf920bd6802633971bd9662249dfb"} Oct 31 01:33:16.860569 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:16.860523 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" Oct 31 01:33:16.878568 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:16.878515 5821 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" podStartSLOduration=1.878500774 podStartE2EDuration="1.878500774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 01:33:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:33:16.877250298 +0000 UTC m=+2213.456664217" watchObservedRunningTime="2026-10-31 01:33:16.878500774 +0000 UTC m=+2213.457914741" Oct 31 01:33:17.199625 ip-10-0-132-179 kubenswrapper[5821]: E1031 01:33:17.199512 5821 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-66jgl" containerName="extractor" Oct 31 01:33:17.274042 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:17.274003 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-fb9mh_a8fe7c8e-5707-47c2-82e9-f1dbe51d1a51/networking-console-plugin/0.log" Oct 31 01:33:17.889745 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:17.889707 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/1.log" Oct 31 01:33:17.894396 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:17.894370 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qtvqf_50554e95-e3c9-4f06-84ca-dd86c85bcf8a/console-operator/2.log" Oct 31 01:33:19.184268 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:19.184240 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-58c9f5f46d-wffrk_05787044-8eb5-4158-a092-69f7266871fb/volume-data-source-validator/0.log" Oct 31 01:33:20.338984 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:20.338956 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kg2kz_edf682ca-dae8-42a1-a573-0995bbb7188d/dns/0.log" Oct 31 01:33:20.361820 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:20.361794 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kg2kz_edf682ca-dae8-42a1-a573-0995bbb7188d/kube-rbac-proxy/0.log" Oct 31 01:33:20.555839 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:20.555809 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-twq8q_f6434cdd-b8a7-4fdb-ab00-53f19ce35b98/dns-node-resolver/0.log" Oct 31 01:33:21.181578 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:21.181540 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6mv8k_9b23111a-a892-4d92-990d-742a857450fa/node-ca/0.log" Oct 31 01:33:22.875871 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:22.875841 5821 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fsd8j/perf-node-gather-daemonset-pj76z" Oct 31 01:33:23.918957 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:23.918928 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-xqkhz_aec234d3-c4ae-46a2-8ee7-5f27b62be675/discovery/0.log" Oct 31 01:33:23.992186 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:23.992153 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-858778b8-kkgd8_b7d07e59-68ee-4dd5-82e5-f1c353915f63/kube-auth-proxy/0.log" Oct 31 01:33:24.103780 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:24.103750 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-855f9574cf-bvpfd_dd60c366-7aad-4b22-8e91-55da66289297/istio-proxy/0.log" Oct 31 01:33:24.142518 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:24.142483 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-855f9574cf-jl2rk_4ea534a5-bd49-4cbd-b0ec-5b60c645546b/istio-proxy/0.log" Oct 31 01:33:24.363547 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:24.363519 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-855f9574cf-xrzzh_60eebb39-7f6b-49cc-ba62-d7e82db53ec7/istio-proxy/0.log" Oct 31 01:33:24.493315 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:24.493279 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-788b97d875-vrvqf_e51caef4-2776-4216-9143-2c07435c062b/router/0.log" Oct 31 01:33:26.264692 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:26.264664 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wqhkd_42d46af4-addb-42c6-a15f-d1b717fb91b8/serve-healthcheck-canary/0.log" Oct 31 01:33:26.862529 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:26.862495 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-7sfl6_6dda3bac-470c-46f8-b510-8a73f6dc76c6/insights-operator/0.log" Oct 31 01:33:26.863180 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:26.863150 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-7sfl6_6dda3bac-470c-46f8-b510-8a73f6dc76c6/insights-operator/1.log" Oct 31 01:33:26.882958 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:26.882935 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-66jgl_03e53a8a-f8cb-4821-bd6b-ee63d0e25623/kube-rbac-proxy/0.log" Oct 31 01:33:26.904950 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:26.904924 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-66jgl_03e53a8a-f8cb-4821-bd6b-ee63d0e25623/exporter/0.log" Oct 31 01:33:26.931106 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:26.931074 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-66jgl_03e53a8a-f8cb-4821-bd6b-ee63d0e25623/extractor/0.log" Oct 31 01:33:27.143061 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:27.142974 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_periodic-gathering-gqgf7-x4kfr_3737c365-6bb7-4e45-a487-5a6ed8eda295/insights-gathering/0.log" Oct 31 01:33:27.184321 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:27.184284 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_periodic-gathering-kgzkz-wqj59_4dc0276d-1f7a-46e1-9b6d-34ed7595f3c5/insights-gathering/0.log" Oct 31 01:33:28.565587 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:28.565538 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-xqkhz_aec234d3-c4ae-46a2-8ee7-5f27b62be675/discovery/0.log" Oct 31 01:33:28.596191 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:28.596161 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-858778b8-kkgd8_b7d07e59-68ee-4dd5-82e5-f1c353915f63/kube-auth-proxy/0.log" Oct 31 01:33:28.652192 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:28.652154 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-855f9574cf-bvpfd_dd60c366-7aad-4b22-8e91-55da66289297/istio-proxy/0.log" Oct 31 01:33:28.668759 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:28.668726 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-855f9574cf-jl2rk_4ea534a5-bd49-4cbd-b0ec-5b60c645546b/istio-proxy/0.log" Oct 31 01:33:28.779430 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:28.779392 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-855f9574cf-xrzzh_60eebb39-7f6b-49cc-ba62-d7e82db53ec7/istio-proxy/0.log" Oct 31 01:33:28.859877 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:28.859859 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-788b97d875-vrvqf_e51caef4-2776-4216-9143-2c07435c062b/router/0.log" Oct 31 01:33:29.910822 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:29.910791 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-7f58f8c74c-znbxw_d1e23261-b317-48d7-a8a0-c65ecc6597ed/manager/0.log" Oct 31 01:33:29.936482 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:29.936454 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-7f58f8c74c-znbxw_d1e23261-b317-48d7-a8a0-c65ecc6597ed/copy-manifests/0.log" Oct 31 01:33:32.165127 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:32.165094 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-wssxm_1d976b58-6172-43d5-a1b9-f2df6c0f0a01/manager/0.log" Oct 31 01:33:32.339646 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:32.339590 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-xqkhz_aec234d3-c4ae-46a2-8ee7-5f27b62be675/discovery/0.log" Oct 31 01:33:32.408711 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:32.408678 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-858778b8-kkgd8_b7d07e59-68ee-4dd5-82e5-f1c353915f63/kube-auth-proxy/0.log" Oct 31 01:33:32.496632 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:32.496532 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-855f9574cf-bvpfd_dd60c366-7aad-4b22-8e91-55da66289297/istio-proxy/0.log" Oct 31 01:33:32.531725 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:32.531691 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-855f9574cf-jl2rk_4ea534a5-bd49-4cbd-b0ec-5b60c645546b/istio-proxy/0.log" Oct 31 01:33:32.533525 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:32.533508 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-kwpvb_76963baa-c132-4c79-97b9-5402f25d80af/manager/0.log" Oct 31 01:33:32.603286 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:32.603257 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-dc84dbdd5-bt25k_0bc5b184-05e2-4bd6-8d67-745ec24db023/manager/0.log" Oct 31 01:33:32.657530 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:32.657504 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-855f9574cf-xrzzh_60eebb39-7f6b-49cc-ba62-d7e82db53ec7/istio-proxy/0.log" Oct 31 01:33:32.737082 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:32.737057 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-788b97d875-vrvqf_e51caef4-2776-4216-9143-2c07435c062b/router/0.log" Oct 31 01:33:32.980737 ip-10-0-132-179 kubenswrapper[5821]: I1031 01:33:32.980708 5821 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-w7lk7_c2513372-48c8-4227-909d-aed579f5a7d3/proxy/0.log"